Go to Settings → Remotes and Devices Click on TV button to make it show the Home Screen instead of opening the Apple TV App.
You can also change the speed of your trackpad
How to Customize the remote buttons on your Apple TV
NEXT TIP
Quickly switch between recent apps on Apple TV
Double-press the TV button to open the task switcher and swipe between apps.
TIP FROM
8 Apple TV Tips and Settings
How to customize Apple TV remote, pair AirPods, calibrate display, and set up screensavers