We have bubbled up your feedback / issue to the voice of customer team so it can be shared with the team that works on our home menu.
Note, we are working on improving hand tracking inside the home menu in our next OS release so it might be resolved next month. Never the less, we will make sure that the OS team is aware of the feedback.