I have experienced this problem myself and seen on the Xbox ambassador chat other people have this problem can ether be a broken control which cant be fix or can be your console to fix this use the following steps:
- Turn off your console by holding the Xbox button on the front of the console for approximately 10 seconds. The console will turn off.
- Turn your console back on by pressing the Xbox button on the console or the Xbox button on your controller.
Note If you don't see the green boot-up animation when the console restarts, repeat these steps. Make sure that you hold the power button until the console completely shuts down.
Important If your console is in Instant-On power mode, the above steps will shut the console completely off. Instant-On mode, or the ability to turn on your console by saying "Xbox on," won't be enabled until you restart the console.