Hi Clement,
Thank you for updating to us about the issue.
To fix the issue, perform clean boot and try to install the pending Windows Updates manually (by installing two updates at a time) and test the issue.
Perform a Clean Boot.
Place the computer in clean boot and check if the issue persists. You may follow the article mentioned to perform a clean boot.
A clean boot allows the Windows operating system to launch without any additional programs or services running when you turn the computer on. This allows you to determine if computer issues are caused by a program or service that starts up when you
boot the machine.
Refer: http://support.microsoft.com/kb/929135
While the computer is in clean boot state, try to install the Windows Updates one by one and check if the updates are getting install without fail.
Note: After performing the troubleshooting steps, check the section
“how to reset the computer to start normally after clean boot troubleshooting”.
Hope this helps. Please let us know if you need any further help.