That site has been having major problems long before F4 came out. A lot of the problems started happening after xbox.com did their update last year. Thats why you will notice that xbox.com is slow loading 90% of the time. It also effects Forzamotorsport.net.
So until they fix xbox.com, its Forzamotorsport will always be slow.