Not really freezing but just awful lag when I opened a chest, urn, or barrel.
It would also happen when pressing the d-pad for the favorites menu.
My quick fix was to clear the system cache and delete some old game save files but this only lasted for a gaming session and would soon return.
Then I found them. Dwemer Museum Keys. Thousands of them!
It turns out that there is a bug that is constantly replicating these keys.
Check your key inventory. Ditch these keys ASAP. Your game will play so much better.