Xbox Series X: Graphics crash and keep turning gray after a while

Flickering every hour...have to restart the game...

The best solution I've had to fixing this issue for myself is to go into options and toggle dynamic resolution off and back on again and it resets it back to normal. I've tried a combo of having just dynamic on or off, I've tried just having dynamic culling on or off and nothing, I've tried having both turned on and it didn't fix it and having neither turned on didnt fixed it either. I've tried messing with the upscaling options as well and that arguably made it worse. It almost seems like the devs didn't allocate enough RAM to rendering and after rapidly changing from the skill tree menu to my inventory and then backing out or going in and out of my inventory and rendering all of the other players around me on top of it seems to max out the ram and it doesn't re-texture properly because of it. It would also explain why if you go back into your menu when the bug is happening it typically gets worse and everything goes grey because the game is still trying to correct the textures from before and now that the screen is mostly grey, once you go into a menu it re-renders and makes everything else grey afterwords. Hope this makes any amount of sense and I don't sound like Charlie from always sunny lol.

A friend I play with regularly also has this issue on Series S, and I do on Series X.
It’s a textures issue as far as I can tell, the tiles aren’t loading and grey squares start appearing in place of the tiles