Low fps with pretty good rig.

I got a I7 12700K, RTX3080 and 32GB ram. But after a while playing the fps drops to something around 60 fps and under. And it doesnt matter how low or what i do in graphics settings. The fps wont go up. I tried DX12 and Vulkan but its the same.
Can anyone help?