Crashing when nearing certain mobs in maps

I have been experiencing crashes where the game freezes for a second or 2 and then closes. It happens when nearing certain spots in a couple of maps, The boss of Desert, Bramble Valley before even reaching the boss arena, and a couple of others I can't remember off the top of my head. I was just running a Bramble Valley to fill holes in my atlas and have lost all my portals to this crash in the exact same spot, I don't believe it has anything to do with my graphics settings, tried swapping between DX11,12, and Vulkan all of which crash in the same spot, with no enemies on screen.

I've got a 4070, Ryzen 5 7600x, 32gb ram, and outside of these crashes my framerate is a stable 144.

The same kind of crash (1s of freeze and then close to desktop) has also been sometimes happening when assigning workers to buildings in Kingsmark, as well as depositing gold to the treasury, though those ones are manageable. Not being able to complete certain maps is game breaking however, and would like to know if anyone else has experienced the same issue and/or has a fix.