PoE 2 Latency/ input lag issues

I'm always on my default gateway (17ms), when I'm in the hideout, everything is fine most of the time, but if I load any other instance, in 95% of cases my ping goes to 60-70, which leads to huge delay in my actions, it's just not fun at all. I made a traceroutes via WinMTR in different instances, maybe it will give you some clue.

1. Hideout (17 ms) - https://pastebin.com/JzbArUE2
2. Temple of Chaos portal area (60+ ms) - https://pastebin.com/WqfWPvwd
3. Temple of Chaos (60+ ms) - https://pastebin.com/Mb9tDfCv

There's clearly some weird routing happening, since it's definitely not my normal gateway.