Join a Different Party when Teleporting to Town

In PoE 2, in a party with a friend. He teleports to town and he ends up in a party of 9 people, and our party is disbanded. Happened to me a few minutes later. I attempted to teleport to one of the party members and my game froze on the loading screen.