Please fix personal town portal not letting you go back to Altar of Ascendancy

If you use the portal button (not the portal that spawns for you) to go back to town after killing the Ascendancy boss, you can't go back if you didn't finish everything you needed to do. I don't know if this is a bug or not, but the expectation given by the game until this point is that any time you can use the portal, you can also return. The trial is already long and tedious, so having to do it again after passing because the portal works in an unexpected way is very frustrating, especially if it's taken many attempts to pass the trial.

If you don't want players going to town and coming back in this location, it should prevent you from using your own portal there. But with inventory space being as restrictive as it is, I don't see why you shouldn't be able to go to town and return to finish looting and grabbing your Ascendancy. Please help us loot goblins not miss out on things just because we like picking up the shinies!