Unable to go through portal for 4th ascendancy trial (Test of Time)

So I'm going through the trial to get the 4th set of points.

I just finished trial 3 boss. After stashing all the drops I got I proceeded down the new doorway and ramp to the Test of Time portal.

Whenever I click on the portal I get

Error: Failed to join instance because: Disconnected from server.
Error: Failed to join any instances.

I am still connected to the game perfectly fine seeing as I'm still playing and chatting in global with other people.

Any way to fix this or am I SoL.

https://i.imgur.com/pK4gEvU.jpeg

I'm getting a similar thing upon trying to join Test of Time:
"The terrain generator for the client is out of sync with the server. Please create a new instance and try again."

I've waited an hour, gone to different zones, all kinds of stuff and no such luck getting past it.

Took a break for a while to go make dinner.

I still got the error while clicking on the portal so I decided to go back to login screen.

Logged back in, ran up to the thing where you put the token and clicked on it to rejoin the trial.

I was able to choose the room I wanted to start in for the 4th trial. Clicked the room and was instantly put into the start of the 4th trial as if I had clicked the portal from earlier.

So I am now able to progress in the 4th trial.