Softlocked at Shadow of the Vaal

Hey all,
I recently began shadow of the vaal (act 2) but finished the hideout quest before activating the waypoint in the northern forest and now I cannot seem to access that part of the map at all. I have tried going through the Vaal Ruins again but I cannot find the spot where you use the Baleful Gem on the big orb thing. please help because I've been really enjoying this game so far.

You don't use the baleful gem on the orb thing. You use it with the thing you get from the spider on the tree roots.

You should be able to just go through the ruins without needing to interact with the big orb

If you already went past the vaal ruins (and there is night already) you just have to find entrance to next area.

On the map vaal ruins are circle with black color inside (there is no waypoint there)

https://www.poewiki.net/wiki/Shadow_of_the_Vaal

red arrow show where you have to go
yellow circles are bandits from deal with the bandits quest

Ok last time that I tried to go through I completely cleared the ruins but couldnt find the door but now it has appeared. Thanks yall!