Can't allocate passive skill point to where i want to

The game is only allowing me to allocate skill points at the mana regen node that's glowing it won't let me put it anywhere else.

https://www.youtube.com/watch?v=vEAOC67yjss&ab_channel=HardmoreGamer


UPDATE: If I hard press x on nodes I already have allocated I can change the weapon set for each node. I was able to fix the issue that way. Well, it seems it messing with something. That is confusing. Wowzer

allocating the weapon specialization points is ridiculous. there's no way to select it with a controller. I'll have to try redoing older points and see if it works finally.