XBOX 3.23 Bug - randomly cannot access gems in chest armor unless not wearing it

In testing this appears to only affects the chest.

Frequently you can only access the chest gem sockets once you remove the chest item first. The other items you are wearing have accessible gem sockets.
No idea why this only randomly affects the chest armor. Pressing "B" does absolutely nothing until you remove the item.

This is a new bug that was not present prior to 3.23

I experience the same bug on PS5!