Weapon Swap & Gem Restrictions – A Limitation on Gameplay?

Setting up dual-weapon slots, I find it frustrating that swapping weapons still limits gem usage. If I use 1H mace & shield in one slot and a 2H mace in another, why can't I keep the same skills? Since they aren’t active at the same time, it wouldn’t break gem rules.

From an https://xooolink.com/edukesyen view, a flexible system encourages strategy and adaptability. Shouldn’t weapon swapping allow for more build creativity? Thoughts?