Prioritizing interacting with objects or exits instead of spells for left click.

I end up casting my left click ability multiple times before I am able to transition to areas or interact with some quest items. My Ascendancy run was just ruined because it would not allow me to interact with a death crystal, which just wasted over an hour of my time.