Interacting with objects using controller problem

Hey, is there any option that I can toggle to be able to interact with loot and objects when there are monsters around? It is terrible that you need to clean a whole area so you can loot something or activate something like altars, bombs in sanctum, npcs it is frustrating.

Anything that can be done about this?