event horizon bug

Hi,
I took event horizon passive node - 53% increased Chaos Damage Lose 3% of maximum Life and Energy Shield when you use a Chaos Skill. But didn't like it how fast my ES was going down, so refunded it at Doryani and all spells still charge me ES for usage. Tried to take off gear then gems and nothing helps. Is there any way around it ?