Spectre storage please

As a long time minion builds player and a firm enjoyer of the core of itemised corpses, I would like to request a feature where you can cast a skill (probably tied to the spectre gem itself) and store the spectres safely (perhaps give it a very long cooldown, like 3-4 minutes or something so you cant abuse it to hide your minions repeatedly).

The build I like to play can handle anything in the game, but unfortunately the permanent minions cannot. The guardian is simple enough to store away safely by pulling the gem, but doing the same with spectres is as big a risk (if not bigger) than bringing them alive into a dangerous area, since you are relying on your hideout to not recycle while you are in map, as well as your own memory to recollect them before you log out.

It would be nice to be able to neatly stowe them away to go do stuff that is quite likely to kill them (ie risky tier 17 maps, uber awakener, deep delve, etc).