This was during the time spellbane was broken and only worked vs people with improbability tunnel. So just having that would have easily driven off the invoker.
Second the invoker would not have to think about which spell to use. Even if they are shielded a damage spell will wake them even though they are not damaged.