I'd seriously consider elf, since they are (supposedly) less affected by mental stuff. Then I'd take the anti-bard legacy, one of the anti-repertoire edges, the anti-distortion edge, and the anti-fear edge (to prevent him making you flee, when you have him on the ropes). I'd keep resist mental and resist heat/cold (for apocalyptic overture) on hand. Second legacy: STSF. Then for specs, maybe...whip/flail and dagger.
With resist mental + elf int + anti-bard legacy + anti-bard edges, it should take him a good while to distort you. Especially if you're throwing in well-timed lashes. If he's singing distort then he's not damaging you, meaning the fight is dragging on. By the time he either lands distortion or decides it's time to flee, striking will be fully charged up. Then you can entwine and start doing all your dagger crap.