Nice one-handed faro shuffle though!
But yeah, it's way more common than you'd think. I did a card trick for my Mum a few months back and she forgot the card she chose

You really do just have to end up saying "trust me, that's your card"!
I guess having the spectator show the card to the audience is a good way of mitigating against this.