I'd say that it's all about how it is performed.
Triumph is perhaps a good example but I'm sure that there are many more.
If you take David Forrest's Triumph version from his Trickery DVD then there is a definate plot. He tells a story of two magicians battling it out to see who is best and the cards merely act as a prop for the story. Personally, I think that this is a great plot for such a great routine.
However, when I see magicians performing Triumph it's nearly always
"look, I take this half face up and that half face down and mix them, click my fingers and they're now they're the same way up"
There's no plot whatsoever and it's jut another trick.
Someone once said to me that when you explain every stage of what you're doing they called this magic for the blind, despite the fact that it's usually being performed for sighted people. There's no plot at all and no matter how strong the routine is, you reduce it downwards to being a trick - not magic.
That's why I think that the answer to the question is all about the performance and the patter or storyline that's used. Personally, I'm a sucker for a good plot

Member of the Magic Circle & The 2009 British Isles Close-Up Magician of the Year
It's not really an optical illusion - it just looks like one!