While I get what you're saying, I can't help but imagine that a person holding up their cell phone recording video would get no such response, despite being the exact same thing.

Glass isn't uniquely invasive. I've yet to hear about someone mugging a guy wearing a gopro.