Objections to being photographed are, mostly, rooted in superstition.
I don't much like being photographed by strangers, and I would be infuriated by a done. But it's still superstition.
To see this, just keep unpacking. You say perhaps, 'no, it's because people feel violated' then all yourself 'but why? Where is the violation?' and so on. With a few exceptions, there is no rational reason at the bottom of it all.