Rob, I think it's more of an issue if people don't understand the photographer's intent.
As an example, when photographing folk in Morocco the individual may or may not like being photographed but they do understand why a western European would want to do so: It's a daily occurrence for them.
On the other hand I would never attempt to capture images such as you've posted here and on the without prejudice thread as the intent is not obvious and is open to all kinds of misinterpretation.
That's an interesting point, Keith.
To be frank, I'm not really sure of the motivation myself - it's mostly that I see something about to happen (usually far too late) that might make a pleasing picture for me, and that's about it. I think that I'd find it embarrassing trying to say that to any challenger, perhaps because they wouldn't understand unless they, too, were snappers.
Truth is, I find anything human outwith paid models a challenge. I feel uncomfortable because, unlike with a model whose work one knows (or should) before the fact, there's no background of what she does or does not do. It's so easy to cross invisible demarcation lines that one didn't know even existed in that person's mind.
On the same thing: why do you find yourself drawn to shooting women or kids in North Africa? I don't think you do it in Greece or Italy. Similar demarcation lines? That kids can get you arrested or, worse, mobbed in 'western' society regardless of your innocence is something that has stopped me ever doing kids outwith advertising decades ago. I wouldn't dream of it. And it's such a shame: some old photographers have made fabulous street pics of children at play or just hanging out with their fellow brats. Such great, natural material to work with, but now far too dangerous because of some sick bastards who mess life up for the rest of us.