Whether it's on the street or in people's apartments or where ever, It comes down to how you personally feel about it inside your gut. If you feel queasy about taking the picture, don't do it. In the end, you'll be hurting yourself more than the people you're taking pictures of.