I've gone to visit photographers in other areas and let them guide me to interesting stuff in their areas, and done the reverse (let them visit me and I guide them). Having a knowledgeable guide helps A LOT in a strange area.
I might do an "unaccompanied" house swap with someone I knew well, but I'm too suspicious a curmudgeon to let someone I don't know in my house unaccompanied for several days....I think sequential "accompanied" swaps would be a better idea.