Hey Isaac!
Of all the places that one can just "wander around", this one is the MOST ok to just wander around! There are not even any trails! (which is both a good and a bad thing, at times), but yea you are just supposed to go wander around wherever you want. At the base of phantom falls (which is definitely not flowing anymore, only flows in the wet season), there is a cave, and in the back of that cave there's an abandoned gold mine shaft. They even say "please be careful because this is dangerous", but don't care if you explore it!.
It's a truly amazing place, I've only been there once but I'm already in love, but the time I want was the exact perfect time of year. I'm not sure if it would be as enchanting in summer. It will likely be unbearably hot up until the sun sets.