Glenn: Silent Lake is a very pretty area. Depending on time and other contstraints, you may also want to check out Petroglyphs Provincial Park, which is a bit south, or wander around the very large/ mostly undeveloped Kawartha Highlands area, including Kawartha Highlands Provincial Park. Warsaw Caves are interesting, but out of the way from where you're going. There's enough beautiful landscape - lakes, rocks, trees in the Kawartha Lakes area to keep you going for years. Eagle's Nest, as mentioned, is on the highway heading north out of Bancroft. A steep road, not maintained in winter but easily accessible in summer.
Makes me wish I could join you... Maybe next time.