The Organ tour and cave are interesting, particularly for the cave's saltpeter history and archaeology--a recommended stop. At about 40 miles, Organ is the 9th longest cave in the U.S.
Also in the Lewisburg WV area is Lost World Caverns (self-guided tour.) The owner is a friend to cavers, and supportive of the WVCC.
Both offer "wild" or "extended exploring expeditions " tours as well that you might want to do to see more of the caves.
Grand Caverns, in Grottoes VA, is the oldest continually operating show cave in the U.S. and a National Natural Landmark, and in addition to formations, contains a lot of interesting signatures from the1800s and Civil War. (It's also been a project of the VA Region for several years, with NSS members doing all sorts of restoration, surveying, documentation, and facilities work.) Grand is owned by the town of Grottoes.
Heck, hit all of them along your route and report back!
This weekend BATS grottos is caving and camping in Bath Co VA. You're welcome to join us. PM me if interested. Not likely that virgin borehole will be included, however--just some fun recreational caving.