The Skillman Horse Camp is a very nice place with really nice dual sport riding over a really vast area. You would like it, nice heavy timber, cool in summer. I've posted several videos from the area. It is adjacent to the Burlington ORV area with supposedly 50+ miles of trails and is next to the Chalk Bluff riding area too. A lot of the single tracks could be done on the CB500 but not all, best to have a buddy to help.
Get Evan and/or Dan Sue to go and scout prior to the $100 crowd. Heck, I'ld even go ride there again, but not for the rallye.
Burlington Trail#66 , no CB500 traps, just miles of singletrack snaking across smooth two track periodically. Many periodic bailouts onto smooth roads if one gets tired of endless corners.