Some links that might help you out:
It sounds like it’s a fee area probably no more than a few bucks. Second link mentions a camping site along the trail at 1.4 miles in and also a camping area at the base of the falls 3.7 miles in. Based on my experience at Brasstown Bald, Ga last Christmas Eve, you won’t see a soul out there and you’ll have the entire forest to yourself.
http://georgiatrails.com/reports/panthercr.html
http://www.jdmpics.com/trails/panther-creek-ga-1.htm
This link mentions two camping sites along the trail, 1.4 and 3.7 miles