You can plainly see that there's some sort of trail that goes along the river, but it would be quite an arduous, deadly tick-laden slog to get to the fort, even if someone weren't chasing you with a hiking stick.