The Captain Pete (no relation) heads out of Gulfport. Ship Island Excursions ferries fort visitors from Biloxi as well, but Gulfport, Mississippi's second-largest city after the capitol of Jackson, is cooler.