You can rent a canoe to get there under your own steam or take a ride in one of the many small ferry boats departing from Long Bay.
There are multiple options to get off of long bay.
You cannot escape from Long Bay. Once you're there, you're there forever.