You spot a drainage pipe on the east side of the island, partially submerged at high tide but exposed now at low tide. Big enough for medium creatures to crawl through. There are also docks on the south side with some small boats, and the main gate faces west. The drainage pipe looks like your best bet for a covert entry.