Our crawler

The crawler is operated by Island Graph Limited, a Guernsey company (registration no. CMP78596) registered with the Office of the Data Protection Authority as a data controller under number DPA11733. It is run by Niki Wiles. Questions go to hello@island.gg. How we handle personal data is set out on the privacy page.

• the public websites of Guernsey businesses and organisations — their home, about, services, team and contact pages;
• the public pages of registers and directories, such as the Guernsey Registry and island business directories.

It reads public pages only. It does not log in, submit forms, or read anything behind a password or a paywall. It is scoped to Guernsey: it does not roam the wider web.

• It identifies itself on every request with the user agent above, so it appears in your server logs under its own name with a link back to this page.
• It reads your robots.txt before fetching and honours it for the IslandGraphBot token, falling back to the* rules, and it respects a Crawl-delay directive of up to 60 seconds. This has been in force since 4 September 2026.
• It pauses between requests to the same site, and it reads a site in full once, returning from time to time to see whether anything has changed.
• A separate, low-volume checker fetches a cited page once to confirm that a quotation shown on Island Graph really appears there. It sends the same IslandGraphBot identity and reads robots.txt first; a page we may not read is simply not checked, and the fact it would have supported is not published.

We publish facts an organisation states about itself — what it does, where it is, who leads it, how to reach it — and we link every such fact to the page it came from, so a reader can check it. We do not publish private contact details or home addresses, and we do not take facts from pages a site has asked crawlers not to read.

Add this to the robots.txt at the root of your site and the crawler will stop at its next visit:

User-agent: IslandGraphBot
Disallow: /

You can also disallow particular paths rather than the whole site. If you would rather not edit robots.txt, email hello@island.gg and we will exclude your site by hand.

If something on Island Graph about your business is wrong or out of date, or you would like your listing removed, see the page for owners or write to hello@island.gg. We aim to act on corrections within two working days.