Visual Network

Free AI crawler check

See whether ChatGPT, Claude, Perplexity and Google's AI may read your website, from your own robots.txt file. No account, and no email address asked.

Private by design. What you paste is checked in your browser and never sent anywhere.

How to get your robots.txt

This page cannot open other websites itself (that is what keeps it private), so you copy the file across.

  1. Open yoursite.com/robots.txt in a new tab, with your own website's address in place of yoursite.com.
  2. Select all the text (Ctrl+A, or Cmd+A on a Mac) and copy it.
  3. Paste it in the box below and choose Check.

If that address says "not found", your site has no robots.txt, and every crawler may read everything.

Your robots.txt

For example: User-agent: GPTBot then Disallow: /

A page of your site, for example /services/ or the full address. Your home page and /llms.txt are always tested.

Want your robots.txt set up for you? Visual Network can do the work: send a request at help.visualnetwork.co.uk.

What you paste is checked in your browser and never sent anywhere. This page loads no fonts, adverts or tracking.

More free tools from Visual Network