XunLMove cross-border work forward
中文

Website & SEO

Search and AI Crawler Access Test

Request a public page using selected search or AI crawler User-Agent strings.

◈ Online Lookup · Public Information Only

Inputs & Settings

Target domain or URL will be submitted to the server for querying; do not enter links containing secret keys.

Results workbench

Fill in the details, then click Start Lookup.

↗

Results will be displayed here

Review details, copy or download, and then continue your work.

YOUR NEXT STEP

Turn a website check into a monitoring routine

Create a company account to manage sites and notifications. Pro supports 5 sites and 5-minute availability monitoring, with deep diagnostics available according to your plan and permissions.

Create company accountExplore ProContact Pan Chenxing

New companies receive a 14-day Pro trial, with no card required. Trials exclude the paid monthly credit grant.

Already have an account? Open your workspace →

How to use Search and AI Crawler Access Test

  1. Enter Website URL and adjust the options as needed.
  2. Run the tool and inspect its results, evidence and limitations.
  3. Copy or download the result, then verify it against the actual website, source data or business records.

Try a concrete example

Compare the page's response for the available crawler identities and inspect its HTTP headers.

How to interpret results

Only the User-Agent string is simulated. The request does not originate from a verified crawler network and does not establish actual crawling, indexing or AI training behavior.

Frequently asked questions

Does 200 mean it has been indexed by AI?

Does not imply pass. It only indicates that this simulated User-Agent request returned a 200 status code.

Does 403 definitely mean the real Googlebot was blocked?

Not necessarily. The real Googlebot source IP differs from this tool; combine with official IP verification and log checks.

Does this result consider robots.txt?

This request checks HTTP responses; robots.txt rules should be viewed separately using the robots.txt checker tool.

crawler access checker practical guide and common questions

What does a crawler access checker do?

A crawler-access test compares HTTP responses to specified User-Agent strings, helping investigate firewall or content-policy differences.

Who is this for, and when is it useful?

Webmasters investigating differences in public HTTP responses for crawler user agents.

How do I use this crawler access checker?

Submit a URL and crawler label, compare the returned evidence; a simulated user agent does not establish real crawling or indexing.

How should I interpret the results?

Compare responses with server logs. Our request IP differs from a real search crawler, so a simulated response cannot establish actual crawling or indexing.

Where is the work performed, and which services receive data?

Our server requests the public URL using the selected User-Agent. It does not originate from a verified Googlebot or another crawler's actual IP.