The Agent Lens crawler

How it identifies itself

Plain requests carry this user agent:

Mozilla/5.0 (compatible; BastionHelixAgentLens/1.0; +https://bastionhelix.com/lens/bot)

Its robots.txt name is BastionHelixAgentLens. When a page needs a real browser, it is loaded through Cloudflare Browser Run, which Cloudflare always identifies as a bot. Agent Lens checks your robots.txt rules for BastionHelixAgentLens before that happens.

What it does and doesn't do

• It fetches a page only when an agent asks for that page. It does not crawl a site on its own.
• It reads /robots.txt first, follows its rules for BastionHelixAgentLens (or for * if there is no group for it), and also follows the rules for the agent's own bot when the agent names it.
• It respects Content Signals: with ai-input=no, it declines to read your pages.
• It does not try to get past bot checks or human checks, does not sign in, and does not submit forms.
• For its free site tool it may read /robots.txt, /llms.txt, /llms-full.txt, your sitemap and the page asked about, each only if robots.txt allows it.

How to block it

Add this to your robots.txt:

User-agent: BastionHelixAgentLens
Disallow: /

Or, to allow it to see your pages but not use them as input to AI, add a Content Signal:

User-agent: *
Content-Signal: ai-input=no

Contact

Questions or a problem with how Agent Lens accessed your site: support@bastionhelix.com. Please include the page address and the time.