BotLens

About

Can AI read your website?

BotLens is a one-click Chrome extension that tells you exactly how AI crawlers and language models see any page you visit — from GPTBot and ClaudeBot to Perplexity, Google-Extended, and a dozen others.

Click the icon on any site and BotLens instantly runs a technical audit:

🤖 robots.txt & Meta Analysis
Parses the site's robots.txt with proper Allow/Disallow precedence and wildcard support. Detects blocks against 20+ known AI user-agents, plus meta directives like noindex, noai, and noimageai.

🌳 Semantic Structure
Checks heading hierarchy, HTML5 landmarks, structured data (JSON-LD), image alt-text coverage, and the lang attribute — the signals LLMs rely on to understand content.

⚡ JS Rendering Detection
Compares the initial HTML payload to the rendered DOM to catch SPA shells that hide content from bots. Shows you when a site depends on JS to render text that crawlers cannot see.

📊 A weighted 0–100 score
Every signal contributes to a single readability score you can act on — plus a plain-language verdict so you know whether to celebrate or start fixing.

🔒 Privacy-first
Everything runs locally in your browser. No accounts, no analytics, no data collection. Read the privacy policy at botlens.iamjarl.com/privacy.html

Who is this for?
• Developers who want to know if their SPA is bot-friendly
• SEO practitioners who need to audit AI-crawler policies
• Content teams who want their work discoverable by ChatGPT, Claude, and Perplexity
• Site owners curious whether they're opted in or out of AI training