About ObaronBot

ObaronBot is the web crawler used by Obaron to audit sites for AI search engine readiness. It only crawls sites when someone requests an audit.

How it works

ObaronBot only visits your site when someone has requested an audit for that domain.
It fetches pages twice — once as raw HTML (like an AI bot would see) and once with JavaScript rendered — to detect SSR/CSR gaps.
It respects robots.txt directives and Crawl-delay headers.
It waits 1.2–1.8 seconds between requests to avoid impacting your site's performance.
Standard audits sample ~30 pages. Pro audits crawl up to 500 pages.
All crawled data is used solely for generating the audit report and is not shared or sold.

ObaronBot/1.0 (+https://obaron.ai/bot)

To prevent ObaronBot from crawling your site, add this to your robots.txt:

User-agent: ObaronBot
Disallow: /

Note: blocking the bot will prevent us from completing your audit. If you've purchased a scan and blocked the bot, we'll issue a full refund.

Questions or concerns about our crawler? Email hi@obaron.ai.