# robots.txt for Fast Estimate Maker
# https://fastestimatemaker.com/robots.txt
#
# One rule group for ALL crawlers, including AI/LLM agents:
#   OpenAI:     GPTBot, OAI-SearchBot, ChatGPT-User
#   Anthropic:  ClaudeBot, Claude-SearchBot, Claude-User
#   Perplexity: PerplexityBot, Perplexity-User
#   Google:     Googlebot, Google-Extended
#   plus Applebot, Meta-ExternalAgent, Bingbot, etc.
# All are welcome on public content and inherit the * rules below.
#
# Do NOT add a named per-bot group unless that bot needs DIFFERENT rules:
# a bot that matches a named group ignores this * group entirely
# (https://developers.google.com/search/docs/crawling-indexing/robots/robots_txt).
#
# App/auth pages (admin.html, settings.html, payment.html, portal.html,
# booking.html, canvass.html, demo.html, ...) are kept out of search with
# on-page <meta name="robots" content="noindex"> tags. Crawlers must be able
# to fetch a page to see its noindex, so those pages are deliberately NOT
# disallowed here. Only true non-page paths are blocked.
#
# LLM context file: https://fastestimatemaker.com/llms.txt

User-agent: *
Disallow: /api/
Disallow: /admin/
Disallow: /stats.html

Sitemap: https://fastestimatemaker.com/sitemap.xml