User-agent: * Allow: / # Nothing here is blocked. /api/ used to be, which is what Search Console kept # reporting as "Blocked by robots.txt" — the page references those endpoints # itself (the visitor badge is an , the install URLs are printed as # plain text, the charts fetch their data), so Google finds them, can't fetch # them, and files a ticket that blocking can never clear. They're crawlable now # and every one answers with X-Robots-Tag: noindex, so Google reads them once # and drops them. # # Two things keep that safe, and a new endpoint needs both: # - the three counters skip their increment for crawlers (netlify/lib/crawlers.js) # - /api/chat and /api/live-post are POST-only, so a crawler GET gets a 405 # Blocking a URL never removes it from the index. Serving noindex does. Sitemap: https://howborisusesclaudecode.com/sitemap.xml