# Cigarro — open to crawlers. # # Public review pages at /r/ are explicitly designed to be unfurled # by social previews (Facebook, Twitter, Slack, iMessage, LinkedIn, etc.). # The rest of the SPA is auth-gated and serves the same index.html shell # regardless of crawler activity, so an open allow exposes no sensitive # data. # # Without this file, Vercel served the SPA index.html (~1.1MB) at /robots.txt # because of the catch-all SPA rewrite. Facebook's crawler treats an # unparseable robots.txt as a block and refuses to scrape the target URL — # that was the source of the "Bad Response Code 403" the FB Sharing # Debugger reported even when /r/ itself responded 200. User-agent: * Allow: / Sitemap: https://app.cigarroapp.com/sitemap.xml