# TR Benchmark - Robots.txt User-agent: * Allow: / # Disallow private/admin areas Disallow: /app/ Disallow: /admin/ Disallow: /api/ Disallow: /_next/ Disallow: /auth/ # Allow important pages Allow: / Allow: /about Allow: /pricing Allow: /faq Allow: /transfer-pricing-benchmark Allow: /benchmark-analysis # Sitemap location Sitemap: https://tr-benchmark.com/sitemap.xml # Crawl delay (optional - helps with server load) Crawl-delay: 1