# robots.txt for sunnypatneedi.com # Search + answer engines are welcome to crawl the public site. # Googlebot: general web search crawler # Bingbot: general web search crawler # OAI-SearchBot: OpenAI's search crawler (used for ChatGPT search / answers) # GPTBot: no explicit policy set — inherits allow-all. Change deliberately; see docs/SEO_AEO_GEO_CHECKLIST.md # AI assistant guidance: https://sunnypatneedi.com/llms.txt # A crawler follows only its most specific group, so every named group repeats # the private-route rules from the * group. User-agent: Googlebot Allow: / Disallow: /admin Disallow: /auth Disallow: /billing Disallow: /resume-builder Disallow: /payment-success Disallow: /payment-canceled Disallow: /scorecard Disallow: /work-with-me/thanks Disallow: /work-with-me/paid User-agent: Bingbot Allow: / Disallow: /admin Disallow: /auth Disallow: /billing Disallow: /resume-builder Disallow: /payment-success Disallow: /payment-canceled Disallow: /scorecard Disallow: /work-with-me/thanks Disallow: /work-with-me/paid User-agent: OAI-SearchBot Allow: / Disallow: /admin Disallow: /auth Disallow: /billing Disallow: /resume-builder Disallow: /payment-success Disallow: /payment-canceled Disallow: /scorecard Disallow: /work-with-me/thanks Disallow: /work-with-me/paid User-agent: Twitterbot Allow: / Disallow: /admin Disallow: /auth Disallow: /billing Disallow: /resume-builder Disallow: /payment-success Disallow: /payment-canceled Disallow: /scorecard Disallow: /work-with-me/thanks Disallow: /work-with-me/paid User-agent: facebookexternalhit Allow: / Disallow: /admin Disallow: /auth Disallow: /billing Disallow: /resume-builder Disallow: /payment-success Disallow: /payment-canceled Disallow: /scorecard Disallow: /work-with-me/thanks Disallow: /work-with-me/paid User-agent: * Allow: / Disallow: /admin Disallow: /auth Disallow: /billing Disallow: /resume-builder Disallow: /payment-success Disallow: /payment-canceled Disallow: /scorecard Disallow: /work-with-me/thanks Disallow: /work-with-me/paid Sitemap: https://sunnypatneedi.com/sitemap.xml