User-agent: * Allow: / # Internal endpoints — not useful to index, generate WAF noise when crawled Disallow: /administrator/ Disallow: /admin/ Disallow: /api/ Disallow: /app/ Disallow: /users/sign_in Disallow: /users/sign_up Disallow: /users/password Disallow: /users/confirmation Disallow: /users/invitation Disallow: /users/unlock Disallow: /profiles/*/upload_resume Disallow: /profiles/*/upload_document Sitemap: https://directdental.com/sitemap.xml.gz