# robots.txt for jobmonitor.com # Google sitemap best practices - M37 User-Agent: * Disallow: /jobalert/gettimeout # Disallow internal/private areas Disallow: /protected/ Disallow: /runtime/ Disallow: /admin/ Disallow: /site/error Disallow: /jobalert/ # Sitemap index files - one per subdomain, plus root index Sitemap: https://www.jobmonitor.com/sitemap.xml