User-agent: * Allow: / # below should be handled inside robots.txt on GitLab # Disallow: https://git.cto.ai* Disallow: /cms* Disallow: /home/* Disallow: /registry/[team]/[op] Sitemap: https://cto.ai/sitemap.xml