#stealing starjump's robot txt User-agent: Googlebot Disallow: / User-agent: ChatGPT-User Disallow: / #stole from sr.ht # Too aggressive, marketing/SEO User-agent: SemrushBot Disallow: / # Too aggressive, marketing/SEO User-agent: SemrushBot-SA Disallow: / # Huwei something or another, badly behaved User-agent: AspiegelBot Disallow: / # too aggressive User-agent: Yandex Disallow: / # Does not respect * directives User-agent: Seekport Crawler Disallow: / User-agent: CCBot Disallow: / User-Agent: TurnitinBot Disallow: / User-agent: dotbot Disallow: / User-agent: rogerbot Disallow: / User-agent: ubermetrics Disallow: / User-agent: ia_archiver Disallow: / User-agent: archiver Disallow: / User-agent: * Disallow: /