haikuwebkit/Websites/bugs.webkit.org/robots.txt

6 lines
81 B
Plaintext

User-agent: *
Allow: /index.cgi
Allow: /show_bug.cgi
Disallow: /
Crawl-delay: 20