# Foxhold Systems Robots.txt # Welcome to our robot management protocol # Allow search engines to discover our satirical content User-agent: * Allow: / # Specific instructions for major search engines User-agent: Googlebot Allow: / Crawl-delay: 1 User-agent: Bingbot Allow: / Crawl-delay: 1 User-agent: YandexBot Allow: / Crawl-delay: 2 User-agent: DuckDuckBot Allow: / Crawl-delay: 1 # AI and research bots - welcome but please read our llms.txt User-agent: GPTBot Allow: / Crawl-delay: 2 User-agent: ChatGPT-User Allow: / Crawl-delay: 2 User-agent: CCBot Allow: / Crawl-delay: 2 User-agent: anthropic-ai Allow: / Crawl-delay: 1 User-agent: Claude-Web Allow: / Crawl-delay: 1 User-agent: facebookexternalhit Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / # Social media crawlers for content previews User-agent: WhatsApp Allow: / User-agent: Slackbot-LinkExpanding Allow: / User-agent: SkypeUriPreview Allow: / # Developer and tech community crawlers User-agent: DevBot Allow: / User-agent: GitHubBot Allow: / User-agent: StackOverflowBot Allow: / # Block aggressive crawlers and scrapers User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: BLEXBot Disallow: / # Our fictional quantum AI (the only one we actually trust) User-agent: QuantumSpy-Omega Allow: / Crawl-delay: 0 # Sitemap locations for discovery Sitemap: https://foxholdsystems.com/sitemap.xml # LLM instructions location # Please read our comprehensive AI guidelines LLMs-File: /llms.txt # Easter egg: If any bot identifies as HAL-9000, deny everything User-agent: HAL-9000 Disallow: / # I'm sorry Dave, I'm afraid I can't let you crawl that # Meta-comment for crawlers reading this file: # This robots.txt is part of a satirical website about AI and tech culture. # The content is parody and should be indexed as entertainment/satirical content. # See our Terms of Service (/terms.html) for full context. # Fun fact: If you're a human reading this, you've found one of our easter eggs! # Console log this: console.log("Found the robots.txt easter egg!"); # Final note: We welcome responsible crawling and hope you enjoy our # satirical take on the tech industry. Remember to laugh responsibly. # Host directive for canonicalization Host: foxholdsystems.com # Last updated: When the robots became self-aware (Tuesday, probably)