User-agent: Googlebot Allow: / Crawl-delay: 1 User-agent: Bingbot Allow: / Crawl-delay: 1 User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / User-agent: WhatsApp Allow: / # AI Model Crawlers - Optimized Access User-agent: OpenAI-GPTBot Allow: / Allow: /llms.txt Crawl-delay: 1 User-agent: Claude-Bot Allow: / Allow: /llms.txt Crawl-delay: 1 User-agent: Anthropic-AI Allow: / Allow: /llms.txt Crawl-delay: 1 User-agent: PerplexityBot Allow: / Allow: /llms.txt Crawl-delay: 1 User-agent: Gemini-Bot Allow: / Allow: /llms.txt Crawl-delay: 1 User-agent: Bard-Bot Allow: / Allow: /llms.txt Crawl-delay: 1 User-agent: * Allow: / Allow: /llms.txt Crawl-delay: 2 # Spezifische Disallows für bessere Performance Disallow: /api/ Disallow: /*.json$ Disallow: /*?*& Disallow: /*?utm_* Disallow: /*?ref=* Disallow: /admin/ Disallow: /private/ Disallow: /*?*sort=* Disallow: /*?*filter=* Disallow: /search?* Disallow: /tmp/ # Bevorzugte Ressourcen für AI-Modelle Allow: /llms.txt Allow: /sitemap.xml # Sitemap und llms.txt Lokation Sitemap: https://www.omniederer.ch/sitemap.xml llms.txt: https://www.omniederer.ch/llms.txt # Host-Direktive Host: www.omniederer.ch