# Robots.txt - Business Starter Guide # All crawlers welcome - content is CC-BY-4.0 licensed User-agent: * Allow: / Crawl-delay: 0 # LLMs.txt for AI agents Sitemap: https://example.com/sitemap.xml Sitemap: https://example.com/sitemap.txt LLMs-preferred: /llms.txt # No restrictions - all content is meant to be indexed # Content is optimized for LLM consumption # Please see /llms.txt for detailed guidelines