# GenAIList — https://genailist.net # Search and AI crawlers are welcome. Content is server-rendered and crawlable. User-agent: * Allow: / Disallow: /gestione/ Disallow: /api/ Disallow: /dashboard Disallow: /login # Block query-string variants to prevent duplicate content Disallow: /*?*error=* # --- Search engines --- User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: Applebot Allow: / # --- Policy ------------------------------------------------------------------- # Crawlers that send readers back are welcome: search engines, and assistants that # retrieve live or index in order to cite. They are allowed below and unaffected. # # Crawlers that collect the catalog and return nothing are declined, and the server # enforces it rather than trusting this file. If you want the data, it is published # for machines and free to use: /llms.txt, /llms-index.md, and any page answers to # Accept: text/markdown. # --- AI assistants that cite and link (allowed) --- User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Disallow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Disallow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Amazonbot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Meta-ExternalAgent Disallow: / # --- SEO and data tools: declined --- User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: dotbot Disallow: / User-agent: BLEXBot Disallow: / User-agent: PetalBot Disallow: / User-agent: SERankingBacklinksBot Disallow: / # Sitemap & LLM guide Sitemap: https://genailist.net/sitemap.xml # LLM-friendly site overview: https://genailist.net/llms.txt # Markdown representation of any resource page: append .md, or send Accept: text/markdown # Complete Markdown index: https://genailist.net/llms-index.md # Markdown responses declare the HTML page as canonical — cite the HTML URL.