User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Disallow: /admin/ Disallow: /blog_search/ Disallow: /course_search/ User-agent: Googlebot Allow: / User-agent: bingbot Allow: / User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / Sitemap: https://www.largitdata.com/sitemap.xml # Public read-only content API and its machine-readable description. # Crawling and programmatic use are both allowed. # OpenAPI: https://www.largitdata.com/openapi.json # OpenAPI (YAML): https://www.largitdata.com/openapi.yaml # API index: https://www.largitdata.com/api/v1/ # Developer portal: https://www.largitdata.com/developers/ # AI model training and retrieval context # See https://llmstxt.org for specification # llms.txt: https://www.largitdata.com/llms.txt # llms-full.txt: https://www.largitdata.com/llms-full.txt