Create llms.txt file for your website. So ChatGPT, Claude and others can read it correctly.
Get llmstxt generated in minutes and integrate with your stack using llmstxt APIs.
Create llmstxt.so file for the your domain, sub-domains and the llms-full.txt file - all from one place.
llmstxt.so auto-refreshes your llmstxt and llmstxt full overnight so you can pass latest information to LLMs.
Simple API to submit request for crawling your website and fetch the status and llmstxt files.
Got a Question? We’ve got answers.
Think of llms.txt file just like the sitemap.xml file that you have for Google crawlers. But, llms.txt file is built for LLMs like ChatGPT, Perplexity and Claude. It helps these LLM crawlers to understand your website content better.
llms.txt usually contains a basic list of available Large Language Models (LLMs) with essential details. llms-full.txt is a more detailed version, including additional metadata like parameters, architecture, and performance benchmarks. The "full" version provides deeper insights, while the standard version is more concise for quick reference.
It depends. If you have any developer documentation, it's highly recommended. Rest you can decide on a case by case basis. For example, if you have a lot of case studies with interesting insights, you should consider creatine one for that sub-domain or sub-folder.
Just like how you informed Google crawlers what pages, folders and sub-domains to crawle and which ones to avoid, you can do the same thing in llms.txt file.
Yes and no. This is one of those things that someone suggested and a lot of companies started doing it. In September 2024, Jeremy Howard suggested creating llms.txt file so that crawlers for different LLMs can read the website well. The thought process is quite similar to creating robots.txt and hitemap.xml files for search engine crawlers.
We believe it's a good idea. Given that most of the big LLM companies themselves have started using llms.txt files makes us believe that its an early trend and it will help with ranking and mentions in the LLM ecosystem / answers.
Perplexity | Anthropic | Cursor | ElevenLabs | Zapier | Cloudflare
You can keep tracking the referral in your analytics dashboards. You should already see some traffic coming from ChatGPT and other LLMs.
Submit Your Website to AI Models
Submit Your Details and we will reach out to you in 24 hours.
Pay for 12 months.
Pay once, and let LLMs crawl your data.
$199 USD
Join Beta ProgramInvoices and receipts available for easy company reimbursement