llms.txt
What is llms.txt? How to set it up in WordPress and why it matters for AI citations
llms.txt is a plain-text file that tells AI crawlers — ChatGPT, Gemini, Perplexity — what your site is and what it offers. While robots.txt controls URL access, llms.txt passes semantic context to AI. Place it in your WordPress public root and it's immediately active.
What is llms.txt?
llms.txt is a web specification (draft) proposed in 2024 by AI researcher Jeremy Howard and others. It's designed to let AI agents and large language models efficiently retrieve information about a specific website. Written in Markdown or structured text, it lives at the site's root URL (e.g., https://example.com/llms.txt). OpenAI (OAI-SearchBot), Google (Googlebot-Extended), and Perplexity (PerplexityBot) are among the systems that reference this spec.
What is the difference between robots.txt and llms.txt?
| Item | robots.txt | llms.txt |
|---|---|---|
| Purpose | URL access control for crawlers | Pass semantic context to AI |
| Content | Allow/Disallow paths | Service summary, company info, key URLs |
| Audience | All crawlers (incl. search engines) | AI crawlers and LLM agents |
| Format | Custom format (key: value) | Markdown / plain text |
| Standard | RFC 9309 | Draft (2024–) |
How to write llms.txt — what should you include?
Below is an excerpt from amplest.cloud's own llms.txt — use it as a reference for your own.
# Amplest Autopilot — AI partner for WordPress sites > Amplest Autopilot is a WordPress-native AI operations partner. > It covers diagnosis, auto-fix, monthly LLM scanning, and content > operations in one place. ## Services ### Amplest Autopilot (SaaS / WordPress only) Continuously get your WordPress site cited by ChatGPT, Gemini, Perplexity, Copilot, and Claude. - Monthly/weekly 5-LLM citation scans - Auto-generated JSON-LD structured data - FAQPage / Article / Organization schemas - llms.txt auto-generation and updates - Fix preview and approval workflow ## Pricing - Free ($0): 5 credits/mo, 5-page diagnosis - Planner ($33/mo): 100 credits/mo, WP auto-fix - Operator ($99/mo): 300 credits/mo, weekly scans - Autopilot ($199+/mo): multi-site, agency ## Company Amplest LLC | CEO: Katsuhiko Tanaka | Suginami, Tokyo URL: https://amplest.cloud ## Excluded from AI crawl /admin, /dashboard, /auth, /api
How to place llms.txt in WordPress
Choose from three methods.
Auto-generate with Amplest Autopilot plugin
- Install Amplest Autopilot plugin in WordPress
- Run 'Generate llms.txt' in the dashboard
- Review and approve the generated file, then apply to WordPress
- Verify access at https://yourdomain.com/llms.txt
Includes automatic update suggestions when your site changes. Recommended.
Manual upload via FTP / cPanel
- Create llms.txt in a text editor (see writing guide above)
- Connect to `public_html` via FTP client or cPanel file manager
- Upload as `public_html/llms.txt`
- Verify access at https://yourdomain.com/llms.txt
All updates are manual.
WordPress theme file editor or custom plugin
- WP Admin > Tools > Theme File Editor to place at root (not recommended)
- Or place in `wp-content/uploads/` with redirect rules
- Warning: WordPress updates may overwrite the file
Maintenance becomes cumbersome. Methods 1 or 2 are recommended.
Frequently asked questions
What is llms.txt and how is it different from robots.txt?
llms.txt is a plain-text file that tells AI crawlers (OAI-SearchBot, Googlebot-Extended, etc.) what your site is about — your services, content scope, and restricted paths. robots.txt controls which URLs crawlers can access. llms.txt communicates the semantic identity of your site to AI: what it is and what it offers. The two files are complementary; you should have both.
Does llms.txt actually help AI cite your site more often?
A direct causal relationship has not been fully verified, but by giving AI crawlers accurate context about your site, the probability of being selected for relevant queries increases. At amplest.cloud, we observed growth in Perplexity and Gemini citations after adding llms.txt. Maximum effect comes from combining it with structured data and FAQ-formatted content.
Where exactly should I place llms.txt in WordPress?
Place it in your WordPress public root — typically `public_html` or `www` on your server. You can create it via FTP, cPanel's file manager, or through Amplest Autopilot's plugin. After placing it, verify it's accessible at `https://yourdomain.com/llms.txt`.
What should I write in llms.txt? Are there required fields?
Required: (1) site/brand name, (2) a summary of your services or content, (3) URLs of key pages (service page, About, pricing, etc.). Recommended: (4) paths to exclude from AI crawling (admin, login pages), (5) company information (company name, representative, location), (6) contact details. Markdown formatting is conventional but plain text works too.
How often should I update llms.txt?
Update it whenever your service offering or key page structure changes — when you add a new service page, change pricing plans, or update company information. Amplest Autopilot detects site changes and automatically suggests llms.txt updates.
Want to automate llms.txt setup with a plugin?
Amplest Autopilot automates llms.txt generation, JSON-LD implementation, and citation rate monitoring together. Start with a free diagnosis.