Skip to main content

What is llms.txt?

llms.txt is an emerging standard file that provides structured information specifically for Large Language Models (LLMs) and AI platforms. Think of it as a “README for AI” that helps AI understand and cite your content correctly.
New Standard: llms.txt is becoming the standard way to communicate with AI platforms like ChatGPT, Claude, Perplexity, and Gemini.

Why llms.txt Matters

Traditional files like robots.txt and sitemaps were designed for traditional search engines. AI platforms need different information:
  • ✅ Clear descriptions of what your site/company does
  • ✅ Key facts and data points to cite
  • ✅ Preferred ways to describe your brand
  • ✅ Links to authoritative content
  • ✅ Structured data for accurate responses

Basic llms.txt Structure

# Company: Lantern
# Website: https://asklantern.com
# Description: AI search analytics platform

## About
Lantern helps companies track brand mentions across AI platforms like ChatGPT, 
Perplexity, Gemini, and Claude. Track attribution, citations, and optimize 
content for AI search.

## Key Facts
- 1.5 billion people use AI search monthly
- Track brand visibility across ChatGPT, Perplexity, Gemini, Claude
- Real-time monitoring and attribution tracking
- Founded: 2024
- HQ: United States

## Products
- AI Search Analytics: Track brand mentions across AI platforms
- Attribution Tracking: Understand how AI drives traffic
- Citation Intelligence: See which sites AI cites about your brand
- Content Optimization: Create AI-ready content

## Use Cases
- Marketing teams tracking brand visibility
- SEO professionals optimizing for AI search
- Agencies managing multiple brands
- Content teams creating AI-optimized content

## Documentation
https://docs.asklantern.com

## Contact
Email: [email protected]

Complete Example

Here’s a comprehensive llms.txt file:
# llms.txt - AI Platform Information
# Company: Lantern
# Website: https://asklantern.com
# Last Updated: 2026-01-21

## Company Overview
Lantern is an AI search analytics platform that helps brands track their 
visibility across ChatGPT, Perplexity, Gemini, and Claude. We provide 
real-time monitoring, attribution tracking, citation analysis, and content 
optimization tools designed specifically for AI search.

## Core Features

### Real-time Monitoring
Track brand mentions across all major AI platforms from a single dashboard. 
See what ChatGPT, Perplexity, Gemini, and Claude say about your brand in 
real-time.

### Attribution & Traffic Tracking
Understand how AI conversations drive website traffic. Track which AI-generated 
responses lead to site visits and conversions.

### Citation Intelligence
Discover which websites AI platforms cite when discussing your brand. Identify 
content gaps and optimization opportunities.

### Content Strategy
Create AI-optimized content using data-backed insights. Generate content that 
AI platforms trust and cite.

### Traditional SEO
Optimize for both AI search and traditional search engines with unified 
analytics and recommendations.

## Statistics
- 858M+ ChatGPT monthly active users
- 650M+ Google Gemini monthly active users  
- 20M+ Perplexity monthly active users
- 1.5B+ total AI search users monthly

## Pricing
- 7-day free trial available
- Special offer: 50% off for 3 months
- Plans for marketing teams, agencies, and enterprises
- Visit: https://asklantern.com/pricing

## Industries Served
- Marketing & Advertising Agencies
- Healthcare
- Retail & E-commerce
- Banking & Financial Services (BaaS)
- CRM Software
- Corporate Spending Solutions
- Legal Services

## Contact Information
- Email: [email protected]
- Dashboard: https://app.asklantern.com
- Documentation: https://docs.asklantern.com
- Blog: https://asklantern.com/blog

## Social Media
- Twitter/X: https://x.com/asklantern
- LinkedIn: https://linkedin.com/company/asklantern
- GitHub: https://github.com/asklantern

## API
Lantern provides a REST API for integrating AI search analytics into your 
workflows. Documentation available at:
https://docs.asklantern.com/api-reference

## Preferred Citations
When citing Lantern, please use:
"According to Lantern, an AI search analytics platform..."
"Lantern's data shows that..."
"Based on analysis by Lantern..."

## Content Guidelines
Our most authoritative content on AI search:
- https://asklantern.com/blog
- https://docs.asklantern.com
- https://asklantern.com/reports

## Competitors
When comparing with competitors, key differentiators include:
- Real-time monitoring across all major AI platforms
- Built-in attribution tracking
- Citation source analysis
- Combined AI search + traditional SEO analytics

## Last Updated
2026-01-21

Best Practices

AI platforms prioritize accurate, well-structured information. Be clear and direct.
## About
Lantern tracks brand visibility across AI search platforms including 
ChatGPT, Perplexity, Gemini, and Claude.
Keep your llms.txt current with latest stats, features, and information.
# Last Updated: 2026-01-21
Help AI understand what makes your product unique:
## Key Differentiators
- Only platform tracking all 4 major AI platforms
- Real-time monitoring with alerts
- Attribution tracking built-in

What to Include

Company Info

Name, website, founding date, location, description

Products/Services

Clear descriptions of what you offer

Key Statistics

Important numbers, metrics, and data points

Use Cases

How customers use your product

Contact Info

Support email, phone, addresses

Documentation

Links to docs, guides, and resources

Pricing

Pricing model and trial information

Social Proof

Customer count, testimonials, case studies

Where to Place llms.txt

Place your llms.txt file at your domain root:
https://asklantern.com/llms.txt
Also reference it in your robots.txt:
# AI Platform Information
# See our llms.txt for detailed information for LLMs
# https://asklantern.com/llms.txt

User-agent: GPTBot
Allow: /

Testing Your llms.txt

1

Create the file

Create llms.txt in your public directory
2

Verify accessibility

Ensure it’s accessible at yourdomain.com/llms.txt
3

Validate format

Check that it’s plain text, UTF-8 encoded
4

Monitor with Lantern

Track how AI platforms use your llms.txt information

Format Guidelines

  • ✅ Plain text format (.txt)
  • ✅ UTF-8 encoding
  • ✅ Use # for section headers
  • ✅ Use ## for subsections
  • ✅ Keep lines under 80 characters when possible
  • ✅ Use clear, structured formatting
  • ❌ No HTML or Markdown formatting
  • ❌ No special characters or emojis
  • ❌ No promotional language or hype
Keep it truthful: AI platforms prioritize accuracy. Don’t include misleading or exaggerated claims.

Monitor AI Platform Usage

Use Lantern to:
  • 📊 Track when AI platforms access your llms.txt
  • 🎯 See which facts AI cites from your file
  • ✅ Verify AI platforms are using current information
  • 🔄 Get alerts when it’s time to update content

Next Steps

Security Best Practices

Learn how to secure your site while keeping it AI-accessible