AI Content Guide - Documentation

Overview

AI Content Guide is a WordPress plugin that generates llms.txt files to help AI systems like ChatGPT, Claude, and Perplexity better understand your website content. This improves how your content appears in AI-generated responses and prepares your site for the growing importance of AI-powered search.

What is llms.txt?

llms.txt is a proposed standard file format, similar to robots.txt, that provides AI systems with a structured overview of your website's content. It follows the specification outlined at llmstxt.org.

Why This Matters: As AI-powered search becomes more prevalent, having an llms.txt file helps ensure your content is properly understood and cited by AI systems.

Key Benefits

🎯 Better AI Visibility

Improves how AI systems discover and understand your content, leading to better citations in AI-generated responses.

🔄 Automatic Updates

Your llms.txt file is automatically updated when you publish new content or change settings.

🛡️ SEO Friendly

Respects your existing SEO settings and integrates with popular SEO plugins.

⚡ Performance Optimized

Lightweight design with minimal impact on your website's speed and performance.

Installation

Method 1: WordPress Admin (Recommended)

Access Plugin Directory

Go to your WordPress admin dashboard and navigate to Plugins > Add New.

Search for Plugin

Search for "AI Content Guide" in the plugin directory.

Install and Activate

Click "Install Now" and then "Activate" once installation is complete.

Method 2: Manual Installation

Download Plugin

Download the plugin zip file from WordPress.org or our website.

Upload to Server

Upload the ai-content-guide-llms-text-generator folder to your /wp-content/plugins/ directory.

Activate Plugin

Activate the plugin through the 'Plugins' menu in WordPress.

Installation Complete! You should now see "AI Content Guide" in your WordPress admin menu.

Configuration

Initial Setup

After activation, navigate to AI Content Guide in your WordPress admin menu to configure the plugin.

Content Settings

Setting	Description	Default
Site Introduction	Brief introduction to your website that appears at the top of llms.txt	Auto-generated from site description
Post Types	Select which post types to include (Posts, Pages, Custom Post Types)	Posts and Pages
Include Taxonomies	Whether to include category, tag, and custom taxonomy archives	Enabled
Max Posts Per Type	Maximum number of posts to include for each post type	20
Description Length	Maximum length of post descriptions in characters	150

File Settings

Setting	Description	Recommended
File Method	How the llms.txt file is served (WordPress Rewrite or Direct File)	WordPress Rewrite
Add to robots.txt	Add reference to llms.txt in your robots.txt file	Enabled
Generate Full File	Create comprehensive llms-full.txt file with detailed content	Enabled

Advanced Settings

Use the Advanced Settings tab to add custom content to your llms.txt file. This is useful for including information that isn't automatically generated, such as:

Company information
Contact details
Special instructions for AI systems
Additional context about your content

Features

Automatic File Generation

The plugin automatically generates your llms.txt file based on your content and settings. The file is updated when:

You publish or update posts/pages
You change plugin settings
You manually regenerate the file

File Delivery Methods

WordPress Rewrite (Recommended)

Serves the file dynamically using WordPress rewrite rules. This method:

Works on all hosting environments
Doesn't require file system write permissions
Is automatically updated when content changes

Direct File

Creates a physical llms.txt file in your website root. This method:

Requires write permissions to your root directory
May be preferred by some hosting configurations
Creates an actual file that can be directly accessed

File Status Monitoring

The plugin dashboard shows real-time status of your llms.txt file:

Whether the file exists
If it's accessible via URL
Delivery method being used
Last update timestamp

Content Preview

Use the preview feature to see exactly what your llms.txt file will contain before it's generated.

SEO Integration

Supported SEO Plugins

AI Content Guide automatically integrates with popular SEO plugins:

Yoast SEO - Uses meta descriptions and respects noindex settings
Rank Math - Integrates with focus keywords and meta data
All in One SEO - Respects SEO settings and meta descriptions
SEOPress - Full integration with SEO configuration

How Integration Works

The plugin automatically:

Excludes content marked as "noindex"
Uses SEO meta descriptions when available
Respects your SEO plugin's content priorities
Includes focus keywords in content descriptions

Note: If no SEO plugin is detected, the plugin will still function normally using WordPress default content and excerpts.

Content Filtering

The plugin respects these SEO directives:

Posts/pages marked as noindex are excluded
Private or draft content is never included
Password-protected content is excluded
SEO meta descriptions take priority over excerpts

Troubleshooting

Common Issues

llms.txt File Not Accessible

Symptoms: Visiting yoursite.com/llms.txt shows a 404 error

Solutions:

Go to Settings > Permalinks and click "Save Changes" to flush rewrite rules
Check if your hosting provider blocks .txt files
Try switching to "Direct File" method in plugin settings
Ensure the plugin is activated and settings are saved

File Not Updating

Symptoms: Changes to content don't appear in llms.txt

Solutions:

Click "Regenerate Now" in the plugin dashboard
Check if caching is enabled and clear cache
Verify the content is published and not set to noindex

Direct File Method Failing

Symptoms: Error messages about file write permissions

Solutions:

Check file permissions on your website root directory
Switch to "WordPress Rewrite" method
Contact your hosting provider about write permissions

Large File Size

Symptoms: llms.txt file is very large

Solutions:

Reduce "Max Posts Per Type" setting
Decrease "Description Length" setting
Disable "Include Taxonomies" if not needed
Exclude unnecessary post types

Still Having Issues? Check the WordPress error logs or contact support through the WordPress.org support forum.

Developer Guide

Hooks and Filters

The plugin provides several hooks for developers to customize functionality:

Filters

// Modify the generated content before saving
add_filter('fulgid_aicogu_generated_content', function($content) {
    return $content . "\n\n## Custom Section\nAdditional information";
});

// Filter posts before processing
add_filter('fulgid_aicogu_posts', function($posts) {
    // Filter or modify posts array
    return $posts;
});

// Customize file headers
add_filter('fulgid_aicogu_file_header', function($header) {
    return "# My Custom Site\n\n> Custom description\n\n";
});
                

Actions

// Run custom code after file generation
add_action('fulgid_aicogu_file_generated', function($content) {
    // Log file generation or perform custom actions
    error_log('llms.txt file regenerated');
});

// Before file generation
add_action('fulgid_aicogu_before_generation', function() {
    // Perform actions before generation
});
                

Custom Post Type Integration

To include custom post types in llms.txt:

Ensure your custom post type is set to public => true
Enable it in the plugin's Content Settings
Optionally use filters to customize how it appears

Programmatic File Generation

// Manually trigger file regeneration
$content_analyzer = new FULGID_AICOGU_Content_Analyzer();
$file_manager = new FULGID_AICOGU_File_Manager();

$content = $content_analyzer->analyze_site_content();
$file_manager->generate_file($content);
                

Frequently Asked Questions

General Questions

Q: Will this improve my search engine rankings?

A: llms.txt primarily targets AI systems rather than traditional search engines. While it may not directly affect traditional SEO rankings, it can improve how your content appears in AI-generated responses.

Q: How often should I update my llms.txt file?

A: The plugin automatically updates the file when you publish content or change settings. Manual updates are rarely necessary.

Q: Can I have both llms.txt and robots.txt?

A: Yes! They serve different purposes and complement each other. The plugin can even add a reference to llms.txt in your robots.txt file.

Technical Questions

Q: Does this plugin work with multisite?

A: Yes, each site in a multisite network can have its own llms.txt file and settings.

Q: What happens if I deactivate the plugin?

A: The llms.txt file will no longer be served, but your settings are preserved. If using direct file method, you may need to manually delete the file.

Q: Can I exclude specific posts or pages?

A: Yes, you can exclude content by marking it as "noindex" in your SEO plugin, or it will be automatically excluded if it's private, draft, or password-protected.

Privacy and Security

Q: Does this plugin collect any data?

A: No, the plugin does not collect, store, or transmit any personal data. All processing happens locally on your server.

Q: Is the generated content secure?

A: The plugin only includes public content that's already accessible on your website. Private, draft, or password-protected content is never included.

Need More Help? Visit the WordPress.org support forum for community support or contact us through our website.