GioContextAi

Beschreibung

GioContextAi helps WordPress websites expose their content in a clean, structured format for AI systems, crawlers, and other machine-readable applications.

The plugin dynamically generates virtual endpoints for:

• llms.txt — a structured Markdown index of selected website content.
• llms-full.txt — an extended version containing the full text of selected published content.
• ai.txt — a dedicated endpoint for AI-related crawler directives and sitemap information.

The files are generated dynamically through WordPress rewrite rules. No physical files need to be created on your server.

GioContextAi is designed to work alongside your existing SEO tools. It can automatically respect noindex settings detected from supported SEO plugins, helping prevent content that should not be indexed from being included in the generated AI context.

GioContextAi also includes AI Crawler Intelligence: a lightweight monitor of the requests that declared AI crawlers make to your site, as observed by WordPress.

The Lite version provides the core AI context generation engine. GioContextAi Pro adds advanced controls for businesses, developers, agencies, and websites that need more control over how their content is represented to AI systems.

Features

AI Context Files

• llms.txt generation — Automatically creates a structured Markdown index of selected published content.
• llms-full.txt generation — Provides an extended machine-readable version including the content of selected posts and pages.
• ai.txt generation — Provides a dedicated endpoint for AI crawler directives and sitemap information.
• Virtual endpoints — Files are served through WordPress rewrite rules without creating physical files on the server.

Content Control

• Post Type selection — Choose which public post types should be included in the generated context.
• Published content only — Only appropriate published content is considered for inclusion.
• Noindex awareness — Automatically excludes content marked as noindex through supported SEO plugins.
• Protected content safeguards — Password-protected content is not exposed through the generated context.
• System page safeguards — Sensitive WordPress and WooCommerce system pages can be excluded from AI context generation.

AI Crawler Intelligence

• Requests observed by WordPress — Counts the requests made by known AI crawlers (for example GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Meta-ExternalAgent, Amazonbot, CCBot) when WordPress handles them.
• What crawlers request — Requests by type of resource (posts and pages, home page, archives, AI context files, REST API, feeds, sitemaps, search, 404 and redirects) and by response (served, redirected, not found, server error).
• Requests per day — Daily chart by type of crawler (training, AI search, user-initiated, other AI) for the last 7 or 30 days.
• AI context files — Requests to llms.txt, llms-full.txt, ai.txt and products.json, file by file.
• Monitoring diagnostics — The AI Crawlers page states whether monitoring is active, active with partial coverage (for example when a page cache is detected), active with no requests observed yet, or not working, together with any database error.
• Light by design — One small daily aggregate table, one write per crawler request, no request is recorded for regular visitors.

See „About AI Crawler Intelligence“ below for what these figures mean and their limits.

Performance

• Transient caching — Generated context files are cached to reduce unnecessary database queries when crawlers request the endpoints.
• Automatic cache invalidation — Cache is refreshed when relevant content is modified.
• No physical files — The plugin does not create or maintain static files on your server.

Administration

• Simple configuration — Configure included post types directly from the WordPress administration area.
• Endpoint previews — Preview the generated context files directly from the plugin settings.
• Native WordPress integration — Uses WordPress rewrite rules and APIs rather than requiring server-level configuration.

Pro Version

GioContextAi Pro extends the core engine with advanced AI context management tools.

Pro features include:

• Global Brand Voice — Define your brand personality, tone, and communication style.
• Custom AI Instructions — Add global instructions that can be included in the AI context.
• Custom Post Type support — Extend context management to custom post types such as WooCommerce products and portfolios.
• Taxonomy support — Include categories, tags, product categories, and other public taxonomies.
• Per-content controls — Exclude individual posts, pages, products, or taxonomy terms from AI context.
• Custom context instructions — Add contextual notes and instructions to individual resources.
• AI Readiness Audit — Analyze multiple dimensions of your site’s AI context configuration and receive actionable recommendations.
• AI Context Inspector — Inspect how individual content is represented within the generated AI context.
• Per-content AI crawler statistics — Rankings of the most requested posts, pages, WooCommerce products and taxonomy terms, filters by crawler and provider, 12 months of history and the request history of each content, also shown in the editor.
• Advanced AI feed capabilities — Create structured machine-readable feeds for selected WordPress content.
• Priority support and updates — Pro customers receive priority support and product updates during their active license period.

For information about Pro features and licensing, visit the GioSuite website.

How It Works

After activation, GioContextAi registers virtual WordPress endpoints for the generated context files.

For example:

• /llms.txt
• /llms-full.txt
• /ai.txt

When one of these endpoints is requested, GioContextAi generates the appropriate output using your WordPress content and configuration.

The generated files can then be accessed by compatible crawlers, AI systems, developer tools, or other applications that retrieve machine-readable website information.

GioContextAi does not guarantee that a specific AI service or crawler will access or use these endpoints. The plugin provides the structured endpoints and content; how external systems discover, retrieve, or use them is determined by those systems.

About AI Crawler Intelligence

What is counted. A request is counted when WordPress handles it and the user-agent matches one of the AI crawlers in the built-in list. Figures are aggregated per day, crawler, type of resource and response class.

Declared user-agents, not verified identities. Crawlers are identified by the user-agent they declare. A user-agent can be imitated by anyone, so every request is shown as „Declared user-agent (not verified)“. Verification against the IP ranges published by the providers is not active in this version.

Partial coverage with caches and CDNs. Requests answered by a page cache, a server cache (for example Varnish or Nginx FastCGI cache) or a CDN without running WordPress are not seen by the plugin and are not counted. When a page cache plugin is detected, the AI Crawlers page reports partial coverage. The figures are therefore a lower bound of the real crawler traffic.

What the figures do not show. A request shows that a crawler asked for a page. It does not show whether the page was indexed, cited, recommended or used in an AI answer, and GioContextAi does not claim to improve the visibility of your site in AI services.

Scheduled tasks. Expired data is removed by a daily WP-Cron task. WP-Cron runs only when the site receives visits: on low-traffic sites, or when DISABLE_WP_CRON is set, configure a server cron job that calls wp-cron.php. The AI Crawlers page warns when a scheduled task has not run within the expected time.

Free and Pro. The free plugin shows site-wide figures for the last 7 or 30 days. GioContextAi Pro adds per-content detail: rankings of posts, pages, WooCommerce products and taxonomy terms, filters by crawler and provider, a 12-month period and the request history of each content.

Data on uninstall. Deactivating or deleting the plugin keeps the statistics, unless „Delete all GioContextAi data“ is enabled in the settings.

Performance and Caching

GioContextAi uses WordPress transient caching for generated context output.

This prevents the plugin from rebuilding the same content for every request and reduces unnecessary database queries, particularly when context endpoints are accessed repeatedly by automated crawlers.

Relevant caches are automatically invalidated when supported content is modified.

SEO Plugin Compatibility

GioContextAi is designed to work alongside traditional SEO plugins.

The Lite version can detect noindex settings from supported SEO plugins, including:

• Yoast SEO
• Rank Math
• SEOPress

Content marked as noindex can therefore be excluded from the generated AI context.

GioContextAi does not replace your SEO plugin. It provides an additional machine-readable representation of your website content.

Privacy

GioContextAi does not send your website content to an external AI service in order to generate the core context files.

The generated files are served directly by your WordPress installation.

AI Crawler Intelligence stores only daily aggregate counters: date, crawler, type of resource, response class and number of requests, plus the time of the last request. It does not store IP addresses, full user-agent strings, URLs of regular visitors, cookies or any personal data, and it records nothing for regular visitors. Data older than 30 days is deleted daily (developers can extend the period with the giocontextai_crawler_retention_days filter).

External Services

GioContextAi’s core context generation does not require an external third-party service.

The plugin generates and serves the context endpoints directly from your WordPress installation. AI Crawler Intelligence works locally and does not contact any external service.