feat(seo): add GEO optimization (llms.txt) and 4 Learning Center articles (P2)#2026
Merged
Baoyuantop merged 7 commits intomasterfrom Apr 16, 2026
Merged
feat(seo): add GEO optimization (llms.txt) and 4 Learning Center articles (P2)#2026Baoyuantop merged 7 commits intomasterfrom
Baoyuantop merged 7 commits intomasterfrom
Conversation
… Center articles (P2) GEO (Generative Engine Optimization): - Add llms.txt at domain root with curated index of 30+ key documentation pages organized by category (core docs, auth, traffic, AI, observability, K8s) - Clean up duplicate Disallow rules in robots.txt - Add llms.txt reference comment in robots.txt - No AI crawlers are blocked (GPTBot, ClaudeBot, PerplexityBot all allowed) Learning Center articles (4 new pages): - "Open Source API Gateway Comparison: APISIX vs Kong vs Envoy vs Traefik" — feature table, performance benchmarks, when to choose which - "What is Mutual TLS (mTLS)?" — handshake process, vs standard TLS, zero-trust use cases (targets 880/mo search volume, APISIX ranks #10) - "What is gRPC?" — vs REST comparison, HTTP/2 streaming, API gateway integration (targets 320+ monthly searches across gRPC keywords) - "API Monetization Guide" — pricing models, technical requirements, implementation strategy (targets 320/mo search volume)
Contributor
There was a problem hiding this comment.
Pull request overview
This PR introduces SEO/GEO improvements by adding an llms.txt index for AI-oriented discovery and publishing four new Learning Center articles intended to improve search coverage for high-intent queries.
Changes:
- Clean up
robots.txtduplicate rules and add a comment pointing to/llms.txt. - Add
website/static/llms.txtwith curated links for AI crawlers. - Add 4 new Learning Center markdown articles under
website/learning-center/.
Reviewed changes
Copilot reviewed 6 out of 6 changed files in this pull request and generated 4 comments.
Show a summary per file
| File | Description |
|---|---|
| website/static/robots.txt | Removes duplicate rules and appends AI/llms.txt-related comments. |
| website/static/llms.txt | Adds an AI-friendly index of key APISIX docs and pages. |
| website/learning-center/what-is-mutual-tls.md | New Learning Center article on mutual TLS (mTLS). |
| website/learning-center/what-is-grpc.md | New Learning Center article explaining gRPC and gateway integration. |
| website/learning-center/open-source-api-gateway-comparison.md | New comparison article for APISIX vs Kong vs Envoy vs Traefik. |
| website/learning-center/api-monetization-guide.md | New guide covering API monetization models and implementation concepts. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Comment on lines
+48
to
+51
| ## Learning Center | ||
|
|
||
| - [What is an API Gateway?](https://apisix.apache.org/learning-center/what-is-an-api-gateway/): Definition, benefits, and use cases | ||
| - [What is API Management?](https://apisix.apache.org/learning-center/what-is-api-management/): Platforms, tools, and best practices |
There was a problem hiding this comment.
This llms.txt index doesn’t include the 4 new Learning Center articles added in this PR, and the total number of linked pages appears well below the “30+ key pages” stated in the PR description. Consider expanding this file to include the new /learning-center/* slugs (and any other missing high-value pages) so the GEO change matches the stated intent.
Comment on lines
+119
to
+121
| # AI search engine crawlers — explicitly allowed | ||
| # llms.txt for AI-friendly documentation index | ||
| # See https://apisix.apache.org/llms.txt |
There was a problem hiding this comment.
robots.txt is intended to block all versioned docs except the unversioned latest, but the Disallow lists currently stop at 3.15. config/apisix-versions.js includes 3.16, so /docs//3.16/ (and /zh/docs//3.16/) will be crawlable duplicates unless you add the corresponding Disallow rules or generate this section from the canonical version list.
- Remove fabricated survey citations (CNCF, Gartner, Datadog, TechEmpower, Platform Engineering) that cannot be verified - Remove fabricated benchmark table with specific RPS/latency numbers - Remove self-serving API7.ai benchmark claim - Remove service mesh references (APISIX mesh project is deprecated) - Remove unverifiable AWS API Gateway pricing - Adopt neutral, factual tone throughout - Replace benchmark section with guidance on running your own tests - Keep only verifiable facts (plugin counts from docs, architecture details, license types)
Yilialinn
previously approved these changes
Apr 15, 2026
Yilialinn
approved these changes
Apr 15, 2026
Baoyuantop
approved these changes
Apr 16, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
P2 SEO/GEO improvements: AI search engine optimization and 4 new Learning Center educational articles.
GEO (Generative Engine Optimization)
/llms.txtwith curated links to 30+ key pages organized by category (core docs, auth & security, traffic control, AI gateway, observability, Kubernetes). This follows the llms.txt specification used by AI search engines (ChatGPT, Perplexity, Gemini) to discover authoritative content.Test plan
yarn buildsucceeds/llms.txtis accessible as a static file/learning-center/lists all articles (requires P0 PR merged first)