Skip to content

Commit a4c5bf9

Browse files
committed
docs: add real-world comparison showing 63% token savings
Tested same query on Express.js codebase with and without plugin. Shows token efficiency gains while maintaining answer quality.
1 parent 81707ca commit a4c5bf9

File tree

1 file changed

+26
-0
lines changed

1 file changed

+26
-0
lines changed

README.md

Lines changed: 26 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -68,6 +68,32 @@ src/api/checkout.ts:89 (Route handler for /pay)
6868

6969
**Rule of thumb**: Semantic search for discovery → grep for precision.
7070

71+
## 📊 Real-World Comparison
72+
73+
We tested the same query on the [Express.js](https://github.com/expressjs/express) codebase (169 files):
74+
75+
> *"find the middleware that handles routing"*
76+
77+
| Metric | Without Plugin | With Plugin |
78+
|--------|----------------|-------------|
79+
| **Tokens used** | 58,715 (46%) | 21,671 (17%) |
80+
| **Token savings** || **63% fewer tokens** |
81+
| **Search approach** | Grep + glob + AST + explore agents | `codebase_search` + grep + explore agents |
82+
| **Answer quality** | ✅ Found external router package | ✅ Found external router package |
83+
84+
### Key Takeaways
85+
86+
1. **Significant token savings**: The plugin reduced token usage by 63% for the same quality answer
87+
2. **Complements existing tools**: The plugin doesn't replace grep/explore agents—it provides a faster initial signal that reduces exploration overhead
88+
3. **Same answer quality**: Both approaches found that Express 5.x delegates routing to the external `router` npm package
89+
90+
### When the Plugin Helps Most
91+
92+
- **Conceptual queries**: "Where is the authentication logic?" (no keywords to grep for)
93+
- **Unfamiliar codebases**: You don't know what to search for yet
94+
- **Cost-sensitive workflows**: 63% fewer tokens adds up over many queries
95+
- **Large codebases**: Semantic search scales better than exhaustive grep
96+
7197
## 🛠️ How It Works
7298

7399
```mermaid

0 commit comments

Comments
 (0)