Skip to content

feat: improve 5 lowest-scoring skill definitions#498

Open
rohan-tessl wants to merge 3 commits into
deepgram:mainfrom
rohan-tessl:improve/skill-review-optimization
Open

feat: improve 5 lowest-scoring skill definitions#498
rohan-tessl wants to merge 3 commits into
deepgram:mainfrom
rohan-tessl:improve/skill-review-optimization

Conversation

@rohan-tessl

Copy link
Copy Markdown

Hey @deepgram 👋

I ran your skills through tessl skill review at work and found targeted improvements in your skills. Here's the before/after:

Skill Before After Change
deepgram-js-text-intelligence 10% 90% +80%
deepgram-js-text-to-speech 89% 100% +11%
deepgram-js-audio-intelligence 90% 100% +10%
deepgram-js-voice-agent 86% 90% +4%
deepgram-js-management-api 86% 90% +4%

These were easy changes to bring the skill's structure and activation in line with what performs well against Anthropic's best practices. text-intelligence had unquoted YAML with special characters that broke parsing (10% score). Trimmed verbose sections, added workflows and error handling.

In addition, I stress-tested your deepgram-js-management-api skill against a few real-world scenarios, and it held up really well. This means that your skill meaningfully improves agent steering and contributes to stronger output quality. Kudos for that!

Honest disclosure, I work at @tesslio where we build tooling around skills like these. Not a pitch, just saw room for improvement and wanted to contribute.

If you want to self-improve your skills, or define your own scenarios to pressure test, just ask your agent (Claude Code, Codex, etc.) to evaluate and optimize your skill with Tessl. Ping me @rohan-tessl, if you hit any snags.

@rohan-tessl rohan-tessl requested a review from lukeocodes as a code owner May 7, 2026 06:42
@lukeocodes

Copy link
Copy Markdown
Member

@GregHolmes check this out! :o

lukeocodes
lukeocodes previously approved these changes May 12, 2026

@lukeocodes lukeocodes left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

love this less-is-more approach!

@rohan-tessl

rohan-tessl commented May 27, 2026

Copy link
Copy Markdown
Author

@GregHolmes following up on @lukeocodes's ping from a couple weeks back the same change is shipped across all four Deepgram SDKs:

Happy to wait if there's a release window or batching reason, just wanted to flag in case they slipped off the queue. Let me know if you'd like any tweaks before merge, or who to loop in for the second sign-off on Java/Go.

@GregHolmes

GregHolmes commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

Hi @rohan-tessl, thank you for taking the time to suggest these changes. The YAML parse fix on text-intelligence is a genuine catch (I confirmed its frontmatter fails to load with js-yaml on main), and the new Workflow / error-handling sections are solid additions.

Two things your changes remove that I believe we need to restore in audio-intelligence before this merges, both were removed in this PR:

  1. The ## Authentication block. All seven deepgram-js-* skills carry the same client-setup block, and each skill loads in isolation. Dropping it here leaves an agent using audio-intelligence with no cue that it needs DEEPGRAM_API_KEY or how to construct deepgramClient, even though every deepgramClient.listen.v1... snippet below assumes it. Please re-add it verbatim from the siblings, between the intro and ## Quick start — REST with analytics:
require("dotenv").config();

const { DeepgramClient } = require("@deepgram/sdk");

const deepgramClient = new DeepgramClient({
  apiKey: process.env.DEEPGRAM_API_KEY,
});
  1. The diarization-quality gotcha. This line was dropped:

Diarization quality depends on audio quality and duration. Short or noisy clips churn speakers.

It's product/runtime knowledge an agent can't infer from the types or examples, and it lives only in this skill — no sibling carries it — so removing it loses it from the skill set entirely. Please keep it in the Gotchas list.

Everything else looks good to merge once those two are back.

@GregHolmes GregHolmes force-pushed the improve/skill-review-optimization branch from 94e1553 to c3fd965 Compare June 1, 2026 10:30
@GregHolmes GregHolmes self-requested a review as a code owner June 1, 2026 10:30
@rohan-tessl

rohan-tessl commented Jun 3, 2026

Copy link
Copy Markdown
Author

Thanks @GregHolmes both points are fair, will restore them.

  1. Re-adding the ## Authentication block verbatim between the intro and ## Quick start — REST with analytics so the skill stands on its own when loaded in isolation.
  2. Putting the diarization-quality gotcha back in the Gotchas list — agreed it's product knowledge that doesn't live anywhere else in the skill set.

Will push the restore in a moment.

…n gotcha

Restore the standard ## Authentication client-setup block so the skill
stands on its own when loaded in isolation (the listen.v1 examples below
all assume `deepgramClient`). Restore the diarization-quality gotcha —
runtime knowledge that doesn't live anywhere else in the skill set.

Addresses GregHolmes's review feedback on deepgram#498.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants