Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
105 commits
Select commit Hold shift + click to select a range
be624fe
Add Windows voice mode foundation and AlwaysOn runtime
NichUK Mar 21, 2026
f40ffc3
Fix voice chat transport and reply routing
NichUK Mar 23, 2026
a81d31e
Add configurable voice mode settings and setup UI
NichUK Mar 23, 2026
197a89b
Integrate always-on voice mode with tray chat workflow
NichUK Mar 23, 2026
1340bde
Fix tray voice startup and chat window submission
NichUK Mar 23, 2026
aed8cb8
Remove stale always-on autosubmit setting
NichUK Mar 23, 2026
25dd06b
Add focused coordinator coverage for tray voice chat
NichUK Mar 23, 2026
1336472
Address voice mode review findings and harden runtime
NichUK Mar 23, 2026
0f1028a
Document required Minimax and ElevenLabs provider support
NichUK Mar 23, 2026
2c8a46d
Harden tray chat voice message handling
NichUK Mar 23, 2026
fdbf48e
Fix voice transport connection task reuse
NichUK Mar 23, 2026
b556c64
Group voice runtime services under Services/Voice
NichUK Mar 23, 2026
7f31c12
Implement MiniMax TTS for voice mode
NichUK Mar 23, 2026
c64f168
Add editable TTS provider settings to voice mode
NichUK Mar 23, 2026
907a1a0
Move voice settings into main settings window
NichUK Mar 23, 2026
6dba89b
Extract hosted voice settings panel from settings window
NichUK Mar 23, 2026
ded41a2
Generalize cloud TTS providers through catalog contracts
NichUK Mar 23, 2026
199e534
Rename voice modes to VoiceWake and TalkMode
NichUK Mar 23, 2026
47efc3e
Move voice settings below node mode toggle
NichUK Mar 23, 2026
85d7b90
Make cloud TTS voice settings fully catalog-driven
NichUK Mar 23, 2026
c1cc0ff
Ship voice provider catalog with the tray app
NichUK Mar 23, 2026
83f05ee
Instrument voice output latency and reduce TTS buffering
NichUK Mar 23, 2026
d137409
Tighten talk mode speech recognition filtering
NichUK Mar 23, 2026
05d7bae
Use MiniMax api-uw endpoint for lower TTS latency
NichUK Mar 23, 2026
5efcebf
Add catalog-driven MiniMax WebSocket TTS
NichUK Mar 23, 2026
45ff8f8
Fix voice restart after settings save
NichUK Mar 23, 2026
71d0de4
Fix MiniMax websocket voice playback routing
NichUK Mar 23, 2026
91ccec3
Add dynamic tray icons for voice states
NichUK Mar 23, 2026
2ff57fc
Add pre-response voice latency timing logs
NichUK Mar 23, 2026
ffa3fa2
Keep talk mode alive after input failures
NichUK Mar 23, 2026
c3ded30
Queue talk mode replies for sequential playback
NichUK Mar 25, 2026
82e2958
Add voice control and configuration APIs
NichUK Mar 25, 2026
06d508f
Accept late talk mode replies after timeout
NichUK Mar 25, 2026
d8cd664
Add voice mode commit timeline to docs
NichUK Mar 25, 2026
d61d82d
Delay talk mode ready state until recognizer warm-up
NichUK Mar 25, 2026
d1c3655
Recycle stalled talk mode recognition sessions
NichUK Mar 25, 2026
d569f71
Revert talk mode to direct chat send
NichUK Mar 25, 2026
7b8f118
Add configurable tray chat memory stripping
NichUK Mar 25, 2026
c212c3f
Fix stalled talk mode recognizer recycle
NichUK Mar 25, 2026
e07234b
Rebuild talk mode recognizer after deaf sessions
NichUK Mar 25, 2026
3c62244
Fix voice draft clearing and playback start
NichUK Mar 25, 2026
40383a1
Add streaming playback backlog story
NichUK Mar 25, 2026
dcddec2
Fix truncated voice input and MiniMax output
NichUK Mar 25, 2026
cbb4fdc
Refresh talk mode on default mic changes
NichUK Mar 25, 2026
b7ea999
Support selected playback devices
NichUK Mar 25, 2026
0709911
Avoid stale voice preview replies
NichUK Mar 25, 2026
13174ba
Document AudioGraph voice input architecture
NichUK Mar 25, 2026
7046346
Add AudioGraph capture backbone for talk mode
NichUK Mar 25, 2026
339a969
Fix AudioGraph frame buffer interop
NichUK Mar 25, 2026
ee64cb9
Gate talk mode listening on capture readiness
NichUK Mar 25, 2026
cc1ab5c
Document macOS voice parity backlog
NichUK Mar 25, 2026
a305902
Inline parity exceeded notes
NichUK Mar 25, 2026
5ca4af2
Stop recycling talk mode on silence
NichUK Mar 25, 2026
bcdaca8
Delay deaf recognizer recovery until silence
NichUK Mar 25, 2026
4bf802a
Fix overlapping talk mode recovery watchdogs
NichUK Mar 25, 2026
93f01dd
Fix talk mode playback failure handling
NichUK Mar 25, 2026
cd013ac
Add ElevenLabs websocket TTS provider
NichUK Mar 25, 2026
5dadf15
Adjust voice tray icon states
NichUK Mar 25, 2026
e22474b
Tune ElevenLabs websocket turn flushing
NichUK Mar 25, 2026
39623a6
Stop premature ElevenLabs websocket EOS
NichUK Mar 25, 2026
8499202
Match ElevenLabs websocket generation flow
NichUK Mar 25, 2026
e8fefaf
Initial plan
Copilot Mar 26, 2026
14f4279
Initial plan
Copilot Mar 26, 2026
91de100
Update src/OpenClaw.Shared/OpenClawGatewayClient.cs
NichUK Mar 26, 2026
7291d78
Update src/OpenClaw.Tray.WinUI/Services/Voice/VoiceProviderCatalogSer…
NichUK Mar 26, 2026
0a0c3be
Update src/OpenClaw.Tray.WinUI/Windows/WebChatWindow.xaml.cs
NichUK Mar 26, 2026
be22a39
Propagate CancellationToken through WebSocket TTS call chain
Copilot Mar 26, 2026
5bad542
Thread CancellationToken through WebSocket TTS operations to prevent …
Copilot Mar 26, 2026
40b1aa6
Merge pull request #4 from NichUK/copilot/sub-pr-2-again
NichUK Mar 26, 2026
7c9c8b6
Merge remote-tracking branch 'origin/feature/voice-mode' into copilot…
Copilot Mar 26, 2026
2a93e5a
Simplify to single CancellationTokenSource with linked token and timeout
Copilot Mar 26, 2026
c8f5ba1
Add VoiceCloudTextToSpeechClient cancellation and decode tests
Copilot Mar 26, 2026
5628675
Merge pull request #3 from NichUK/copilot/sub-pr-2
NichUK Mar 26, 2026
ea3fb7d
Merge remote-tracking branch 'origin/feature/voice-mode' into feature…
NichUK Mar 26, 2026
8b81870
Log talk mode recognizer restart decisions
NichUK Mar 26, 2026
f1db7b7
Fix stale talk mode restart latch
NichUK Mar 26, 2026
1515e43
Split Talk Mode STT into route classes
NichUK Mar 26, 2026
7d074d7
Stop rebuilding Windows STT on idle timeouts
NichUK Mar 26, 2026
03e7e39
Catalog future STT providers without exposing them
NichUK Mar 26, 2026
ad471b2
Polish talk mode recovery and settings
NichUK Mar 26, 2026
c6be900
Ship v0.1rc3 voice chat and docs fixes
NichUK Mar 26, 2026
89ccb08
Add compact voice repeater window
NichUK Mar 28, 2026
5443dc3
Refine voice transport and webchat draft bridge
NichUK Mar 28, 2026
dc8651c
Refine voice mode controls and docs
NichUK Mar 30, 2026
a787640
Add voice mode feature icon asset
NichUK Mar 30, 2026
67771c2
Address remaining voice review comments
NichUK Mar 30, 2026
4756563
Tweak voice mode README credit wording
NichUK Mar 30, 2026
c9dc8e8
Merge branch 'codex/webchat-direct-send-restore' into feature/voice-mode
NichUK Mar 30, 2026
fc66745
Merge remote feature branch into feature/voice-mode
NichUK Mar 30, 2026
db108f4
Merge origin/master into feature/voice-mode
NichUK Apr 2, 2026
6c9680f
Fix tests after master merge
NichUK Apr 2, 2026
777088c
Update src/OpenClaw.Tray.WinUI/Services/Voice/VoiceCloudTextToSpeechC…
NichUK Apr 2, 2026
78d0a3d
Fix SupportsSpeechToTextRuntime test assertions to match streaming pr…
Copilot Apr 2, 2026
3d5b4e7
Fix incorrect test project binding to x64
NichUK Apr 2, 2026
a6592e8
Merge branch 'feature/voice-mode' of github.com:NichUK/openclaw-windo…
NichUK Apr 2, 2026
83c7983
Revert "Fix SupportsSpeechToTextRuntime test assertions to match stre…
NichUK Apr 2, 2026
1820901
Remove incorrect project binding to x64
NichUK Apr 2, 2026
91006ce
Refactor tray voice code into OpenClaw.Tray.Shared
NichUK Apr 3, 2026
fd6c89f
Update src/OpenClaw.Tray.WinUI/App.xaml.cs
NichUK Apr 3, 2026
4f3c8c6
Update src/OpenClaw.Tray.WinUI/App.xaml.cs
NichUK Apr 3, 2026
7e7bb32
Update src/OpenClaw.Tray.WinUI/Helpers/AppIconHelper.cs
NichUK Apr 3, 2026
88caa1a
Merge pull request #5 from NichUK/codex/fix-pr120-ci
NichUK Apr 3, 2026
5534e93
Add tests for voice provider configuration helpers
NichUK Apr 4, 2026
57ae532
Merge pull request #6 from NichUK/codex/fix-pr120-ci
NichUK Apr 4, 2026
7b48541
Merge remote-tracking branch 'upstream/master' into feature/voice-mode
NichUK Apr 8, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -62,6 +62,7 @@ BenchmarkDotNet.Artifacts/
project.lock.json
project.fragment.lock.json
artifacts/
.env

# ASP.NET Scaffolding
ScaffoldingReadMe.txt
Expand Down Expand Up @@ -344,3 +345,9 @@ MigrationBackup/
# Fody - auto-generated XML schema
FodyWeavers.xsd
Output/

# Repo-local tool caches and workspace metadata
.claude/
.dotnet-cli/
.playwright-cli/
output/playwright/
13 changes: 12 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -105,6 +105,7 @@ Modern Windows 11-style system tray companion that connects to your local OpenCl
- 🚀 **Auto-start** - Launch with Windows
- ⚙️ **Settings** - Full configuration dialog
- 🎯 **First-run experience** - Welcome dialog guides new users
- <img src="src/OpenClaw.Tray.WinUI/Assets/voice-mode-feature.png" alt="Voice Mode" width="20" height="20" /> **Voice Mode (new)** - Talk to your Claw via your Windows node

#### Quick Send scope requirement

Expand All @@ -122,13 +123,14 @@ If Quick Send fails with `pairing required` / `NOT_PAIRED`, that is a **device a

### Menu Sections
- **Status** - Gateway connection status with click-to-view details
- **Voice** - Access to Voice controls
- **Sessions** - Active agent sessions with preview and per-session controls
- **Usage** - Provider/cost summary with quick jump to activity details
- **Channels** - Telegram/WhatsApp status with toggle control
- **Nodes** - Online/offline node inventory and copyable summary
- **Recent Activity** - Timestamped event stream for sessions, usage, nodes, and notifications
- **Actions** - Dashboard, Web Chat, Quick Send, Activity Stream, History
- **Settings** - Configuration, auto-start, logs
- **Settings** - Configuration, auto-start, logs, voice

### Mac Parity Status

Expand All @@ -148,6 +150,7 @@ Comparing against [openclaw-menubar](https://github.com/magimetal/openclaw-menub
| Refresh | ✅ | ✅ | Auto-refresh on menu open |
| Launch at Login | ✅ | ✅ | |
| Notifications toggle | ✅ | ✅ | |
| Voice Mode | ✅ | 🟡 | Talk Mode implemented (half-duplex), WakeWord, Interrupt, etc. in progress

### Windows-Only Features

Expand Down Expand Up @@ -281,6 +284,14 @@ OpenClaw registers the `openclaw://` URL scheme for automation and integration:

Deep links work even when Molty is already running - they're forwarded via IPC.

### Voice Mode
*contributed by NichUK and his colleagues @codex and @copilot*

Currently supports Talk Mode - Always on talk to your Claw! Wakeword and PTT modes coming soon
- Uses internal Windows STT (cloud providers coming soon)
- Windows/Minimax/Eleven Labs TTS voices
- Give your Claw a voice!

## 📦 OpenClaw.CommandPalette

PowerToys Command Palette extension for quick OpenClaw access.
Expand Down
Loading
Loading