Repository navigation
Conversation
asr.engine picks the local recognizer: whisper (default), parakeet or qwen3. Neither new engine needs NVIDIA hardware: - Parakeet TDT 0.6B v3 via onnx-asr on ONNX Runtime: int8 on the CPU by default; uses CUDA or DirectML automatically when that onnxruntime build is installed. 25 European languages. It does not report the language, so the transcript carries the locked/configured one. - Qwen3-ASR (0.6B default, 1.7B option) via qwen-asr on PyTorch: float32 on the CPU, bfloat16 on a CUDA GPU. 30 languages, language detected. Both are optional extras (uv sync --extra parakeet / --extra qwen3) and are imported only when their model loads; a missing package is a ConfigError naming the install command. Settings > Speech gains an engine selector that shows only the chosen engine's options. Tests: adapter tests against fake libraries, wiring/config tests, a settings-dialog test, and slow real-model tests that skip when the extras are not installed. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0178pC5pfGXepbgU7JEpqVUh
When the speech model failed to load, the pipeline stopped capture in the background, and that stop published a plain STOPPED status, which replaced the error a moment after it appeared. A fatal stop now leaves the status at ERROR with its message. ERROR is not a listening state, so the window still offers Start; the next Start (or a manual Stop) clears it. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0178pC5pfGXepbgU7JEpqVUh
The LOADING status already shows "Loading speech model…"; the pipeline also sent "loading speech model" as its detail, so the window read "Loading speech model…: loading speech model". The detail is now empty. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0178pC5pfGXepbgU7JEpqVUh
A reply hotkey can answer an earlier sentence, but the suggester only saw
what came before it, and was told "They just said" as if it were the
latest. Now:
- SuggestionContext.following holds what was said after the target
(both speakers, finals only), up to suggestions.history_after
utterances (default 4). The history_chars budget covers both sides,
filled nearest-first, so the closest context survives a tight budget.
- The prompt is one numbered transcript with the target marked ">>>" and
named by number ("Suggest replies to message [3]"). When later lines
exist, they are labelled context only: the reply must answer the
target, still make sense now, and not repeat what the user already said.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0178pC5pfGXepbgU7JEpqVUh
suggestions.instructions (Settings > Suggestions > Extra instructions, up to 1000 characters) is added to every suggestion prompt, after the profile, for things like tone, length, or "don't ask questions back unless the conversation needs one". The prompt tells the model to follow them except where they conflict with the fixed rules (reply language, output format, no invented facts). Like the profile, it applies live: changing only the instructions no longer rebuilds the pipeline (which stopped listening and reloaded the speech model). config.needs_rebuild ignores fields listed in LIVE_FIELDS. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0178pC5pfGXepbgU7JEpqVUh
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0178pC5pfGXepbgU7JEpqVUh
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0178pC5pfGXepbgU7JEpqVUh
Each tab set its QFormLayout directly on the page, so when the dialog (as tall as its tallest tab) had spare height, Qt gave it to rows that could grow. The Model + Refresh row stretched to fill the Suggestions and Translation tabs, leaving "Model" far above its field. Pages now pack their rows at the top with a stretch below, and the Model + Refresh row has a fixed vertical size. A UI test checks the row keeps its natural height in a tall dialog. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0178pC5pfGXepbgU7JEpqVUh
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
v2 adds two local speech engines that run without NVIDIA hardware, gives reply suggestions better context plus user-written instructions, and fixes three UI issues found while testing.
Speech engines
asr.enginepicks the recognizer:whisper(default),parakeetorqwen3. Settings → Speech has a "Speech engine" dropdown that shows only the chosen engine's options.onnx-asr. It covers 25 European languages and is fast on a CPU (int8). It uses CUDA or DirectML automatically when that ONNX Runtime build is installed. It doesn't report the language it heard, so the transcript carries the locked or configured language.qwen-asr. It covers 30 languages, uses float32 on a CPU and bfloat16 on a CUDA GPU, and detects the language.uv sync --extra parakeet/--extra qwen3. Each is imported only when its model loads. A missing package is aConfigErrorthat names the install command. Whisper stays installed because Silero VAD ships inside faster-whisper.Suggestions
suggestions.history_after, default 4).history_charscovers both sides, filled nearest-first.>>>and named by number. Later lines are labelled context only, so the reply must still fit the conversation now and must not repeat what the user already said.suggestions.instructions(Settings → Suggestions → Extra instructions, up to 1000 characters) is added to the system prompt. Fixed rules (reply language, output format, no invented facts) win over it. It applies live, like the profile: changing only the instructions no longer rebuilds the pipeline (config.needs_rebuild/LIVE_FIELDS).Fixes
Testing
pytest -m slow) run the real Parakeet and Qwen3 models on synthesized speech, and skip when the extras aren't installed. CI's models job doesn't install them, so the real models are untested in CI.https://claude.ai/code/session_0178pC5pfGXepbgU7JEpqVUh
Generated by Claude Code