Repository navigation
feat(agent): hear voice messages addressed to the agent - #202
Merged
Merged
Conversation
added 2 commits
October 12, 2026 19:22
A voice message to Stacky got no answer. In a room with several people nanobot decides whether a message is for the agent before it transcribes it, and a voice message's text is "Voice message", so it never carried the agent's name. Now the agent transcribes voice messages with the stack's Whisper, in the household language, the way the archivist does. In a shared room a voice message is let through the gate and, once transcribed, held to the rule for typed text: it reaches the agent only if what was said starts with the agent's name. Any other gets no answer. In a direct chat or the agent's own thread every voice message counts. The answer starts with what was heard, as a quote, so a word Whisper got wrong shows next to what it caused. Every voice message in a shared room the agent is in is transcribed, also the ones meant for someone else; the transcript is not kept. Refs: #197
A photo of a handwritten list, sent with a caption that starts with the
agent's name ("Stacky, put this on the shopping list"), now has its
items added. The model sees the image; nanobot falls back to a text
placeholder for a model without vision.
A photo sent first and explained in a second message is not connected:
the user guide says to put the words in the caption.
Refs: #197
4 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Refs: #197