Repository navigation
docs(realtime-stt): document results.tag_audio_events - #303
Conversation
|
Preview deployment for your docs. Learn more about Mintlify Previews.
💡 Tip: Enable Automations to automatically generate PRs for you. |
|
Caution Review failedThe pull request is closed. Walkthrough
Merge Risk:
|
New realtime option results.tag_audio_events (boolean, default true). false removes every sound tag from the text of a turn (draft, eager_end_of_turn, committed and its words) and collapses whitespace as with diarize false. - WebSocket reference: the config row; invalid_config for a non-boolean value; a configure change applies to turns that open after configured; a guarantee that no text of such a turn holds an opening tag bracket; the Sound tags section says tags can also come in full-width (U+FF3B/U+FF3D) or lenticular (U+3010/U+3011) brackets, widens the strip regular expression to match, and gives the bracket rules for tag_audio_events false (an unclosed bracket hides the rest of a draft but only itself in a final); the Speakers, Language and Degraded commits sections note how the option interacts with them. - AsyncAPI: the property in the config and configure schemas, the session_started config echo, and the committed text description. - Realtime overview and cookbooks: mention the option next to the sound tags; the cookbook strip regexes also match the full-width and lenticular brackets; the voice agent's answer rule notes the option. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
adabab3 to
54265e8
Compare
Summary
Documents the new realtime STT option
results.tag_audio_events(boolean, defaulttrue). Withfalse, the server removes every sound tag, such as[laughter], from the text of a turn (draftand itssettled_text,eager_end_of_turn,committedand itswords) and collapses whitespace as it does withdiarize: false. The default keeps today's output.Merge only after realtime-asr 3.1.0 (https://github.com/fishaudio/realtime-asr/pull/50) is live. Until then the server refuses the field as an unknown key (
invalid_config, close 4400).results.tag_audio_eventsrow in theconfigtable;trueorfalseisinvalid_config(the strings"true"and"false"are not accepted, unlikediarize);configurethat changes it applies to turns that open afterconfigured, likeignore_timestampsanddiarize;falsewhen the turn opened, no text of the turn contains an opening tag bracket ([, U+FF3B or U+3010);tag_audio_events: falseand its bracket rules: each bracket closes only with its own kind; a closing bracket with nothing open is text; an unclosed opening bracket hides the rest of adraft(the tag may still be growing), but ineager_end_of_turnandcommittedonly the bracket is dropped. It also says that speaker tags still followdiarizealone, and what a turn that holds only tags commits;committedcan show text after a stray bracket that its draft hid.config(withdefault: true) andconfigureresults schemas,tag_audio_events: truein thesession_startedconfig echo (the server always echoes the key), and thecommitted.textdescription.stripregex and the voice agent'sTAGSregex now also match full-width and lenticular tags, written as\uFF3B/\u3010escapes. The voice agent's answer rule notes that the option already removes the tags.The wording follows the realtime-asr source doc (
docs/realtime-api-v1.md). Internal details (unchanged engine requests, settle state and history) are left out.This conflicts with the open
docs/realtime-stt-packet-sizebranch inrealtime-voice-agent.mdx. That branch changesCHUNK_MSon the line next toTAGS. Whichever merges second keeps both changes.Checks: prettier (3.6.2, the repo version) on the changed files; the AsyncAPI YAML parses;
mint broken-linksfinds nothing in the changed files (its 25 findings are existing ones in.mintlify/skills/andtemp/). The installed mint CLI has novalidatecommand. Both cookbook regexes were run on sample text with ASCII, full-width and lenticular tags in Python and Node, and the tags were removed as expected. Nothing was tested against production, because the option is not live yet. No CJK characters and no internal names.🤖 Generated with Claude Code
Need help on this PR? Tag
@codesmith-botwith what you need.Summary by CodeRabbit