Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
82fbbb2
feat(client): add optional companion babble and spring drag tilt
DoodleBears Oct 8, 2026
e431168
Merge remote-tracking branch 'origin/main' into codex/1173-companion-…
DoodleBears Oct 8, 2026
e2e7014
fix(companion): keep throw physics alive beyond the character clip
DoodleBears Oct 8, 2026
9c4d660
Merge origin/main into codex/1173-companion-babble-spring
DoodleBears Oct 8, 2026
15cd2e8
fix(companion): hide idle chrome until deliberate interaction
DoodleBears Oct 8, 2026
a4069f7
Merge latest main into companion feedback slice
DoodleBears Oct 8, 2026
629f7ba
test(companion): comply with source comment policy
DoodleBears Oct 8, 2026
01dc9ad
test(companion): exercise collision with active status bubbles
DoodleBears Oct 8, 2026
c396fba
Merge latest main while preserving companion and WeChat notes
DoodleBears Oct 8, 2026
d6156ff
fix(companion): follow long message tails without scrollbars
DoodleBears Oct 8, 2026
4e36690
Merge latest main into companion motion and reading slice
DoodleBears Oct 8, 2026
5e0ec08
Merge latest main before companion interaction audio
DoodleBears Oct 8, 2026
451d27a
feat(client): add companion interaction sounds
DoodleBears Oct 8, 2026
4776990
fix(client): unlock companion audio on first drag
DoodleBears Oct 8, 2026
223ed1e
docs(companion): publish real interaction audio evidence
DoodleBears Oct 8, 2026
d7f3d91
docs(companion): publish real reading and mouth lifecycle evidence
DoodleBears Oct 8, 2026
3b1b591
fix(companion): admit fresh replies after final card dismissal
DoodleBears Oct 8, 2026
e492654
Merge latest main for current avatar compatibility
DoodleBears Oct 8, 2026
62d9ef7
test(companion): verify empty-reader recovery displays new output
DoodleBears Oct 8, 2026
c693867
docs(companion): publish real fresh-reply dismissal regression evidence
DoodleBears Oct 8, 2026
3c7da41
docs(companion): qualify native unpin and live repin
DoodleBears Oct 8, 2026
84f01f3
docs(companion): format sanitized unpin qualification
DoodleBears Oct 8, 2026
426167c
Keep companion anchors aligned on direct motion commits
DoodleBears Oct 9, 2026
803be5e
Record actual reduced-motion release regression and correction
DoodleBears Oct 9, 2026
3dbcce8
Merge current main into companion sound and spring branch
DoodleBears Oct 9, 2026
a4b78f2
docs(companion): qualify actual offscreen playback and return
DoodleBears Oct 9, 2026
50b4453
merge: integrate live companion requests with sound and spring
DoodleBears Oct 9, 2026
476cc0d
docs(companion): qualify sound with live multi-bot requests
DoodleBears Oct 9, 2026
c9cc029
fix(client): keep throw gravity on elapsed frame time
DoodleBears Oct 9, 2026
fc50dde
docs: keep companion sound and drop fixes unreleased
DoodleBears Oct 9, 2026
ef1885d
fix(client): start drop integration at pointer release
DoodleBears Oct 9, 2026
024fe5f
merge: integrate latest main with companion drop clock
DoodleBears Oct 9, 2026
98edf28
docs: format integrated unreleased ledger entries
DoodleBears Oct 9, 2026
0eb841d
End companion drag immediately at pointer release
DoodleBears Oct 9, 2026
4072b9e
Merge latest main into companion release fix
DoodleBears Oct 9, 2026
c8fec7c
Record integrated companion release and floor return
DoodleBears Oct 9, 2026
83a02c6
docs: qualify companion audio through stale recovery and repin
DoodleBears Oct 9, 2026
2ff8136
docs: qualify stale audio interval precisely
DoodleBears Oct 9, 2026
1ab4fb9
docs: qualify companion archive audio and resume
DoodleBears Oct 9, 2026
aa74d85
docs: format archive audio qualification
DoodleBears Oct 9, 2026
b48ed8a
refactor: move companions with a translated stage
DoodleBears Oct 9, 2026
774d9f6
merge: integrate latest main with companion translation
DoodleBears Oct 9, 2026
7b1eba8
docs: capture translated companion release on real DSH
DoodleBears Oct 9, 2026
3a1764e
docs: compare companion translation in both themes
DoodleBears Oct 9, 2026
5cddec3
Merge direct-motion anchor correction into companion polish
DoodleBears Oct 9, 2026
1c0651e
fix(client): keep companion stage fixed during keyboard reading
DoodleBears Oct 9, 2026
0e122cc
docs: record native companion reading and stage qualification
DoodleBears Oct 9, 2026
326d669
merge: sync companion polish with current main
DoodleBears Oct 10, 2026
43dae15
docs: keep released companion history immutable
DoodleBears Oct 10, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,8 @@ Pixel Avatars can be an elf, dwarf, orc or talking flower with beards, medieval

### Added

- Window Companions offer optional, quiet text-paced babble and grab, fast-drag, throw and first-impact landing sounds, off by default for each Profile, and a damped angular spring makes drag reversals and settling continuous without adding model tools or TTS. Idle companions hide the empty status bubble and fade action controls in on hover or keyboard focus; pointer focus after dragging no longer keeps reading open. Long message bubbles follow the latest revealed text without scrollbars; scrolling upward preserves the reading position until returning to the bottom. Dismissing the final card shows waiting replies and lets later arrivals display even while the character retains keyboard focus ([#1173](https://github.com/BotHarness/DeepSeekBot/issues/1173)).

- The CLI can create blank, Zip/directory and GitHub/Git PersonaBots, configure models and inspect Channel, attention and Session summaries through a running Host, retaining known partial results and offering explicit identity cleanup with Memory preserved. See the [CLI guide](docs/bot-cli.md) ([#1363](https://github.com/BotHarness/DeepSeekBot/issues/1363)).

- The CLI can authorize Feishu and WeChat IM applications through the existing Provider, return a phone-scannable QR, submit credentials or verification codes through stdin and poll or cancel the same authorization attempt. See the [CLI guide](docs/bot-cli.md) ([#1318](https://github.com/BotHarness/DeepSeekBot/issues/1318)).
Expand Down Expand Up @@ -79,6 +81,12 @@ Pixel Avatars can be an elf, dwarf, orc or talking flower with beards, medieval

### Fixed

- Window Companion bubbles update their origin together with the character during dragging, keyboard movement and reduced-motion release, without waiting for another animation frame ([#1248](https://github.com/BotHarness/DeepSeekBot/issues/1248)).

- Reading a Window Companion bubble with the keyboard or resizing the window no longer scrolls the outer stage and leaves the character above the floor; the bubble itself still scrolls ([#1173](https://github.com/BotHarness/DeepSeekBot/issues/1173)).

- Window Companions keep falling after a fast throw clips the character outside the visible content, and delayed frames no longer slow gravity into an apparent midair pause. Releasing immediately ends the drag, so a late pointer move cannot grab the character again; the release click remains suppressed. Visibility checks follow the fixed presentation area, while hidden pages and offscreen areas still pause animation ([#1173](https://github.com/BotHarness/DeepSeekBot/issues/1173)).

- Opening a Bot DM by Channel ID, including the first Bot-mode entry, now shows that PersonaBot's Channel sidebar and shares its collapse/expansion preferences with Bot navigation; stale conversation metadata no longer selects another Channel's entries ([#1361](https://github.com/BotHarness/DeepSeekBot/issues/1361)).

- Clicking the tutorial mask advances to the next step instead of dismissing the tour; the final step uses the Done action. The footer keeps Skip as text and uses labeled icons for Previous, Next and Done so the controls and progress do not wrap ([#1356](https://github.com/BotHarness/DeepSeekBot/issues/1356)).
Expand Down
8 changes: 8 additions & 0 deletions CHANGELOG.zh.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,8 @@

### Added

- 窗口伙伴新增随文字播放的轻柔叽咕声与抓起、快速拖动、抛出及首次落地音效,按 Profile 保存开关且默认关闭;拖拽倾斜改用阻尼角度弹簧,让反向拖动与回摆连续,不增加模型工具或 TTS。空闲时隐藏占位状态气泡,操作按钮仅在悬浮或键盘聚焦时淡入;拖拽留下的鼠标焦点不再锁住阅读状态。长消息气泡隐藏滚动条并自动跟随最新播放文字;向上翻阅时保持阅读位置,回到底部后恢复跟随。关闭最后一张卡片后立即显示等待中的回复,小人仍保留键盘焦点时,后续新消息也能继续出现([#1173](https://github.com/BotHarness/DeepSeekBot/issues/1173))。

- CLI 可在运行中的 Host 创建空白、Zip/目录和 GitHub/Git PersonaBot,配置模型并查询 Channel、待办与 Session 摘要;失败保留已知完成结果,显式清理身份时保留 Memory。见 [CLI 指南](docs/bot-cli.md)([#1363](https://github.com/BotHarness/DeepSeekBot/issues/1363))。

- CLI 可经既有 Provider 完成飞书与微信的 IM 应用授权,返回手机扫码二维码,通过 stdin 提交凭据或验证码,并查询或取消同一次授权。参见 [CLI 指南](docs/bot-cli.md)([#1318](https://github.com/BotHarness/DeepSeekBot/issues/1318))。
Expand Down Expand Up @@ -79,6 +81,12 @@

### Fixed

- 窗口伙伴在拖拽、键盘移动与减少动效下松手时,同步更新人物和气泡来源锚点,无需等待下一动画帧([#1248](https://github.com/BotHarness/DeepSeekBot/issues/1248))。

- 用键盘阅读窗口伙伴气泡或调整窗口尺寸时,不再滚动外层舞台、让人物悬在底部上方;气泡内部仍可滚动([#1173](https://github.com/BotHarness/DeepSeekBot/issues/1173))。

- 窗口伙伴快速甩到可见内容区外后仍会继续下落,绘制帧延迟也不再让重力变慢而看似悬空。松手会立即结束拖拽,迟到的鼠标移动不会把人物重新抓住,同时仍避免松手误开私聊。可见性检测改为跟随固定显示区域,页面隐藏或整个区域离屏时仍暂停动画([#1173](https://github.com/BotHarness/DeepSeekBot/issues/1173))。

- 通过 Channel ID 打开 Bot 私聊(包括首次进入 Bot 模式)时,现在显示对应 PersonaBot 的侧栏,并与 Bot 导航共享收起与展开偏好;旧对话元数据不会再导致侧栏显示其他 Channel 的条目([#1361](https://github.com/BotHarness/DeepSeekBot/issues/1361))。

- 点击教程遮罩会进入下一步,不再退出引导;最后一步执行完成按钮的动作。底部的跳过保留为文字,上一步、下一步和完成改用带无障碍名称的图标,按钮和进度不再挤压换行([#1356](https://github.com/BotHarness/DeepSeekBot/issues/1356))。
Expand Down
4 changes: 3 additions & 1 deletion docs/architecture/botharness-architecture.en.md
Original file line number Diff line number Diff line change
Expand Up @@ -642,7 +642,9 @@ The [#1152](https://github.com/BotHarness/BotHarness/issues/1152) QQ group-text

If an EventSource enters the terminal CLOSED state after a temporary HTTP failure, the collection owner replaces it with one retry timer backing off from 1 to 8 seconds. The last acknowledged process consumer ID is carried in `?resume=`; native `Last-Event-ID` takes precedence when the replacement subsequently reconnects automatically. Both paths use the same authenticated, bounded Host lease and canonical requalification. Successful baselines reset backoff; removing the last selection or disposing the Plugin cancels the timer and resume identity. No resume identity survives a Client restart.

The Client's independent `CompanionMotion` owns bounded drag poses, velocity sampling, continuous gravity, damped lateral motion, a small floor rebound and settling. View owns the existing frame loop and eases character transforms; bubbles follow the same position. Resizing preserves the current motion and retargets bounds and the drag origin; pointer cancellation matches the active capture. Final landing persists only the normalized horizontal position. Reduced motion returns directly to the floor without pose effects. These are independently implemented presentation dynamics, informed by Coopanion's drag/air/landing interaction rather than imported source or artwork.
The Client's independent `CompanionMotion` owns bounded drag poses, velocity sampling, continuous gravity, damped lateral motion, a small floor rebound and settling. View owns the existing frame loop; a damped second-order angular spring preserves angle and angular velocity through drag reversal, holding and release, while bubbles follow the same position. Bounded integration steps and an angle limit prevent delayed frames from destabilizing the pose. Resizing preserves the current motion and retargets bounds and the drag origin; pointer cancellation matches the active capture. Final landing persists only the normalized horizontal position. Reduced motion clears spring energy and returns directly to the floor without pose effects. These are independently implemented presentation dynamics, informed by Coopanion's drag/air/landing interaction rather than imported source or artwork.

One Client-owned `CompanionSound` serves the collection, consuming newly revealed committed graphemes from the existing playback loop and grab, fast-drag, fast-release and first-ground-impact feedback from `CompanionMotion`. Drag squeaks have a 500ms cooldown; small rebounds do not repeat the landing sound. Cancellation and reduced-motion resets do not replay feedback. The existing `speechSound` storage field now retains the unified companion-sound preference without resetting saved choices. The global companion setting persists per Client/Profile and defaults off. Web Audio is allocated lazily by a trusted Human gesture; blocked or unavailable audio does not affect message playback. Short synthesized syllables vary with Bot identity and text, skip punctuation/whitespace, and use bounded concurrency and rate limits without a catch-up queue. Muting, hidden/offscreen presentation, stale synchronization, archive, removal and disposal stop the relevant voices. This presentation adds neither model tools nor TTS, and audio resources and playback progress are not persisted ([#1173](https://github.com/BotHarness/DeepSeekBot/issues/1173)).

For companion consumers, Avatar exposes a disposable anchor reader. It captures the supported head's local top-center once per Avatar replacement, then reads only that local group's displayed screen matrix in the existing visible-frame loop, including outer rotation, scale and transition origin. Activity pixel covers use the same stable head-region point with the SVG root matrix. Images, unknown rigs and unavailable SVG geometry use the visible Avatar box top-center. There is no whole-SVG bounds scan per frame or Host pose RPC. `CompanionBubbles` keeps the original projected point while placing upright cards within viewport limits, above the toolbar and away from other companions; a pixel-style connector preserves the relationship after displacement. Reading keeps its placement continuity and existing grace period. Hidden/offscreen presentation stops sampling, and Avatar replacement/disposal clears the reader ([#1177](https://github.com/BotHarness/DeepSeekBot/issues/1177)).

Expand Down
4 changes: 3 additions & 1 deletion docs/architecture/botharness-architecture.md
Original file line number Diff line number Diff line change
Expand Up @@ -798,7 +798,9 @@ The [#1152](https://github.com/BotHarness/BotHarness/issues/1152) QQ group-text

EventSource 在暂时 HTTP 失败后进入终态 CLOSED 时,集合 owner 用单一重试计时器重新建立连接,间隔从 1 秒退避到最多 8 秒。最后确认的过程消费 ID 通过 `?resume=` 携带;新连接随后原生自动重连时,`Last-Event-ID` 优先于查询参数。两条路径共享同一认证、有界 Host 租约与规范资格重查。成功基线重置退避;移除最后一个选择或卸载 Plugin 清理计时器和恢复标识。Client 重启不保留恢复标识。

Client 独立的 `CompanionMotion` 拥有有界拖拽姿态、速度采样、连续重力、横向阻尼、轻微地面回弹与落地收敛。View 继续拥有既有帧循环,对人物变换做缓动;气泡跟随同一位置。调整窗口保留当前运动并重新收敛边界、协调拖拽原点,指针取消只匹配活动捕获。最终落地只保存归一化横向位置;减少动效时直接回到底部并关闭姿态效果。这些呈现动力学独立实现,参考 Coopanion 的拖拽/空中/落地交互概念,不引入其源码或美术。
Client 独立的 `CompanionMotion` 拥有有界拖拽姿态、速度采样、连续重力、横向阻尼、轻微地面回弹与落地收敛。View 继续拥有既有帧循环;带阻尼的二阶角弹簧在拖拽反向、停留与松手时保留角度和角速度,气泡跟随同一位置。有界积分步长和倾角上限避免延迟帧使姿态失稳。调整窗口保留当前运动并重新收敛边界、协调拖拽原点,指针取消只匹配活动捕获。最终落地只保存归一化横向位置;减少动效时清除弹簧能量、直接回到底部并关闭姿态效果。这些呈现动力学独立实现,参考 Coopanion 的拖拽/空中/落地交互概念,不引入其源码或美术。

集合共用一个 Client-owned `CompanionSound`,消费既有文字播放循环新显示的已提交字素,以及 `CompanionMotion` 的抓起、快速拖动、快速释放与首次触地反馈。拖动音效冷却 500ms,地面小反弹不重复播放;取消捕获与减少动效不补播。沿用既有 `speechSound` 存储字段保存统一伙伴音效偏好,避免重置已选设置。全局伙伴声音设置按 Client/Profile 持久化,默认关闭;Web Audio 只在可信 Human 操作时按需创建,受限或不可用不影响消息。短合成音节随 Bot 身份和文字变化,标点与空白静音,并发与频率有界,不排队补播。静音、隐藏/离屏、断线、归档、移除和销毁停止相应声音。该呈现不新增模型工具或 TTS,不持久化音频资源或播放进度([#1173](https://github.com/BotHarness/DeepSeekBot/issues/1173))。

Avatar 为伙伴消费者提供可释放的锚点读取器:每次形象替换只采集一次受支持头部的局部顶部中心,既有可见帧循环只读取该局部组当前显示的屏幕矩阵,包含外层旋转、缩放及过渡中的变换原点。像素 Activity 覆盖使用相同头部区域点与 SVG 根矩阵;图片、未知 rig 或不可用的 SVG 几何使用可见 Avatar 盒子顶部中心。不逐帧扫描整个 SVG 边界,也不向 Host 发送姿态 RPC。`CompanionBubbles` 保留原始投射点,让直立卡片受视口、工具栏与多伙伴避让约束,偏移后用像素式连线保持来源关系。阅读延续既有位置与离开宽限;隐藏/离屏停止采样,形象替换/销毁清除读取器([#1177](https://github.com/BotHarness/DeepSeekBot/issues/1177))。

Expand Down
9 changes: 9 additions & 0 deletions docs/assets/pr/1173-archive-audio/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# Actual DSH archive and resume during speech

Runtime source 4072b9e6b8add5fa7cfab214b8a769c8220f1894, formal pixel-avatar 0.10.0; Chinese, dark theme, 1559 × 865 at scale 1. A new canonical Bot reply drives partial text reveal and native Web Audio. Native pin/sound controls and the owning Host's pause/resume RPC exercise real Bot archive and resume, without fabricating product events or state.

Before archive, the card is partially revealed and audio starts are observed. Across 120 archived samples and at least five seconds, source starts remain 11 → 11, one immediate stop is observed, cards are absent and the mouth is restored. After resume, starts remain 11 → 11 for at least three seconds with zero historical cards. The same document survives both transitions. Bot and original sound preference are restored; observer and owned browser are closed. No console errors occur.

A bounded observer delegates actual oscillator/buffer source start and stop calls to the original native methods. Its 23 observed calls do not modify audio output or capture a microphone. This qualifies source admission and cessation, not acoustic playback, every retained resource, genuine background, unsupported AudioContext or autoplay failure. No performance trace or heap measurement ran during this recording.

The continuous silent VP9 recording contains 466 frames over 31.066 seconds and was container-remuxed only. The PNGs are successive states at one fixed runtime, not a code-version comparison. Chat and roster contain isolated QA fixtures only; no Human-supplied image, login credential, raw profile log or raw browser trace is published.
Binary file not shown.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
87 changes: 87 additions & 0 deletions docs/assets/pr/1173-archive-audio/qualification.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,87 @@
{
"source": "4072b9e6b8add5fa7cfab214b8a769c8220f1894",
"formalAvatar": "0.10.0",
"viewport": {
"width": 1559,
"height": 865,
"deviceScaleFactor": 1
},
"theme": "dark",
"locale": "zh-CN",
"method": "Actual DSH canonical Bot reply, native pin/sound UI and owning Host pause/resume; bounded observation of actual Web Audio calls during real Bot archive/resume, not audible playback or background qualification",
"canonicalReply": {
"characters": 2921,
"bodySha256": "ddf338096648fda6a71a2a4e9e872164d1f8cd848ea55b60484e67b34d621f7c",
"exactRequestedText": true
},
"playing": {
"archived": false,
"sync": "live",
"cards": 1,
"mouth": ["closed"],
"sourceStarts": 5,
"immediateStops": 0
},
"archived": {
"archived": true,
"sync": "live",
"cards": 0,
"mouth": ["saved"],
"sourceStarts": 11,
"immediateStops": 1
},
"archivedHeld": {
"archived": true,
"sync": "live",
"cards": 0,
"mouth": ["saved"],
"sourceStarts": 11,
"immediateStops": 1
},
"archivedObservedMilliseconds": 6165.0999999996275,
"archivedSamples": 120,
"resumed": {
"archived": false,
"sync": "live",
"cards": 0,
"mouth": ["saved"],
"sourceStarts": 11,
"immediateStops": 1
},
"resumedHeld": {
"archived": false,
"sync": "live",
"cards": 0,
"mouth": ["saved"],
"sourceStarts": 11,
"immediateStops": 1
},
"resumedObservedMilliseconds": 4231.300000000745,
"audioObservation": {
"events": 23,
"cap": 2500,
"outputModified": false,
"audiblePlaybackQualified": false
},
"sameDocument": true,
"cleanup": {
"botResumed": true,
"soundRestored": true,
"observerRemoved": true,
"browserClosed": true
},
"consoleErrors": 0,
"video": {
"seconds": 31.066,
"frames": 466,
"codec": "VP9",
"silent": true,
"containerRemuxOnly": true
},
"limits": [
"Actual foreground Host archive/resume, not genuine background, unsupported AudioContext or autoplay failure.",
"Native audio starts/stops are observed without modifying output; acoustic listening and complete retained-resource disposal are not inferred.",
"Screenshots are successive states of one fixed runtime, not a matched revision before/after pair.",
"No performance trace or heap snapshot was recorded during this flow."
]
}
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading