Skip to content

feat(cu/ch): 集成 Windows 原生 History 与跨平台任务录制 - #690

Open
Jovianix wants to merge 35 commits into
MemTensor:1.2.7from
Jovianix:feature/windows-history-native-core
Open

Jovianix wants to merge 35 commits into
MemTensor:1.2.7from
Jovianix:feature/windows-history-native-core

Conversation

@Jovianix

Copy link
Copy Markdown

改动内容

将 CU / CH 功能分支集成到 1.2.7,包含 Windows 原生 Computer History、跨平台任务录制,以及合并后发现的问题修复。

  • 接入 Windows 原生 UIA 采集,复用共享 History 服务、设置和摘要流程;补齐应用名称、采集范围、文档内容适配、采集健康状态及敏感字段处理。
  • 支持人工演示和 Agent 执行过程的任务录制、暂停/恢复、停止、视频回放、事件时间线及 OpenAdapt Flow 离线导出。
  • 修复 Windows 静态画面、macOS 长时间静止画面的录像问题,以及应用退出时录制和事件流的收尾;完善原生助手打包和 CI 验证。
  • 修复旧版 History 持久化证据未迁移导致原始数据保留检查反复失败的问题。迁移时保留已有摘要,并将暂缓清理状态与摘要生成失败分开显示。
  • 同步分支内已有的 GPT-6 / Responses 兼容性修复和 CU 执行事件名称修正。

分支与验证

  • 来源:Jovianix:feature/windows-history-native-core,提交 047b3fe501bc2b6f009cf631c050a66ab7a620b6。
  • 已合入团队最新 main(8cd095c7f67300b6582a912bdd7fd33163d5e5b4);当前 main 与 1.2.7 指向同一提交。
  • macOS、Windows 均已完成打包和人工自测,由开发者确认完成。
  • macOS 安装包已完成 Developer ID 签名、Apple 公证、票据装订及 Gatekeeper 验证。
  • 本地 History 回归:1,238 通过、0 失败、10 跳过。另对 41 份旧版原始记录的隔离副本完成迁移验证:全部可通过保留检查,已有摘要及原始记录保持不变。

以下 CI 均针对上述来源提交运行并通过:

检查 结果
macOS History 验证 通过;产品测试 1,241 通过、0 失败、7 跳过,包含原生录制验证及 arm64 / x64 助手构建
Windows History 验证 通过;产品测试 1,232 通过、0 失败、20 跳过
OpenAdapt 导出兼容性 通过

交付范围

  • 本 PR 的 OpenAdapt 集成为离线导出,不包含桌面端自动回放或技能生成。
  • 当前源代码及自测安装包版本号仍为 1.2.3;本 PR 合入 1.2.7 分支,正式版本号调整与发布按团队发布流程执行。
  • 对应迭代:1.2.7 CU & CH。

Jovianix and others added 30 commits October 2, 2026 17:59
Add the C++20 collector, isolated UIA worker, explicit policies, native protocol, input metadata, controlled fixtures and reproducible MSVC build entry. Release and Debug builds pass unit, Win32 boundary and CLI contract checks; foreground acceptance and package delivery remain separate.
…eline

Connect explicit application consent and the native adapter to the shared recording, summary and retrieval service and Windows UI. Preserve Mac import paths and recording formats, fix platform-aware summary metadata and model-sync coverage, and add a reproducible validation entry with a Mac handoff. Validation: 508 tests passed with 8 explicit skips; types, scoped lint, Agent compile and frontend build passed. Mac desktop regression remains required.
Close active SSE responses before Fastify waits for connections and reject event streams whose authentication finishes during shutdown.

Add real HTTP shutdown regression tests and document macOS automated, native, packaged, and installed-App validation results and remaining acceptance cases.
Integrate MemTensor v1.2.3 at dce29c5, including main at f6694d9,
with the Windows History and task-recording work at 92816b3.

Port upstream History summaries, recorder health, Memory synchronization,
source settings and WeChat support into the shared core. Retain the Windows
native driver, Word/VS Code evidence provenance and task recording/export.
Apply shared application exclusions and WeChat consent to native Windows
records, and preserve document context qualifiers through raw retention.

Use upstream Computer Use and permission restart behavior while retaining
recording cleanup, quit ownership and both Windows native validation jobs.

Validation: workspace and standalone agent builds; agent, frontend and
shell typechecks; version consistency; 2712 related regression tests passed
and 201 platform-dependent tests skipped. Windows/macOS native capture and
signed installer acceptance still require the respective operating systems.
Read foreground content by provider capabilities with bounded Raw View and
MSAA fallbacks, and enrich Chrome and Edge records with verified page URLs.

Unify Windows observation settings and management tools, preserve explicit
legacy scopes and sensitive-input filtering, and report content provenance
and capture quality through the shared recording and summary pipeline.
Separate Windows MJS packaging from TypeScript contract tests, validate
feature branch pushes, and pass absolute report paths in the macOS job.

Repair stale defaults and native report fixtures, isolate synthetic Mac
file metadata from the Windows host, and use Git Bash, PowerShell and
junction fixtures appropriate to the host. Preserve explicit skips when
file-symlink permissions or native platform support are unavailable.

Use POSIX Mac interpreter paths and emit BOM-free native report JSON.
Record the fixed integration baseline, the Windows capture and validation
results, remaining Electron limitations, and the move to the personal
feature branch without updating the shared integration branch.
Carry v1.2.3 fixes into the shared History core while retaining platform
adapters, task recording, quit cleanup, and Windows packaging checks.
Preserve both browser capture and path-based Windows exclusion rules.

Validation on macOS: Agent/frontend types and builds, History 885 passed
with 5 platform skips, CU/Agent 882 passed, frontend 159 passed, desktop
lifecycle/package 194 passed, and contract/package checks 46 passed with
5 platform skips. Both summary CLI paths and version checks passed.

The macOS native recording media self-test still reports
part_finalize_failed; reproduced from unchanged pre-merge 646d7b4 source.
Windows native/installed-app acceptance remains separate.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants