Open
Conversation
|
easonysliu seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account. You have signed the CLA already but the status is still pending? Let us recheck it. |
3451832 to
be80284
Compare
Implement full recording & replay pipeline: - Recording engine: content script event capture (click/input/scroll/keypress) with semantic element descriptors, background multi-tab aggregation - Recording UI: real-time step display, recording list, detail view with parameter editing and natural language modification - Replay engine: recordings converted to compact LLM plans injected via systemInstruction, zero changes to PageAgentCore - i18n support (zh-CN/en-US), accessibility (ARIA), error handling - Edge cases: shadow DOM, contenteditable, file upload, SW restart recovery Bug fixes applied: message re-entry loop, stale closure in stopRecording, missing scripting permission, refreshTabIndexMap race condition, rapid start/stop guard, clipboard async, ParamEditor/RecordingDetail state reset, replay config-execute race condition.
be80284 to
6cfbfd8
Compare
1. @引用录制回放 - 输入框输入 @ 自动弹出已录制列表,支持模糊搜索 - 选择录制后可追加自然语言描述修改执行行为 - 例如: @搜索视频 这次搜索"人工智能" - 新增 useRecordingMention hook 和 MentionSuggestions 组件 2. 录制自动命名 - 停止录制后自动调用 LLM 生成名称和描述 - 后台异步执行,不阻塞 UI - RecordingDetail 页面轮询检测命名完成后自动刷新显示 - 用户可随时手动修改名称和描述 - 新增 autoNameRecording 模块 3. 录制/回放元素编号一致性 - 录制时创建独立 PageController,每3秒刷新DOM树 - 将 highlightIndex 缓存到元素 dataset 并写入 ElementDescriptor.idx - 回放时步骤描述包含 (index:N),LLM 优先用编号定位元素 - 编号匹配失败时自动回退到语义匹配(文本、aria-label 等) - 更新 replay_prompt 增加 index 优先匹配规则 Co-Authored-By: Claude (claude-opus-4-6) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
功能概述
为 Page Agent 扩展增加完整的 浏览器操作录制与智能回放 功能,并在本次更新中新增三项核心增强。
Closes #285
Closes #298
核心功能
基础录制回放(已有)
新增功能 1:@引用录制回放
新增功能 2:录制自动命名
新增功能 3:录制/回放元素编号一致性
元素定位策略
多信号语义描述符 + 编号辅助:
```
优先级:index(编号) > text > ariaLabel > role > placeholder > name > selector
```
紧凑 LLM 格式(~10 tokens/步):
```
[1] click "搜索" button (index:15) in header
[2] type "TypeScript教程" → search input (index:16) [PARAM:searchKeyword]
[3] press Enter → search input (index:16)
```
测试方法
基础录制回放
@引用录制回放(新增)
录制自动命名(新增)
元素编号一致性(新增)
边界场景
🤖 Generated with Claude Code