refactor(middleware): 移除数据脱敏中间件及相关代码
Some checks failed
CI / Lint & TypeCheck (push) Has been cancelled
CI / Unit Tests (push) Has been cancelled
CI / Build Frontend (push) Has been cancelled
CI / Rust Check (push) Has been cancelled
CI / Security Scan (push) Has been cancelled
CI / E2E Tests (push) Has been cancelled
Some checks failed
CI / Lint & TypeCheck (push) Has been cancelled
CI / Unit Tests (push) Has been cancelled
CI / Build Frontend (push) Has been cancelled
CI / Rust Check (push) Has been cancelled
CI / Security Scan (push) Has been cancelled
CI / E2E Tests (push) Has been cancelled
移除不再使用的数据脱敏功能,包括: 1. 删除data_masking模块 2. 清理loop_runner中的unmask逻辑 3. 移除前端saas-relay-client.ts中的mask/unmask实现 4. 更新中间件层数从15层降为14层 5. 同步更新相关文档(CLAUDE.md、TRUTH.md、wiki等) 此次变更简化了系统架构,移除了不再需要的敏感数据处理逻辑。所有相关测试证据和截图已归档。
This commit is contained in:
@@ -20,25 +20,24 @@ tags: [module, middleware, runtime]
|
||||
|
||||
## 代码逻辑
|
||||
|
||||
### 15 层 Runtime 中间件(注册顺序见 `kernel/mod.rs:248-361`,执行按 priority 升序)
|
||||
### 14 层 Runtime 中间件(注册顺序见 `kernel/mod.rs:248-361`,执行按 priority 升序)
|
||||
|
||||
| # | 中间件 | 优先级 | 文件 | 职责 | 注册条件 |
|
||||
|---|--------|--------|------|------|----------|
|
||||
| 1 | EvolutionMiddleware | 78 | `middleware/evolution.rs` | 推送进化候选项到 system prompt | 始终 |
|
||||
| 2 | ButlerRouter | 80 | `middleware/butler_router.rs` | 语义技能路由 + system prompt 增强 | 始终 |
|
||||
| 3 | DataMasking | 90 | `middleware/data_masking.rs` | 手机号/身份证等敏感数据脱敏 | 始终 |
|
||||
| 4 | Compaction | 100 | `middleware/compaction.rs` | 超阈值时压缩对话历史 | `compaction_threshold > 0` |
|
||||
| 5 | Memory | 150 | `middleware/memory.rs` | 对话后自动提取记忆 + 进化检查 | 始终 |
|
||||
| 6 | Title | 180 | `middleware/title.rs` | 自动生成会话标题 | 始终 |
|
||||
| 7 | SkillIndex | 200 | `middleware/skill_index.rs` | 注入技能索引到 system prompt | `!skill_index.is_empty()` |
|
||||
| 8 | DanglingTool | 300 | `middleware/dangling_tool.rs` | 修复缺失的工具调用结果 | 始终 |
|
||||
| 9 | ToolError | 350 | `middleware/tool_error.rs` | 格式化工具错误供 LLM 恢复 | 始终 |
|
||||
| 10 | ToolOutputGuard | 360 | `middleware/tool_output_guard.rs` | 工具输出安全检查 | 始终 |
|
||||
| 11 | Guardrail | 400 | `middleware/guardrail.rs` | shell_exec/file_write/web_fetch 安全规则 | 始终 |
|
||||
| 12 | LoopGuard | 500 | `middleware/loop_guard.rs` | 防止工具调用无限循环 | 始终 |
|
||||
| 13 | SubagentLimit | 550 | `middleware/subagent_limit.rs` | 限制并发子 agent | 始终 |
|
||||
| 14 | TrajectoryRecorder | 650 | `middleware/trajectory_recorder.rs` | 轨迹记录 + 压缩 | 始终 |
|
||||
| 15 | TokenCalibration | 700 | `middleware/token_calibration.rs` | Token 用量校准 | 始终 |
|
||||
| 3 | Compaction | 100 | `middleware/compaction.rs` | 超阈值时压缩对话历史 | `compaction_threshold > 0` |
|
||||
| 4 | Memory | 150 | `middleware/memory.rs` | 对话后自动提取记忆 + 进化检查 | 始终 |
|
||||
| 5 | Title | 180 | `middleware/title.rs` | 自动生成会话标题 | 始终 |
|
||||
| 6 | SkillIndex | 200 | `middleware/skill_index.rs` | 注入技能索引到 system prompt | `!skill_index.is_empty()` |
|
||||
| 7 | DanglingTool | 300 | `middleware/dangling_tool.rs` | 修复缺失的工具调用结果 | 始终 |
|
||||
| 8 | ToolError | 350 | `middleware/tool_error.rs` | 格式化工具错误供 LLM 恢复 | 始终 |
|
||||
| 9 | ToolOutputGuard | 360 | `middleware/tool_output_guard.rs` | 工具输出安全检查 | 始终 |
|
||||
| 10 | Guardrail | 400 | `middleware/guardrail.rs` | shell_exec/file_write/web_fetch 安全规则 | 始终 |
|
||||
| 11 | LoopGuard | 500 | `middleware/loop_guard.rs` | 防止工具调用无限循环 | 始终 |
|
||||
| 12 | SubagentLimit | 550 | `middleware/subagent_limit.rs` | 限制并发子 agent | 始终 |
|
||||
| 13 | TrajectoryRecorder | 650 | `middleware/trajectory_recorder.rs` | 轨迹记录 + 压缩 | 始终 |
|
||||
| 14 | TokenCalibration | 700 | `middleware/token_calibration.rs` | Token 用量校准 | 始终 |
|
||||
|
||||
> **注意**: 注册顺序(代码中的 chain.register 调用顺序)与执行顺序不同。Chain 按 priority 升序排列后执行。
|
||||
|
||||
@@ -62,7 +61,7 @@ tags: [module, middleware, runtime]
|
||||
| 范围 | 类别 | 包含的中间件 |
|
||||
|------|------|-------------|
|
||||
| 70-79 | 进化 | EvolutionMiddleware |
|
||||
| 80-99 | 路由+安全 | ButlerRouter, DataMasking |
|
||||
| 80-99 | 路由 | ButlerRouter |
|
||||
| 100-199 | 上下文塑造 | Compaction, Memory |
|
||||
| 200-399 | 能力 | SkillIndex, DanglingTool, ToolError, ToolOutputGuard |
|
||||
| 400-599 | 安全 | Guardrail, LoopGuard, SubagentLimit |
|
||||
@@ -102,7 +101,7 @@ trait AgentMiddleware: Send + Sync {
|
||||
|
||||
### 注册位置
|
||||
|
||||
`crates/zclaw-kernel/src/kernel/mod.rs:248-361` — `create_middleware_chain()` 方法,15 次 `chain.register()`(含 2 个条件注册: SkillIndex, Compaction)。注册顺序与执行顺序不同,chain 按 priority 升序排列后执行。
|
||||
`crates/zclaw-kernel/src/kernel/mod.rs:248-361` — `create_middleware_chain()` 方法,14 次 `chain.register()`(含 2 个条件注册: SkillIndex, Compaction)。注册顺序与执行顺序不同,chain 按 priority 升序排列后执行。
|
||||
|
||||
## 功能清单
|
||||
|
||||
@@ -110,7 +109,6 @@ trait AgentMiddleware: Send + Sync {
|
||||
|--------|--------|------|------|
|
||||
| @78 | EvolutionMiddleware | 进化引擎注入 | ✅ |
|
||||
| @80 | ButlerRouter | 管家语义路由 + XML fencing | ✅ |
|
||||
| @90 | DataMasking | PII 脱敏 | ✅ |
|
||||
| @100 | Compaction | 上下文压缩 (条件注册) | ✅ |
|
||||
| @150 | Memory | 记忆自动提取 + 注入 | ✅ |
|
||||
| @180 | Title | 对话标题生成 | ✅ |
|
||||
@@ -129,11 +127,10 @@ trait AgentMiddleware: Send + Sync {
|
||||
| 功能 | 测试文件 | 测试数 | 覆盖状态 |
|
||||
|------|---------|--------|---------|
|
||||
| 管家路由 | middleware/butler_router.rs | 12 | ✅ |
|
||||
| 数据脱敏 | middleware/data_masking.rs | 9 | ✅ |
|
||||
| 进化中间件 | middleware/evolution.rs | 4 | ✅ |
|
||||
| 轨迹记录 | middleware/trajectory_recorder.rs | 4 | ✅ |
|
||||
| 其余 11 层 | — | 0 | ⚠️ 无独立测试 |
|
||||
| **合计** | 4/15 文件有测试 | **29** | |
|
||||
| **合计** | 3/14 文件有测试 | **20** | |
|
||||
|
||||
## 关联模块
|
||||
|
||||
@@ -147,7 +144,7 @@ trait AgentMiddleware: Send + Sync {
|
||||
| 文件 | 职责 |
|
||||
|------|------|
|
||||
| `crates/zclaw-runtime/src/middleware.rs` | AgentMiddleware trait + MiddlewareChain |
|
||||
| `crates/zclaw-runtime/src/middleware/` | 15 个中间件实现 (15个 .rs 文件) |
|
||||
| `crates/zclaw-runtime/src/middleware/` | 14 个中间件实现 (14个 .rs 文件) |
|
||||
| `crates/zclaw-kernel/src/kernel/mod.rs:248-361` | 注册入口 |
|
||||
| `crates/zclaw-saas/src/main.rs` | SaaS HTTP 中间件注册 (10 层) |
|
||||
|
||||
@@ -156,4 +153,4 @@ trait AgentMiddleware: Send + Sync {
|
||||
- ✅ **TrajectoryRecorder 未注册** — V13-GAP-01 已修复 (在 @650 注册)
|
||||
- ✅ **Admin 端点 404 而非 403** — admin_guard_middleware 已修复
|
||||
- ⚠️ **SkillIndex 条件注册** — 无技能时不注册,长期观察
|
||||
- ⚠️ **11/15 中间件无独立测试** — 仅 butler_router/data_masking/evolution/trajectory_recorder 有测试
|
||||
- ⚠️ **11/14 中间件无独立测试** — 仅 butler_router/evolution/trajectory_recorder 有测试
|
||||
|
||||
Reference in New Issue
Block a user