feat(issue-120): improve session prompt dedupe and cache hits#379
Open
zzp1221 wants to merge 4 commits into
Open
feat(issue-120): improve session prompt dedupe and cache hits#379zzp1221 wants to merge 4 commits into
zzp1221 wants to merge 4 commits into
Conversation
34fea32 to
84a86ad
Compare
Collaborator
|
Thank you for your contribution and interest! We will schedule an internal review of your code and get back to you soon. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description | 描述
本 PR 针对 Issue #120,优化 memory 注入导致的 prompt cache 波动,并补充 session 级稳定系统提示去重研究与诊断能力。
主要改动:
appendSystemContext内重复的稳定块做 digest 去重。重复追加vs去重追加探针。Related Issue | 关联 Issue
Fix #120
Change Type | 修改类型
Self-test Checklist | 自测清单
Additional Notes | 其他说明
已完成验证:
npx.cmd vitest runnpm.cmd run build:pluginnode tmp/session-system-prompt-cache-probe.mjs真实 provider 探针结果:
去重追加相比重复追加,prompt tokens 下降 57.36%,cache miss tokens 下降 99.24%。去重追加相比重复追加,prompt tokens 下降 56.93%,cache miss tokens 下降 93.45%。说明:
本 PR 没有在插件侧做不安全的跨轮
appendSystemContext省略。真正的跨轮系统提示去重应在 OpenClaw host 侧实现,并且需要host 支持 session 持久系统提示语义。