Francis YAO (@Francis_YAO_)· Yao Fu·· 22 天前AI 评分52
Yao Fu 转发分析:DeepSeek-V4 答案随装饰性 docstring 翻转,或与 chunked KV-cache 压缩有关
RT Xingyu Zhu: Same code, same question, but DeepSeek-V4's answer flips with every two tokens of decorative docstring prepended. Its NIAH accuracy als...
AI 导读
Yao Fu 转发 Xingyu Zhu 的观察:相同代码和问题下,DeepSeek-V4 的答案会随每前置 2 个 token 的装饰性 docstring 而翻转,NIAH 准确率还随 needle 位置在固定 4-token 周期内波动最多 40 个百分点。该推文串解释了 chunked KV-cache 压缩与此现象的关系。
来源:Francis YAO (@Francis_YAO_) · x.com