teapawt
Zain
@zainhas
Sep 10
deepseek eval'd their new v4.1 flash model in 8 different harness configs > model performs best in minimal harnesses -- mini-SWE & minimal deepseek harness > underperforms in both claude code and codex
42
28
15
721
61,941
Crio Songo
@shuizhuyu
Sep 10
这个结果也挺符合预期吧,测试 harness 越复杂,额外干扰项越多,反而会拉低模型本身的实际表现。
Translate post
Sep 10, 2026 · 2:00 PM UTC
163