Repository navigation
Commit fbb088e
committed
fix(decide,llm): close review gaps in model detection and completion advice
Review of the #238 -> #243 stack found three accuracy gaps in behavior that
1.7.9 would ship for the first time:
- `claude-mythos-preview` (and any unversioned Fable/Mythos id) did not match
the model-trait pattern, so it still received `temperature` and got an
HTTP 400. Fable/Mythos ids now match with or without a numeric version.
- A remote `verify_completion` probability between the certainty bound (0.75)
and the 0.85 completion bar was reported as a decisive `is_complete=false`.
It is now `uncertain` with a null conclusion, matching the documented
"uncertain completion stays null" contract.
- The local completion heuristic missed Mocha/Jest-style `N passing`, treated
`errors: none` as a failure, and needed `not passing`/`0 passing` handling
once `passing` counts as success.
Every new test fails on the previous head. Rebind the public offline fixtures
to immutable v125 evidence; aggregates are unchanged from v124.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014ksPGXPZQTikJYpaGHa6R61 parent 1b1a0b3 commit fbb088e
15 files changed
Lines changed: 772 additions & 27 deletions
File tree
- docs
- benchmark-evidence
- images
- engraphis
- llm
- tests
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
94 | 94 | | |
95 | 95 | | |
96 | 96 | | |
97 | | - | |
| 97 | + | |
98 | 98 | | |
99 | | - | |
| 99 | + | |
100 | 100 | | |
101 | 101 | | |
102 | 102 | | |
103 | 103 | | |
104 | | - | |
| 104 | + | |
105 | 105 | | |
106 | 106 | | |
107 | 107 | | |
| |||
123 | 123 | | |
124 | 124 | | |
125 | 125 | | |
126 | | - | |
| 126 | + | |
127 | 127 | | |
128 | 128 | | |
129 | | - | |
| 129 | + | |
130 | 130 | | |
131 | 131 | | |
132 | 132 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
36 | | - | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
37 | 43 | | |
38 | 44 | | |
39 | 45 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
84 | 84 | | |
85 | 85 | | |
86 | 86 | | |
87 | | - | |
| 87 | + | |
88 | 88 | | |
89 | | - | |
| 89 | + | |
90 | 90 | | |
91 | 91 | | |
92 | 92 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
109 | 109 | | |
110 | 110 | | |
111 | 111 | | |
112 | | - | |
113 | | - | |
114 | | - | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
115 | 115 | | |
116 | 116 | | |
117 | 117 | | |
| |||
0 commit comments