Repository navigation
Conversation
Co-authored-by: Medulla <medulla@tinyhumans.ai>
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: a621c8ae14
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
Tiny Sweeper review
Last completed reportTiny Sweeper reviewTiny Sweeper completed its review; deterministic results follow. State: Changes requested Review snapshot
Completeness: Complete What changedA new additive `recovery` module is added to tinytools-jev, providing bounded host observations, typed independent questions, strict decision validation and a conservative adviser, plus README/spec/plan documentation and an integration contract test. No removals or modifications to existing behavior were reported. Features
Tests
Findings
Resolved this pass
Before merge
How this fits togetherflowchart LR
n0["rank_detailed"]:::impacted
n1["ToolRanker"]:::impacted
n2["shortlist"]:::impacted
n3["RankCandidate"]:::impacted
n4["build_request"]:::impacted
n5["decode"]:::impacted
n0 -->|calls| n2
n0 -->|uses| n3
n0 -->|calls| n4
n0 -->|calls| n5
n1 -->|uses| n3
n2 -->|uses| n3
n4 -->|uses| n3
n5 -->|uses| n3
classDef changed fill:#0d4429,stroke:#238636,color:#e6edf3
classDef impacted fill:#161b22,stroke:#6e7681,color:#c9d1d9
classDef flagged fill:#5a1e02,stroke:#d93f0b,color:#ffffff
classDef blocking fill:#67060c,stroke:#f85149,color:#ffffff
Agent review detailscritique
security
tests
commits
description
e2e
Evidence and run details
|
Co-authored-by: Medulla <medulla@tinyhumans.ai>
There was a problem hiding this comment.
Requesting changes: 2 lane(s) blocking, worst finding is high.
Fix or reply to the findings below and push. The next review clears this automatically once they are gone — you should not need to dismiss anything by hand.
$0.0293 · 415,345 in / 35,480 out · 52,525 cached (13%) · gpt-5.6-luna, glm-5.3-flash
critique: $0.0148 · 195,979 in / 18,574 out · 32,596 cached (17%) · gpt-5.6-luna, glm-5.3-flash
security: $0.0138 · 145,269 in / 12,413 out · 19,673 cached (14%) · gpt-5.6-luna
tests: $0.0002 · 24,105 in / 1,067 out · 64 cached (0%) · glm-5.3-flash
description: $0.0002 · 23,723 in / 1,300 out · 64 cached (0%) · glm-5.3-flash
Co-authored-by: Medulla <medulla@tinyhumans.ai>
Co-authored-by: Medulla <medulla@tinyhumans.ai>
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 6a0bb436f8
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
There was a problem hiding this comment.
The previously-blocking findings are resolved. Clearing the changes request.
$0.0194 · 286,431 in / 21,193 out · 32,146 cached (11%) · gpt-5.6-luna, glm-5.3-flash
critique: $0.0103 · 120,477 in / 10,016 out · 16,554 cached (14%) · gpt-5.6-luna, glm-5.3-flash
security: $0.0084 · 88,150 in / 7,699 out · 12,520 cached (14%) · gpt-5.6-luna
tests: $0.0002 · 25,539 in / 851 out · 1,536 cached (6%) · glm-5.3-flash
description: $0.0002 · 25,157 in / 676 out · 1,408 cached (6%) · glm-5.3-flash
Co-authored-by: Medulla <medulla@tinyhumans.ai>
|
You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard. |
There was a problem hiding this comment.
Requesting changes: 1 lane(s) blocking, worst finding is critical.
Fix or reply to the findings below and push. The next review clears this automatically once they are gone — you should not need to dismiss anything by hand.
$0.0369 · 504,425 in / 36,967 out · 56,764 cached (11%) · gpt-5.6-luna, glm-5.3-flash
critique: $0.0163 · 209,061 in / 17,512 out · 26,751 cached (13%) · gpt-5.6-luna, glm-5.3-flash
security: $0.0200 · 216,119 in / 16,487 out · 26,941 cached (12%) · gpt-5.6-luna
tests: $0.0002 · 25,964 in / 812 out · 1,536 cached (6%) · glm-5.3-flash
description: $0.0002 · 25,569 in / 592 out · 1,408 cached (6%) · glm-5.3-flash
There was a problem hiding this comment.
The previously-blocking findings are resolved. Clearing the changes request.
$0.0649 · 833,846 in / 64,613 out · 115,988 cached (14%) · gpt-5.6-luna, glm-5.3-flash
critique: $0.0387 · 465,540 in / 41,739 out · 75,425 cached (16%) · gpt-5.6-luna, glm-5.3-flash
security: $0.0255 · 288,863 in / 19,313 out · 37,491 cached (13%) · gpt-5.6-luna
tests: $0.0002 · 26,001 in / 1,231 out · 1,536 cached (6%) · glm-5.3-flash
description: $0.0002 · 25,606 in / 682 out · 1,408 cached (5%) · glm-5.3-flash
There was a problem hiding this comment.
Requesting changes: 1 lane(s) blocking, worst finding is critical.
Fix or reply to the findings below and push. The next review clears this automatically once they are gone — you should not need to dismiss anything by hand.
$0.0583 · 734,167 in / 66,102 out · 126,360 cached (17%) · gpt-5.6-luna, glm-5.3-flash
critique: $0.0333 · 394,793 in / 39,174 out · 78,557 cached (20%) · gpt-5.6-luna, glm-5.3-flash
security: $0.0244 · 259,718 in / 23,407 out · 44,283 cached (17%) · gpt-5.6-luna
tests: $0.0002 · 26,075 in / 1,124 out · 1,856 cached (7%) · glm-5.3-flash
description: $0.0002 · 25,680 in / 860 out · 1,536 cached (6%) · glm-5.3-flash
Co-authored-by: Medulla <medulla@tinyhumans.ai>
|
You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard. |
|
Closing this Jev-assisted tool-recovery implementation at the maintainer's request, together with tinyhumansai/openhuman#7341 and its implementation PRs: tinyhumansai/openhuman#7345, tinyhumansai/tinyagents#375, and #61. The investigation did not establish an incremental recovery or task-completion benefit from this adviser for the observed workload. The maintainer's recent local sessions used native structured tool calls. Observed failures primarily involved command execution, missing runtime state, unavailable services, and a declared JSON Schema anyOf requirement that local validation did not enforce. Recognized schema failures also take the existing deterministic recovery path before this adviser. These findings call for focused validation and state-handling changes rather than proceeding with this decision-model integration. This is a decision not to pursue this implementation; it does not claim that decision-assisted recovery can never be useful. The existing deterministic safeguards and independently merged compatibility fixes remain in place. |
Tool recovery needs a different decision contract from tool selection: whether an admitted next attempt can recover, which failure class the evidence supports, and whether a concrete correction or authorized alternate is useful. This adds that contract to
tinytools-jevwithout changing the existing tool-search evaluator.The new transport-neutral adviser builds bounded Choice/Noul/optional Score questions, validates complete typed answer batches, and abstains on trusted terminal facts, uncertain/applied writes, malformed answers, contradictions, low confidence and unavailable evaluators. Alternate questions require explicit wrong-tool advice or a calibrated repeated blocker and include
none. The API never executes tools, grants permission or modifies host accounting. Hosts supply scrubbed observations and candidates and retain transport, cancellation, the total deadline, policy and fallback.Part of tinyhumansai/openhuman#7341. This is the upstream library dependency; OpenHuman transport/configuration and host-driver wiring are separate. Existing argument normalization and unknown-tool suggestions are reused; broad coercion, automatic retries and rollout/default changes are outside this library change.
Validation: workspace format, clippy (
--all-targets --all-features -- -D warnings), build (--all-targets --all-features), tests (--all-features) and rustdoc (-D warnings) passed. Recovery production-file line coverage is 97.50–100% after validator hardening. The Jev suite passes 49 unit tests, one public contract integration test and one doctest. Regression tests confirmed duplicate-option, empty-batch and zero-recoverability-threshold failures before their fixes. Added fake-evaluator tests and a public contract test; the original 20 Jev ranking tests pass unchanged. The initial public recovery test failed with the absent API before implementation.