Skip to content

Expose native budget capacity admission - #377

Merged
senamakel merged 1 commit into
mainfrom
embed-budget-capacity
Oct 10, 2026
Merged

senamakel merged 1 commit into
mainfrom
embed-budget-capacity

Conversation

@senamakel

@senamakel senamakel commented Oct 10, 2026 •

Copy link
Copy Markdown
Member

Pin TinyInference to immutable 9b583f92336cebf0be57ed42976d0321095639ef from canonical tinyhumansai/tinyinference#75. This exposes opt-in native budget capacity admission for host policies: affordable calls stay concurrent, temporary reservation pressure waits, and permanently unaffordable calls remain refused. Default admission and internal transport retries remain fail-fast; canceled or unknown paid calls keep their conservative charges.

The native change includes thirteen deterministic regressions, including temporary waits not poisoning terminal refusal state. No module versions, release artifacts, policies or pricing bounds change here; this PR only updates the recursive gitlink.

Validation on local Rust stable 1.99: TinyAgents harness 2476 tests passed against this exact native commit; native LLM617 tests and alltargets/allfeatures Clippy passed. Refreshed TinyAgents harness alltargets Clippy with -D warnings also passed. Canonical hosted workspace CI remains required before merge.

Summary by CodeRabbit

  • Chores
    • Updated the bundled inference component to a newer revision. This update does not change the app’s visible features or public-facing behavior; no additional user-facing changes are included.

Co-authored-by: Medulla <medulla@tinyhumans.ai>
@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, add credits to your account and enable them for code reviews in your settings.

@tinysweeper

tinysweeper Bot commented Oct 10, 2026 •

Copy link
Copy Markdown

Tiny Sweeper review

Tiny Sweeper reviewed this change across 5 lane(s) and found 0 active actionable finding(s). Detailed lane evidence and any incomplete work are listed below.

State: Ready for maintainer review
Priority: none
Reviewed head: 342bf56f066c
Updated: 2026-10-10T23:24:24Z

Review snapshot

Change surface Files Review signal Count
Production 0 Active findings 0
Tests 0 Noted findings 0
Documentation 0 Resolved findings 0
Configuration 0 Pending checks/questions 0

Completeness: Complete
Test assessment: No supported feature-to-test mapping was available; this does not mean tests are absent or passed.

Features

None identified with supported citations.

Tests

No supported feature-to-test mapping was produced. Test execution is not inferred.

Findings

No active actionable findings.

Before merge

None.

Agent review details

critique

  • Conclusion: Neutral
  • Scope reviewed: all assigned evidence
  • Lane summary: No added or modified lines to review.

security

  • Conclusion: Neutral
  • Scope reviewed: all assigned evidence
  • Lane summary: No added or modified lines to review.

tests

  • Conclusion: Neutral
  • Scope reviewed: all assigned evidence
  • Lane summary: No added or modified lines to review.

commits

  • Conclusion: Neutral
  • Scope reviewed: all assigned evidence
  • Lane summary: Nothing sensitive found in what this pull request commits.

description

  • Conclusion: Neutral
  • Scope reviewed: all assigned evidence
  • Lane summary: No added or modified lines to review.
Evidence and run details
  • Models: None
  • Spend: $0.000000
  • Tokens: 0 input · 0 output · 0 cached · 0 embedding
Head State Pass summary
342bf56f066c ready for maintainer review 0 active finding(s), 0 resolved finding(s) (at 2026-10-10T23:23:39Z)
342bf56f066c ready for maintainer review 0 active finding(s), 0 resolved finding(s) (at 2026-10-10T23:24:24Z)

tinysweeper 0.1.0

@coderabbitai

coderabbitai Bot commented Oct 10, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration
  • Configuration used: Organization UI
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 416d6a0d-23e1-4cb9-ae9a-b6eda16aab0d


📥 Commits

Reviewing files that changed from the base of the PR and between e6be8cf and 342bf56.



📒 Files selected for processing (1)
  • vendor/tinyinference


Included review availability: This review used your included allowance. Your plan provides up to 2 included reviews per hour; 1 remain after this review.




📝 Walkthrough
📝 Walkthrough

Walkthrough

The vendor/tinyinference subproject reference changed from commit 9c39b819ca8a2c471eb585d399e3624cd4dda074 to 9b583f92336cebf0be57ed42976d0321095639ef.

Changes

Tinyinference Reference Update

Layer / File(s) Summary
Update vendor reference
vendor/tinyinference
The subproject reference now points to commit 9b583f92336cebf0be57ed42976d0321095639ef instead of 9c39b819ca8a2c471eb585d399e3624cd4dda074.

Priority: ➖ Normal

Estimated code review effort: 1 (Trivial) | ~2 minutes

Change: Feature

Suggested reviewers: m3ga-mind



Merge Risk: ⚪ Minimal · up to 342bf

No actionable merge-blocking risk is established for this pin; normal merge checks still apply.

Architecture Summary

Architecture risk: 🔵 Low · up to 342bf

The changed surface does not map to a changed system, dependency edge, entrypoint, or external dependency.

Changed systems: None identified.

Architecture concerns
No architecture-level concerns identified.

Review details

Before / after behavior

  • observed — Modified behavior in vendor/tinyinference: The vendor/tinyinference subproject commit reference was updated to 9b583f92336cebf0be57ed42976d0321095639ef from 9c39b819ca8a2c471eb585d399e3624cd4dda074.


Pre-merge checks | Passed 5
✅ Passed checks (5 passed)
Check name Status Explanation
Docstring Coverage Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Description Check Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check Passed The title clearly identifies the main change: exposing native budget capacity admission through the pinned TinyInference commit.

  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

A rabbit checks the vendor trail
One commit shifts along the way
Tinyinference hops ahead
No other paths have changed today
The rabbit nods, then bounds away

Comment @coderabbitai help to get the list of available commands.

@tinysweeper tinysweeper Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tinysweeper found nothing blocking. Approving.

$0.0000 · 2,174 in / 601 out · 0 cached (0%) · flash

@tinysweeper tinysweeper Bot added the priority: p3 Whenever. Cosmetic, a nicety, or a cleanup with no user visible effect. label Oct 10, 2026
@senamakel
senamakel merged commit 98883f2 into main Oct 10, 2026
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

priority: p3 Whenever. Cosmetic, a nicety, or a cleanup with no user visible effect.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant