Skip to content

bench(linux): record thermally verified paired warm IPC v3 corpus - #53

Merged
amishabenramani merged 1 commit into
mainfrom
agent/kel-90-v3-paired-warm-evidence
Sep 19, 2026
Merged

amishabenramani merged 1 commit into
mainfrom
agent/kel-90-v3-paired-warm-evidence

Conversation

@amishabenramani

@amishabenramani amishabenramani commented Sep 19, 2026 •

Copy link
Copy Markdown
Member

Summary

  • record the thermally verified result-v3 paired warm-cache Linux IPC corpus
  • preserve the registered warm-cache treatment: one unscored priming process per arm/tier plus 1,000 untimed validated echoes in every scored process
  • retain exact 20-round balanced paired scheduling
  • promote 80 scored compact raw sidecars, two v3 tier documents, one manifest, and a bounded measurement note
  • follow existing convention by retaining priming hashes/counts in the manifest without promoting unscored priming vectors

Provenance

Benchmark recipe: ed134e360506cf1c5a9abdc817e9e31ff42af53b
Keld: 0ea0780bb574ad242e9f1105fa4af5842872bad3
Evidence commit: 882079970cb85accdf16297df493ff8dc6d6d507

Campaign

  • cache state: warm-cache
  • one unscored priming process per arm/tier
  • 1,000 validated untimed post-handshake echoes per scored process
  • 20 matched scored rounds/tier
  • 100,000 scored calls/arm/round
  • 2,000,000 scored observations/arm/tier
  • exact 10/10 arm-first balance per tier
  • 80/80 scored raw sidecars hash/size verified
  • zero raw newline expansion

Thermal boundary:

  • state: nominal
  • CPU package: 71C -> 78C; hardware critical 100C
  • CPU thermal-throttle counter advances: 0
  • NVIDIA: 47C -> 47C
  • SW/HW thermal slowdown: inactive

p99 results

Small, 6 B:

  • Rust floor 11.065 us, CI95 [10.601, 11.572]
  • Bun product-client 26.504 us, CI95 [25.999, 27.020]
  • paired Bun/Rust ratio 2.395x, CI95 [2.290, 2.503]
  • paired delta 15.439 us, CI95 [14.777, 16.093]

Representative, 1,024 B:

  • Rust floor 12.873 us, CI95 [12.433, 13.144]
  • Bun product-client 33.369 us, CI95 [32.760, 33.870]
  • paired Bun/Rust ratio 2.592x, CI95 [2.524, 2.692]
  • paired delta 20.496 us, CI95 [19.862, 21.167]

Claim boundary

The v3 documents remain diagnostic-only for:
PRODUCT_CLIENT_VS_LIBRARY_FLOOR_DIAGNOSTIC.

The Bun arm is the shipping TypeScript product-client slice; the Rust arm is the direct library floor. This is not pure Bun runtime overhead and not end-to-end application latency.

Fresh and warm are separate campaigns. Their central values must not be subtracted into a causal cache-state speedup/regression claim.

Bloat/integrity

  • scored raw files: 80
  • scored raw bytes: 44,174,382
  • scored raw Git diff lines: 0
  • each v3 summary: ~26 KB / 701 lines
  • all promoted raw sidecars re-hashed/size-validated
  • unscored priming vectors remain outside Git; their hashes/counts are retained in the manifest per existing warm-cache convention

Validation

  • both v3 documents validate against promoted sidecars
  • exact 10/10 first-arm balance verified
  • schema checks: pass
  • v3 validator negative controls: pass
  • planner: 21/21
  • git diff --check: pass

Linear: KEL-90.

Summary by CodeRabbit

  • Benchmark Results
    • Added warm-cache IPC round-trip benchmark results for Bun and Rust across small and representative payload sizes.
    • Included latency percentiles, confidence intervals, thermal conditions, warmup metadata, and provenance details.
    • Added paired campaign manifests covering 20 rounds and 8 million total observations.
    • Results remain diagnostic-only and are not eligible for publication as end-to-end application latency comparisons.

@coderabbitai

coderabbitai Bot commented Sep 19, 2026 •

Copy link
Copy Markdown

Review Change StackReview Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Advanced

Run ID: a553d19c-b1a1-4a41-a6b4-befeaf732de2

📥 Commits

Reviewing files that changed from the base of the PR and between ed134e3 and 8820799.

📒 Files selected for processing (84)
  • MEASUREMENTS.md
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-bun-rust-paired-representative.warm-cache.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-bun-rust-paired-small.warm-cache.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-bun-rust-paired.warm-cache.manifest.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r01.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r02.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r03.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r04.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r05.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r06.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r07.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r08.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r09.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r10.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r11.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r12.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r13.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r14.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r15.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r16.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r17.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r18.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r19.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-representative.warm-cache.r20.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r01.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r02.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r03.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r04.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r05.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r06.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r07.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r08.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r09.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r10.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r11.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r12.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r13.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r14.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r15.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r16.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r17.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r18.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r19.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-bun-100k-small.warm-cache.r20.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r01.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r02.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r03.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r04.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r05.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r06.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r07.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r08.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r09.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r10.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r11.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r12.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r13.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r14.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r15.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r16.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r17.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r18.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r19.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-representative.warm-cache.r20.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r01.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r02.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r03.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r04.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r05.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r06.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r07.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r08.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r09.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r10.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r11.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r12.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r13.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r14.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r15.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r16.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r17.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r18.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r19.raw.json
  • linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-paired-rust-100k-small.warm-cache.r20.raw.json

Included review availability: Your plan provides up to 1 included review per hour; 0 remain after this review.


📝 Walkthrough

Walkthrough

The pull request adds warm-cache paired Bun/Rust IPC-RTT benchmark results for 6-byte and 1 KiB payloads. It records 20 paired rounds, warmup metadata, bootstrap statistics, raw artifact bindings, thermal conditions, and diagnostic-only publication status.

Changes

Warm-cache IPC benchmark

Layer / File(s) Summary
Campaign protocol and manifest
linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-bun-rust-paired.warm-cache.manifest.raw.json
The manifest records warmup and scoring counts, alternating paired rounds, negative controls, environment and provenance data, 80 raw files, bootstrap configuration, tier statistics, and publication ineligibility.
Benchmark result documents
linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-bun-rust-paired-small.warm-cache.json, linux/bench/results/ipc-rtt/2026-09-19.kel90-linux-bun-rust-paired-representative.warm-cache.json
The result documents add Rust and Bun artifacts, per-arm latency statistics, confidence intervals, paired deltas and ratios, session metadata, and diagnostic comparison notes for both payload tiers.
Measurement record
MEASUREMENTS.md
The measurements document records the warm-cache protocol, nominal thermal verification, result-v3 bindings, diagnostic-only scope, and separation from the fresh-process campaign.

Priority: ⬇️ Low

Estimated code review effort: 3 (Moderate) | ~25 minutes

Change: Other

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and concisely describes the main change: recording a thermally verified paired warm-cache Linux IPC v3 benchmark corpus.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@amishabenramani
amishabenramani merged commit 3e033fe into main Sep 19, 2026
9 checks passed
@amishabenramani
amishabenramani deleted the agent/kel-90-v3-paired-warm-evidence branch September 19, 2026 15:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant