chore(brand): refresh the snapshot — the markers were rendering a stale catalog - #232
Merged
Conversation
…le catalog brand-numbers.json here was a catalog generation behind, so every br: marker in this repo rendered a number that has not been true for some time. The markers did their job — they rendered the input they were given. Nothing refreshes that input: sync-brand-numbers.mjs reads the local snapshot and only re-fetches under --refresh, and --check is offline on purpose so PR CI stays deterministic. Its header defers freshness to a fan-out job that was never built, so every consumer validated markers against its own stale copy and reported green. Produced by --refresh, not by hand.
|
Caution Review failedThe pull request is closed. ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (3)
📝 WalkthroughWalkthroughThis PR updates model counts across the shared numeric source, README, package metadata, product documentation, repository guidance, and skill documentation. It also removes ChangesCatalog count updates
Estimated code review effort: 2 (Simple) | ~10 minutes Possibly related PRs
Suggested reviewers: 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
![coderabbitai[bot]](https://avatars.githubusercontent.com/in/347564?s=60&v=4){kind=small}
There was a problem hiding this comment.
Actionable comments posted: 1
🧹 Nitpick comments (1)
brand-numbers.json (1)
5-9: 📐 Maintainability & Code Quality | 🔵 Trivial | 🏗️ Heavy liftAdd an automated freshness guard for the generated snapshot.
brand-numbers.jsonis the shared count source. The PR states that--checkis offline and the fan-out job is not built. Add CI or fan-out validation that checks everybr:reference and hard-coded count claim against this file. This prevents future documentation drift.Also applies to: 14-15
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the rest with a brief reason, keep changes minimal, and validate. In `@brand-numbers.json` around lines 5 - 9, Update the CI or fan-out validation around brand-numbers.json to automatically verify every br: reference and hard-coded count claim against the generated snapshot, using the documented offline --check flow where applicable. Ensure the validation fails when documentation counts drift from the shared values in brand-numbers.json.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
Inline comments:
In `@README.md`:
- Line 394: Synchronize every count and free-model reference with
brand-numbers.json by updating the README.md summary and the listed docs/skills
sites together: keep README.md’s chatVisible/free summary at 71 and 6, replace
the seven FREE rows with the current six free models, change the stale 41+ AI
Models and FREE (9 free) text in docs/anthropic-cost-savings.md to current
values or mark it historical, update
docs/anthropic-third-party-harness-changes.md to 6 free models, update
docs/clawrouter-cuts-llm-api-costs-500x.md to 71, update
docs/clawrouter-vs-openrouter-llm-routing-comparison.md to 6, and regenerate the
six-name free-model list in skills/clawrouter/SKILL.md.
---
Nitpick comments:
In `@brand-numbers.json`:
- Around line 5-9: Update the CI or fan-out validation around brand-numbers.json
to automatically verify every br: reference and hard-coded count claim against
the generated snapshot, using the documented offline --check flow where
applicable. Ensure the validation fails when documentation counts drift from the
shared values in brand-numbers.json.
🪄 Autofix
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: Path: .coderabbit.yaml
Review profile: CHILL
Plan: Pro Plus
Run ID: 3d039eb2-dbce-4cfa-9664-78ce66fc49eb
📒 Files selected for processing (8)
CLAUDE.mdREADME.mdbrand-numbers.jsondocs/anthropic-cost-savings.mddocs/anthropic-third-party-harness-changes.mddocs/clawrouter-cuts-llm-api-costs-500x.mddocs/clawrouter-vs-openrouter-llm-routing-comparison.mdskills/clawrouter/SKILL.md
| ## Models & Pricing | ||
|
|
||
| <!-- br:models.chatVisible -->65<!-- /br:models.chatVisible --> models across 9 providers, one wallet. **<!-- br:models.free -->7<!-- /br:models.free --> models are $0 — paid models start at fractions of a cent.** | ||
| <!-- br:models.chatVisible -->71<!-- /br:models.chatVisible --> models across 9 providers, one wallet. **<!-- br:models.free -->6<!-- /br:models.free --> models are $0 — paid models start at fractions of a cent.** |
There was a problem hiding this comment.
🗄️ Data Integrity & Integration | 🟡 Minor | ⚡ Quick win
Synchronize all count claims from brand-numbers.json.
models.chatVisible is 71 and models.free is 6. The changed references are not fully propagated.
README.md#L394-L394: Keep the summary at 6 and replace the sevenFREErows at Lines 402-408 with the six current free models.docs/anthropic-cost-savings.md#L53-L53: Change41+ AI ModelsandFREE (9 free)to the current values, or label the diagram as historical.docs/anthropic-third-party-harness-changes.md#L34-L34: Change9 free modelsat Line 82 to 6.docs/clawrouter-cuts-llm-api-costs-500x.md#L138-L138: Change the stale66marker at Line 147 to 71.docs/clawrouter-vs-openrouter-llm-routing-comparison.md#L243-L243: Changeincluding 9 free modelsto 6.skills/clawrouter/SKILL.md#L144-L144: Regenerate the seven-name free-model list as six current names.
📍 Affects 6 files
README.md#L394-L394(this comment)docs/anthropic-cost-savings.md#L53-L53docs/anthropic-third-party-harness-changes.md#L34-L34docs/clawrouter-cuts-llm-api-costs-500x.md#L138-L138docs/clawrouter-vs-openrouter-llm-routing-comparison.md#L243-L243skills/clawrouter/SKILL.md#L144-L144
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In `@README.md` at line 394, Synchronize every count and free-model reference with
brand-numbers.json by updating the README.md summary and the listed docs/skills
sites together: keep README.md’s chatVisible/free summary at 71 and 6, replace
the seven FREE rows with the current six free models, change the stale 41+ AI
Models and FREE (9 free) text in docs/anthropic-cost-savings.md to current
values or mark it historical, update
docs/anthropic-third-party-harness-changes.md to 6 free models, update
docs/clawrouter-cuts-llm-api-costs-500x.md to 71, update
docs/clawrouter-vs-openrouter-llm-routing-comparison.md to 6, and regenerate the
six-name free-model list in skills/clawrouter/SKILL.md.
…free model The snapshot refresh moved brand-numbers.json to 71/92/6, and this repo's own brand-numbers.test.ts immediately failed — correctly. Four of the numbers it guards live in surfaces a br: marker cannot reach: a package.json description, a shields badge URL and its alt text, and a skill's YAML frontmatter, where a marker is not inert because it becomes part of the string. Those hold literals and are asserted by test instead, which is exactly what caught this. They were two generations stale, not one — 65 models and 7 free, against a real 71 and 6. The free count moved 7 -> 6 because nvidia/seed-oss-36b 410'd upstream on 2026-08-03. Changing the digit alone would have left the model named in four places as something a caller can still use, so it is removed from the SKILL.md enumeration, the README model table, the pricing prose, and the /model suggestion line. Verified against the live catalog: six free models, and seed-oss is not among them. src/router/brand-numbers.test.ts: 22 passed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
brand-numbers.jsonin this repo was a catalog generation behind, so everybr:marker here rendered a stale number.The markers worked correctly — they rendered the input they had. Nothing refreshes that input.
sync-brand-numbers.mjsreads the local snapshot and only re-fetches under--refresh;--checkis offline by design so PR CI stays deterministic. The script header defers freshness to a fan-out job that was never built, so all 15 consumers have been validating markers against their own stale copies and reporting green.Measured across the org on 2026-08-05: 14 of 15 consumers stale, most at 66/86/8, ClawRouter at 65/85/7. Truth is 71 chat / 92 total / 6 free. Only ClawRouter-Hermes was current.
Produced by
node scripts/sync-brand-numbers.mjs --refresh— no hand-edited digits.The mirror (BlockRunAI/awesome-blockrun#34) is refreshed first, since it is what every other repo falls back to. The fan-out job itself follows in BlockRunAI/blockrun.
Summary by CodeRabbit