Skip to content

docs: refresh the visual design figure with the updated opus-5 scores - #583

Merged
LivXue merged 1 commit into
mainfrom
docs/raven_design_opus5_scores
Sep 21, 2026
Merged

LivXue merged 1 commit into
mainfrom
docs/raven_design_opus5_scores

Conversation

@LivXue

@LivXue LivXue commented Sep 21, 2026

Copy link
Copy Markdown
Member

Summary

Refreshes the Raven-Design visual design figure in both READMEs with the resupplied
Opus-5 evaluation. Raven-Design and Claude Code moved on all three benchmarks in that
figure; the GPT5.6-Luna rows and the Hermes column carry over unchanged.

Benchmark (Opus-5) Raven-Design Claude Code Hermes
ArtifactsBench Dashboard 64.4 -> 66.3 63.6 -> 62.8 64.4 (unchanged)
ArtifactsBench SVG 83.5 -> 86.2 82.7 -> 83.4 83.0 (unchanged)
GDPVal 89.4 -> 91.9 88.7 -> 89.2 89.1 (unchanged)

Two consequences of the update are worth naming, because they change what the figure
shows rather than only the bar lengths. Raven-Design now leads Hermes on all three
benchmarks, where ArtifactsBench Dashboard was previously a tie at 64.4. And Claude Code
now leads Hermes on ArtifactsBench SVG and GDPVal while trailing it on ArtifactsBench
Dashboard, having previously trailed on all three.

The chart was re-rendered with the same renderer, the same palette and the same layout as
the figure it replaces, so only the six Opus-5 bars and their value labels differ. The
asset is hosted as a comment attachment on #477, per the repository rule that image files
are not committed. Both READMEs reference the same asset, so the diff is one URL swap per
file; the alt text, the anchor, the width and the caption are untouched.

Type

  • Fix
  • Feature
  • Docs
  • CI / tooling
  • Refactor
  • Other

Verification

Chart data, before rendering:

  • Built the eighteen expected plotted values by hand from the supplied numbers, then
    asserted the renderer's readout equal to them. Diffed against the previous value set:
    exactly six cells differ, all of them Opus-5 Raven-Design or Claude Code.
  • The renderer's own guards passed: 18 values verified; no overlapping labels, plus its
    assertions that no text escapes the 2000px canvas and that the output is 2000px wide on
    a white background.

Uploaded asset, after rendering:

  • curl -sL <asset-url> | sha256sum against the local render: identical, 141368 bytes,
    e175bc24e7d6208ab26d2aaaab213431585398c0de9705f058dfd4092023924f. Checked with GET,
    not HEAD, because user-attachments answers HEAD with 403.
  • POST /markdown on the changed line returns both href and src pointing at the new
    asset.

Repository state:

  • Asserted the retired asset id occurred exactly twice per README (anchor plus image)
    before replacing, and zero times after. git grep over the whole tracked tree finds no
    remaining reference to it.

  • git grep for the six retired score values across every markdown, text and YAML file:
    no hits, so no prose quoted the numbers the figure carries.

  • uv run --frozen --all-extras pytest tests/test_living_docs.py tests/test_docs_site.py:
    18 passed. tests/test_cli_onboard_commands.py -k readme: 1 passed. These are the tests
    that read the repository-root READMEs.

  • make check-large-files, make check-source-language,
    scripts/check_commit_messages.py origin/main..HEAD: all exit 0.

  • Relevant tests pass locally

  • Relevant lint / type checks pass locally

  • User-facing docs or screenshots are updated when needed

Risk

User-visible change is the Raven-Design visual design figure in the English and Chinese
READMEs. No code, no configuration and no dependency is touched, so there is no runtime
behaviour change and nothing to be backward incompatible with.

Rollback is a one-line revert per README: the retired asset
061b5818-595b-4392-b9b6-53a1effb8347 stays hosted on #477 and keeps serving, because
replacing a README reference does not delete the attachment it pointed at.

  • Security impact considered
  • Backward compatibility considered
  • Rollback path is clear for risky changes

Related Issues

#477

Re-rendered the Raven-Design visual design chart from the resupplied Opus-5
evaluation. Raven-Design and Claude Code moved on all three benchmarks; the
GPT5.6-Luna rows and the Hermes column are unchanged.

  ArtifactsBench Dashboard  Raven-Design 64.4 -> 66.3, Claude Code 63.6 -> 62.8
  ArtifactsBench SVG        Raven-Design 83.5 -> 86.2, Claude Code 82.7 -> 83.4
  GDPVal                    Raven-Design 89.4 -> 91.9, Claude Code 88.7 -> 89.2

The two READMEs reference the same asset, so this is one URL swap per file.
Layout, alt text, width and caption are unchanged.

Co-authored-by: Claude (claude-opus-5[1m]) <noreply@anthropic.com>
@LivXue
LivXue requested review from 0xKT, Handsome-wzw, ZuyiZhou, gloryfromca and userName20260323 and removed request for 0xKT September 21, 2026 05:21

@gloryfromca gloryfromca left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No blockers; this can merge as far as I am concerned.

Reviewed the current github/main...cff60544d4fb diff and surrounding README history. The effective change is limited to synchronized URL swaps in the English and Chinese READMEs; the apparent stylesheet delta disappeared after refreshing github/main.

I fetched both attachments and compared them visually. The replacement is a valid 2000x1300 PNG, preserves the layout and unchanged series, and reflects exactly the six stated Opus-5 score updates. Both README links use the same reachable asset.

Project rules and compatibility are satisfied: the externally hosted image avoids adding a prohibited repository asset, the Markdown language exemptions apply, no domain terminology or dependencies change, no tests are weakened, and there are no runtime callers, architecture effects, or backward-compatibility concerns.

Verification: uv run --frozen --all-extras pytest tests/test_living_docs.py tests/test_docs_site.py (18 passed); uv run --frozen --all-extras pytest tests/test_cli_onboard_commands.py -k readme (1 passed); scripts/check_large_files.py github/main...HEAD, scripts/check_source_language.py github/main...HEAD, scripts/check_commit_messages.py github/main..HEAD, and git diff --check github/main...HEAD all passed. The make wrapper is unavailable in this environment, so I invoked the Makefile underlying checks directly.

@LivXue
LivXue merged commit f9db625 into main Sep 21, 2026
21 checks passed
@LivXue
LivXue deleted the docs/raven_design_opus5_scores branch September 21, 2026 05:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants