Skip to content

Commit 5954b5f

Browse files
Derive campaign client version from the loaded package
1 parent 7977dc2 commit 5954b5f

11 files changed

Lines changed: 727 additions & 16 deletions

‎BENCHMARKS.md‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -94,14 +94,14 @@ interpretation and do not count as additional benchmark-quality gains.
9494
### Public numeric evidence registry
9595

9696
Every exact public aggregate retained below comes from the checked-in, public-safe
97-
[`offline-fixtures-v116.json`](docs/benchmark-evidence/offline-fixtures-v116.json) artifact. Its
97+
[`offline-fixtures-v117.json`](docs/benchmark-evidence/offline-fixtures-v117.json) artifact. Its
9898
SHA-256 is
99-
`d3014054cf68d1be22005a9257dd39f520a0236180692b1d47cc3fb504269cff`, also recorded in the
99+
`c64eadffbc7f87938e0e822b7aab33dcfece6fffa5175932ac208465d36df192`, also recorded in the
100100
adjacent `.sha256` file. The artifact contains no raw questions, answers, prompts, customer data,
101101
or per-record content fingerprints.
102102

103103
The fixture-suite digest is
104-
`a0a17148da691957e7489de42158768eb0ee591197d9b0760729eda10b706f59`. The artifact defines
104+
`77b140068cd036330b421a0d7668847d196f1bbeaa36c965d68943457002e6eb`. The artifact defines
105105
the digest algorithm and records the SHA-256 of every suite and dataset file. Each evidence ID
106106
also binds its exact command through `sha256(UTF-8 exact command)`:
107107

@@ -123,10 +123,10 @@ Historical LoCoMo, graph, handoff, consolidation, and security figures remain pr
123123
source artifacts but are omitted from the current chart until each has a matching immutable,
124124
public-safe artifact. The chart labels coding outcomes, external datasets, and operational
125125
capacity as pending evaluation tracks rather than implying scores. Regenerate it with
126-
`python scripts/render_benchmark_report.py --report docs/benchmark-evidence/offline-fixtures-v116.json --output docs/images/context-efficiency.svg` after selecting the report to publish.
126+
`python scripts/render_benchmark_report.py --report docs/benchmark-evidence/offline-fixtures-v117.json --output docs/images/context-efficiency.svg` after selecting the report to publish.
127127

128128
The companion examples are also generated from that artifact with
129-
`python -m scripts.render_benchmark_examples --report docs/benchmark-evidence/offline-fixtures-v116.json --output docs/images/evidence-backed-agent-examples.svg`.
129+
`python -m scripts.render_benchmark_examples --report docs/benchmark-evidence/offline-fixtures-v117.json --output docs/images/evidence-backed-agent-examples.svg`.
130130
The historical-to-executable mapping is in
131131
[`docs/BENCHMARK_CHANGE_COVERAGE.md`](docs/BENCHMARK_CHANGE_COVERAGE.md).
132132

‎CHANGELOG.md‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,8 @@ All notable changes to Engraphis are documented here. Format loosely follows
4545
- Rebuild FastMCP settings eagerly to avoid a forward-reference warning on newer SDKs.
4646
- Preserve CSS gradient tiles, screen blending and reduced-motion opacity in graph PNGs,
4747
including fractional display scaling; synchronize graph cache metadata across threads.
48-
- Refreshed public offline fixtures and source bindings in immutable v116 evidence for 1.7.9.
48+
- Refreshed public offline fixtures and source bindings in immutable v117 evidence for 1.7.9.
49+
- Campaign adapter capabilities and metrics now report the loaded Engraphis runtime version.
4950

5051
- Added saved project-to-workspace routing and connection instructions so agents can use the
5152
user's selected workspace. Routine MCP calls inherit an omitted workspace from an authorized

‎README.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -84,9 +84,9 @@ neither is an end-to-end question-answer score. Coding outcomes, external datase
8484
operational capacity remain separate pending evaluation tracks until their artifacts are selected.
8585

8686
These values are evidence IDs `offline-chunking` and `offline-performance` in
87-
[`offline-fixtures-v116.json`](https://github.com/Coding-Dev-Tools/engraphis/blob/main/docs/benchmark-evidence/offline-fixtures-v116.json),
87+
[`offline-fixtures-v117.json`](https://github.com/Coding-Dev-Tools/engraphis/blob/main/docs/benchmark-evidence/offline-fixtures-v117.json),
8888
SHA-256
89-
`d3014054cf68d1be22005a9257dd39f520a0236180692b1d47cc3fb504269cff`.
89+
`c64eadffbc7f87938e0e822b7aab33dcfece6fffa5175932ac208465d36df192`.
9090
[`BENCHMARKS.md`](https://github.com/Coding-Dev-Tools/engraphis/blob/main/BENCHMARKS.md#public-numeric-evidence-registry)
9191
records the matching suite digest, exact commands, and per-command config digests. The offline
9292
fixture registry intentionally excludes external, model-dependent, consolidation, productivity,

‎docs/benchmark-evidence/offline-fixtures-v117.json‎

Lines changed: 694 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
c64eadffbc7f87938e0e822b7aab33dcfece6fffa5175932ac208465d36df192 offline-fixtures-v117.json

‎docs/images/context-efficiency.svg‎

Lines changed: 2 additions & 2 deletions
Loading

‎docs/images/evidence-backed-agent-examples.svg‎

Lines changed: 2 additions & 2 deletions
Loading

‎eval/campaign_adapters.py‎

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,8 @@
2323
from pathlib import Path
2424
from typing import Any, Callable, Iterable, Mapping, Optional, Protocol, Sequence
2525

26+
from engraphis import __version__ as engraphis_version
27+
2628

2729
PINS_PATH = Path(__file__).resolve().parent / "configs" / "competitor-pins.json"
2830

@@ -1275,7 +1277,7 @@ def metrics(self) -> dict[str, Any]:
12751277
class EngraphisAdapter(_BaseAdapter):
12761278
capabilities = AdapterCapabilities(
12771279
adapter="engraphis",
1278-
version="1.7.8",
1280+
version=engraphis_version,
12791281
source="https://github.com/Coding-Dev-Tools/engraphis",
12801282
source_revision=_UNKNOWN_SOURCE_REVISION,
12811283
scopes=("workspace", "repo", "session"),

‎tests/test_benchmark_evidence.py‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -33,8 +33,8 @@
3333

3434

3535
ROOT = Path(__file__).resolve().parents[1]
36-
PUBLIC_OFFLINE_ARTIFACT = "offline-fixtures-v116.json"
37-
PUBLIC_OFFLINE_SHA = "d3014054cf68d1be22005a9257dd39f520a0236180692b1d47cc3fb504269cff"
36+
PUBLIC_OFFLINE_ARTIFACT = "offline-fixtures-v117.json"
37+
PUBLIC_OFFLINE_SHA = "c64eadffbc7f87938e0e822b7aab33dcfece6fffa5175932ac208465d36df192"
3838

3939

4040
@pytest.fixture(scope="module")

‎tests/test_campaign_adapters.py‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -511,6 +511,19 @@ def test_peer_requires_budgeted_client_for_real_constructor():
511511
GraphitiAdapter(client_factory=lambda **_: object())
512512

513513

514+
def test_engraphis_capability_version_matches_loaded_runtime():
515+
from engraphis import __version__
516+
517+
adapter = EngraphisAdapter()
518+
try:
519+
assert adapter.capabilities.version == __version__
520+
prepared = adapter.prepare(workspace_id="version-check")
521+
assert prepared["capabilities"]["version"] == __version__
522+
assert adapter.metrics()["capabilities"]["version"] == __version__
523+
finally:
524+
adapter.close()
525+
526+
514527
def test_engraphis_source_revision_is_unknown_until_explicitly_bound():
515528
direct = EngraphisAdapter()
516529
try:

0 commit comments

Comments
 (0)