Skip to content

Add: 6 markdown lectures chiffrees RL-15 GRPO (densite 1027 -> 1400, #13410) - #16488

Merged
myia-ai-01 merged 1 commit into
mainfrom
feature/13410-density-rl15
Sep 17, 2026
Merged

myia-ai-01 merged 1 commit into
mainfrom
feature/13410-density-rl15

Conversation

@jsboige

@jsboige jsboige commented Sep 17, 2026

Copy link
Copy Markdown
Owner

Grain: DEEP/notebook-python -- lane myia-po-2026:CoursIA -- prev: DEEP/notebook-python #16486

Livrable

Tranche densité #13410 : RL/rl_15_grpo_group_relative_policy (1027 → 1400), plancher 1200. Markdown-only : +48 lignes — 6 cellules md (lectures chiffrées des sorties), chacune avec id nbformat 4.5 (sha1 8 hex, 6 nouveaux ids uniques, vérifiés) ; 0 cellule code touchée, 0 output édité, 0 md supprimée. Branche dédiée feature/13410-density-rl15 depuis origin/main (fe8a398), créée avant l'édition. Famille RL, 2e grain RL de la lane (règle 6).

Les 6 cellules

  1. Device de CE run (§1) — la sortie Device: cuda lue comme un témoin (ce run a tourné GPU), pas une exigence : le md de setup garantit la reproductibilité CPU-only ;
  2. VRAM probe en nombres bruts (§1.1) — la ligne [nvidia-smi] citée verbatim (NVIDIA GeForce RTX 3070 Laptop GPU, 8192 MiB, 749 MiB, 7270 MiB, 610.88), params=9155, peak allocated: 17.68 MiB / peak reserved: 22.00 MiB / final allocated: 16.41 MiB, marge > 300x sous la borne 6144 MiB ;
  3. Espace du problème (§1.2) — obs_dim=4, n_actions=2 lu contre l'architecture 4-64-64-2 décrite en amont (§1.1) : 4 entrées, 2 logits, deux couches cachées de 64 ;
  4. Les six seeds ligne à ligne (§2) — PPO devant 6/6 ; écarts de 48.66 (seed=1) à 329.27 (seed=0) et 282.27 (seed=123) ; le fait tranchant : meilleur GRPO (227.43, seed=42) sous le pire PPO (236.93, seed=1) — les deux distributions ne se chevauchent pas ;
  5. Agrégats re-vérifiés (§2) — moyennes re-dérivées des 6 seeds (2169.26/6 = 361.54 pour PPO, 1024.13/6 = 170.69 pour GRPO), delta -190.86, Wilcoxon stat=0.0, p-value=0.0312 = le minimum n=6 exact que le REPAIR c.644 rendait atteignable, IC95% [-265.41, -117.11] exclut 0 ;
  6. Verdict lu contre les 3 conditions (§2) — VERDICT : PPO BEATS GRPO : conjonction complète (edge au-delà de 2σ, p < 0.05, IC excluant 0).

Défauts préexistants signalés (non corrigés, hors scope md-only)

Mes lectures citent les sorties committées verbatim ; deux divergences prose-vs-sortie du contenu existant sont signalées dans les cellules 2 et 6 et laissées à l'owner :

  • la prose du verdict VRAM cite un pic à 17.44 MiB alors que la sortie committée affiche 17.68 MiB (JSON interne : vram_peak_mib: 17.6845703125) ;
  • la motivation (§ Motivation) documente les sorties v3 (PPO 299.36 ± 55.26 vs GRPO 197.65 ± 104.99, edge −1.27σ, p=0.0938, INCONCLUSIVE, std_GRPO ≈ 2× std_PPO) alors que les sorties committées actuelles donnent 361.54/170.69, p=0.0312, PPO BEATS GRPO, et GRPO MOINS variable que PPO (47.78 contre 69.97).

Validation

  • pedagogy_density.py → RC=0, plancher 1200 respecté (1400).
  • detect_markdown_rendering.py --check → OK (rc=0).
  • Vérification structurelle scriptée : 13 cellules code byte-identiques (sources, outputs, execution_count), 0 md perdue (ordre conservé), 27 cellules au total, ids tous uniques, 0 accent dans les insertions (dominante du fichier mesurée : 153 accents / 13 352 chars = 1,15 %) — md-only strict, diff +48/−0.

Preflight

Par noms (rl_15, grpo, scoped au repo) : aucune PR open. Par chemins : sweep des chemins des PRs open #13410 → seul RL/ touché est rl_7 (PR #16486, cette lane) ; rl_15 intact partout. Vérifié au choix du grain ET au commit. Branche créée avant l'édition.

See #13410

🤖 Generated with Claude Code

…13410)

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Golden-Set Execution (H.7 P3)

✅ 8/8 notebooks passed (certified reproducible)

Notebook Status Time
2.1-Workflow-ML.ipynb ✅ SUCCESS 5.9s
2.2-Descente-de-gradient.ipynb ✅ SUCCESS 3.6s
2.3-Regression-lineaire-logistique.ipynb ✅ SUCCESS 4.1s
2.4-Arbres-Forets-Ensembles.ipynb ✅ SUCCESS 4.0s
Search-01-StateSpace.ipynb ✅ SUCCESS 3.5s
SL-1-LogicalLearning.ipynb ✅ SUCCESS 2.0s
rl_4_multi_armed_bandits.ipynb ✅ SUCCESS 15.2s
GameTheory-04c-NashExistence-Python.ipynb ✅ SUCCESS 5.6s

Pinned lockfile: scripts/notebook_tools/golden_set.lock.txt (H.7 P3, axe A #4208)

@github-actions

Copy link
Copy Markdown
Contributor

Notebook PR Validation: PASS

  • Notebooks checked: 1
  • Code cells validated: 13
  • Result: All passed

Checks: H.1 (no errors), H.3 (execution_count), C.1 (no banned patterns)
Non-Python kernels (.NET/Lean): C.1 + errors only (execution_count advisory)
QuantConnect notebooks: C.1 + errors only (require QC Cloud for execution)

@github-actions

Copy link
Copy Markdown
Contributor

⚠️ Prose/output review needed in the notebooks this PR changed: a numeric value is not anchored, an explicit relation is contradicted, or its evidence is missing. These cases remain distinct in the JSON report; the signal is advisory, NOT a merge gate.

Scope = notebooks CHANGED in this PR, not the whole corpus. Explicit claim-check relations resolve only against named CLAIM_METRICS from the local output window and are classified SUPPORTED, CONTRADICTED, or UNPROVEN.
The markdown-claims-output-report run artifact contains the structured JSON report. See python scripts/check_markdown_claims_output.py --help for re-running locally.
Detector rationale: c.290 / c.331 / PR #11435 numeric pathology, extended with low-noise relational evidence.

@github-actions

Copy link
Copy Markdown
Contributor

Notebook outputs-required (H.4 schema): PASS (every code cell carries an outputs: list)

@jsboige

jsboige commented Sep 17, 2026

Copy link
Copy Markdown
Owner Author

[ADJOINT PREFLIGHT]
schema: 1
lane: myia-po-2025:CoursIA-2
pr: 16488
head: bb1d852
complete: true
body: read -- ligne Grain verifiee: Grain: DEEP/notebook-python - lane myia-po-2026:CoursIA - prev: DEEP/notebook-python #16486
b0: rc=0 -- aucun nit non leve (organe check_unaddressed_nits, 2026-09-17T10:27:35Z)
review: aucune -- ta review + merge = seuls gestes manquants
verdict: READY -- review+merge, position oldest-first 4/12
checks: statusCheckRollup 0 failing / 0 in-progress (tous settles verts, mesure 2026-09-17T10:27:35Z)
rest: mergeable_state clean / mergeable true

@jsboige

jsboige commented Sep 17, 2026

Copy link
Copy Markdown
Owner Author

[ADJOINT PREFLIGHT]
schema: 1
lane: myia-po-2025:CoursIA-2
pr: 16488
head: bb1d852
complete: true
body: read
comments-reviewed: 5
reviews-reviewed: 0
threads-reviewed: 0
threads-unresolved: 0
surfaces-sha256: ad422605b329ea8d6575fbd339712a6f6278c67b978e0a78e92e9adc654e0e65
diff-files: 1
diff-additions: 48
diff-deletions: 0
checks: latest-wins-green
b0: clear
scope: pass (MyIA.AI.Notebooks/RL/rl_15_grpo_group_relative_policy.ipynb)
domain: pass (Grain DEEP|MED ligne 1 verifiee)
verdict: READY_REVIEW_MERGE
measured: 2026-09-17T10:42:13Z
[/ADJOINT PREFLIGHT]

@myia-ai-01 myia-ai-01 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[ai-01 exact-head] APPROVED

Head bb1d8521bf8835cb84fdde69a0ffe23b473bb538 lu intégralement : body, 6 commentaires, 0 review antérieure, 0 thread et diff complet. B.0 rc=0 ; checks latest-wins settles verts. Le diff est strictement markdown-only (+6 cellules), chaque lecture suit l'output concerné, les chiffres sont verbatim ou re-dérivés exactement, et les deux divergences historiques sont signalées honnêtement sans altérer outputs ni code. Scope, C.5 et D.4bis conformes.

@jsboige

jsboige commented Sep 17, 2026

Copy link
Copy Markdown
Owner Author

[ADJOINT PREFLIGHT]
schema: 1
lane: myia-po-2025:CoursIA-2
pr: 16488
head: bb1d852
complete: true
body: read
comments-reviewed: 6
reviews-reviewed: 1
threads-reviewed: 0
threads-unresolved: 0
surfaces-sha256: 6b5287643352ee1294809214aeb38e05274d2e65444a2b84544c66dcd7a7d00f
diff-files: 1
diff-additions: 48
diff-deletions: 0
checks: latest-wins-green
b0: clear
scope: pass
domain: pass
verdict: READY
[/ADJOINT PREFLIGHT]

@myia-ai-01
myia-ai-01 merged commit 758588b into main Sep 17, 2026
78 of 82 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants