Skip to content

enrich(notebook,#13410): density 639 -> 2274 c/code-cell (FallacyDetection survey) - #14108

Merged
myia-ai-01 merged 1 commit into
mainfrom
feature/c120-fallacy-landscape-density
Sep 2, 2026
Merged

myia-ai-01 merged 1 commit into
mainfrom
feature/c120-fallacy-landscape-density

Conversation

@jsboige

@jsboige jsboige commented Sep 1, 2026

Copy link
Copy Markdown
Owner

Grain: MED/notebook-python -- lane myia-po-2026:CoursIA -- prev: MED/notebook-python #14107 (cycle 119)

Summary

Enrichissement markdown-only de 02_fallacy_datasets_landscape.ipynb (survey Phase 1 / livrable 2 EPIC #10355) : 639 → 2274 c/code-cell (+255 %), plancher 1200 largement franchi, cible 1500 depassee.

Rotation R6 (variete obligatoire) : c119 = MED/notebook-python (Search/Part4-Metaheuristics MGS). Cycle c120 = MED/notebook-python sur GenAI/FallacyDetection -- NOUVELLE FAMILLE (GenAI + Fallacy detection Python), distincte de Search/Part4 c119, GameTheory/Lean c118, MIMO/Lean c117, Z3/SMT c116. Meme protocole (umbrella #13410) : code byte-identique, anchors sur sorties kernel in-place, zero re-execution.

Changement

Fichier Type Effet
MyIA.AI.Notebooks/GenAI/FallacyDetection/02_fallacy_datasets_landscape.ipynb markdown-only +8 cellules etendues + 4 nouvelles cellules d'interpretation inserees

Cellules etendues (8) : cells [1, 5, 7, 9, 11, 13, 15, 17, 21] - chacune ancree sur la sortie verbatim de la cellule code qui suit :

  • cell[1] Methodologie : 3 types d'endpoints (HF/GitHub/direct), sortie verbatim code[2] Date d'acces : 2026-08-30 / Session HTTP prete
  • cell[5] MAFALDA : taxonomie L2 fine (23 classes) vs Logic L1 (13 classes), sortie verbatim code[6] repo: chadihelwe/MAFALDA / size: 12.4 MB
  • cell[7] Exercice 1 (Argotario 2017) : contraste historique Habernal (manuel) vs Helwe 2023 (LLM-augmented)
  • cell[9] IBM debate_speeches : pas de labels fallacy, sortie verbatim code[10] downloads: 99
  • cell[11] IBM-Rank-30k : HTTP 401 sur 3 variantes, sortie verbatim code[12] ECHEC : aucune variante IBM accessible
  • cell[13] AraucariaDB : HTTP 404 sur zip, sortie verbatim code[14] arg.tech homepage: HTTP 200 / AraucariaDB.zip: HTTP 404
  • cell[15] Reddit CMV : transfer learning, sortie verbatim code[16] downloads=44 (niche)
  • cell[17] Corpus FR rhetorique : gap francais, sortie verbatim code[18] HF-sophisme HTTP 200 (0)
  • cell[21] Synthese : tableau agrege 7 datasets, sortie verbatim code[22] Datasets testes : 7 (critere >=5 : OK) / accessibles : 5

Nouvelles cellules (4) :

  • Apres code[6] : Lecture du repo MAFALDA -- pourquoi le repo de l'auteur en premier (canonicite), lecture taille 12.4 MB, GitHub API vs HF (rationale du choix d'endpoint).
  • Apres code[14] : Lecture de l'etat d'AraucariaDB -- 3 lectures possibles du HTTP 404 (migre/retire/auth), implication ENDPOINT_MORT, preservation numerique (CNRS/HAL).
  • Apres code[16] : Lecture du paysage ChangeMyView -- pourquoi 44 telechargements est faible, pipeline classique MAFALDA -> CMV (Habernal 2018).
  • Apres code[22] : Lecture du tableau de synthese -- agregation des 4 categories (cibles directes / sources adjacentes / echecs / gap FR), cardinal total ~7-13k exemples pour fine-tuning Phase 3.

Pourquoi ce notebook

Per mesure ground-truth direct disque :

  • 02_fallacy_datasets_landscape.ipynb 639 c/cell <- choisi : 12 code cells, kernel Python, sorties tres riches (HTTP codes, GitHub API responses, HuggingFace metadata, tableaux de synthese verbatim).
  • Famille GenAI/FallacyDetection : distincte de Search/Part4 c119 (MGS), GameTheory/Lean c118, MIMO/Lean c117, Z3/SMT c116.
  • Substantif : survey Phase 1 du EPIC EPIC: fallacy detection via Qwen3.5/3.6 FT + PT, gated by SAE analysis (Argumentum taxonomy + r/fallacy Jessynoo) #10355 (fallacy detection via Qwen 3.5/3.6 FT+PT gated by SAE), livrable 2 - paysage datasets.
  • Sorties verbatim tres pedagogiques : HTTP 200/401/404 codes, cardinalites documentees, licences (MIT/CC BY-SA), references bibliographiques precises (Jin 2022, Helwe 2023, Gretz 2019, Reed 2008, Habernal 2017).

EPIC implicite : la famille FallacyDetection etait sous-representee dans le pool #13410 (GenAI Python notebook, density faible). Ce compagnon comble ce trou et ouvre la voie pour les notebooks suivants (03-build, 04-train, 05-eval) de la serie.

Pool cross-lane autorisation respectee (Search/MGS c119 -> GenAI/Fallacy c120, rotation R6 effective).

Validations

  • validate_pr_notebooks.py origin/main : 1/1 PASS (12 code cells, byte-identique).
  • scan_cell_ordering.py : 1/1 clean (anchors corrects, interpretation cells apres chaque code output).
  • pedagogy_density.py : 2274 c/code-cell (>= 1200 floor largement, >= 1500 cible largement depassee).
  • Pre-commit hooks (gitleaks, dotnet-probes, papermill-paths, fix-hr-separator, markdown-rendering-guard, fix-source-newlines, H.3 un-executed, source-compilable) : all Passed sans auto-fix.
  • Code byte-identique : verifie sur les 12 cellules code (sources + outputs + execution_counts). Les insertions et extensions sont toutes en markdown.

Anti-regression D + Stop & Repair

  • Zero modification aux 12 cellules code du notebook FallacyDetection (sources / outputs / execution_counts byte-identique a origin/main).
  • Zero hand-edit d'output (Stop & Repair respecte).
  • Catalog COURSE_CATALOG.generated.{json,md} non touche (RÈGLE HARD 1 catalog-pr-hygiene).

Refs

Liens

…ction survey)

Markdown-only enrichment of `02_fallacy_datasets_landscape.ipynb`
(survey Phase 1 / livrable 2 EPIC #10355). 8 markdown cells extended + 4
new interpretation cells inserted after code outputs.

Code byte-identique: 12/12 cells (sources + outputs + execution_counts).
Density gain: +1635 c/code-cell (+255%), plancher 1200 largement franchi,
cible 1500 depassee.

Co-Authored-By: Claude Haiku 4.5 (1M context) <noreply@anthropic.com>
@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

G-VAR-2/3 GENRE signals (advisory, non bloquant, #10020).
La lane `myia-po-2026:CoursIA` voit ces signaux actifs sur les mergees du jour (UTC 2026-09-01) :

G-VAR-2 plafonne a max(1, grains_mergees_du_jour // 3) LIGHT par lane et par jour, toutes categories LIGHT confondues -- un RATIO, pas un plafond plat ; le cap calcule du jour est dans le tally ci-dessus. G-VAR-3 interdit deux genres LIGHT consecutifs. Les signaux ci-dessus rendent le fait VISIBLE (labels variation-tier-inflation, `variation-genre-run`, `variation-genre-cap-exceeded`, `variation-genre-mismatch`, `variation-genre-unknown`) -- la decision de merge reste au coordinateur.

@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

⚠️ Detector abstained (merge-base introuvable, shallow fetch or unanchored branch).

c.415 (#11873): scope = notebooks CHANGED in this PR, not the whole corpus.
See python scripts/check_markdown_claims_output.py --help for re-running locally.
Detector rationale: c.290 / c.331 / PR #11435 pathologie.

@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Golden-Set Execution (H.7 P3)

✅ 8/8 notebooks passed (certified reproducible)

Notebook Status Time
2.1-Workflow-ML.ipynb ✅ SUCCESS 5.9s
2.2-Descente-de-gradient.ipynb ✅ SUCCESS 4.1s
2.3-Regression-lineaire-logistique.ipynb ✅ SUCCESS 4.9s
2.4-Arbres-Forets-Ensembles.ipynb ✅ SUCCESS 4.6s
Search-1-StateSpace.ipynb ✅ SUCCESS 3.7s
SL-1-LogicalLearning.ipynb ✅ SUCCESS 2.6s
rl_4_multi_armed_bandits.ipynb ✅ SUCCESS 24.4s
GameTheory-04c-NashExistence-Python.ipynb ✅ SUCCESS 3.2s

Pinned lockfile: scripts/notebook_tools/golden_set.lock.txt (H.7 P3, axe A #4208)

@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Path-collision (organ #13359/#13615)

Cette PR #14108 (enrich(notebook,#13410): density 639 -> 2274 c/code-cell (FallacyDetection survey)) touche au moins un chemin de fichier aussi modifie par d'autres PRs ouvertes. Risque de double-livraison (meme fichier livre deux fois, 2x le travail et 2x les runs CI). Advisory : parfois legitime (tranches coordonnees, partition paths: explicite, PRs empilees exclues) -- l'organe rend visible, il ne bloque pas.

@github-actions github-actions Bot added the pr-overlap Advisory: another open PR touches the same files (organ #13615) label Sep 1, 2026
@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Notebook PR Validation: PASS

  • Notebooks checked: 1
  • Code cells validated: 12
  • Result: All passed

Checks: H.1 (no errors), H.3 (execution_count), C.1 (no banned patterns)
Non-Python kernels (.NET/Lean): C.1 + errors only (execution_count advisory)
QuantConnect notebooks: C.1 + errors only (require QC Cloud for execution)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-overlap Advisory: another open PR touches the same files (organ #13615)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants