Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 8 additions & 2 deletions MyIA.AI.Notebooks/IIT/ICT-Series/ICT-37-FLens-BeliefState.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -633,7 +633,13 @@
"\n",
"## Migration future\n",
"\n",
"Quand le contrat de trace v1 (Epic #15475 instrument) sera livre, ce notebook pourra charger des activations reelles (NPZ) au lieu des activations simulees. La signature `simulate_residual(states, dim, layer, rng)` est compatible avec un futur `load_real_activations(npz_path, layer)`.\n"
"Quand le contrat de trace v1 (Epic #15475 instrument) sera livre, ce notebook pourra charger des activations reelles (NPZ) au lieu des activations simulees. La signature `simulate_residual(states, dim, layer, rng)` est compatible avec un futur `load_real_activations(npz_path, layer)`.\n",
"\n",
"## Références\n",
"\n",
"- **arXiv:2602.02385** — *Transformers Learn Factored Representations* : base directe de la réimplémentation numpy-only de ce notebook (régimes orthogonal / Mess3 / RRXOR, probes linéaires).\n",
"- **arXiv:2405.15943** — Shai et al., *Transformers Represent Belief State Geometry in their Residual Stream* : papier fondateur du théorème de géométrie belief-state linéairement représentée dans le residual stream, que la section Mess3 (belief ground-truth exact sur le 2-simplexe) vérifie empiriquement.\n",
"- **Dépôt ZM** — `Zeinab-Mohammadi/pytorch-AI-interpretability-transformer_ZM` : architecture minimale de référence (transformer from-scratch ~101K params, banc Mess3, probes belief R² > 0.989), explicitement dérivée d'arXiv:2602.02385 — point de comparaison pour la migration future vers des activations réelles (cf. Epic #15475).\n"
]
},
{
Expand Down Expand Up @@ -717,4 +723,4 @@
},
"nbformat": 4,
"nbformat_minor": 5
}
}
Loading