Repository navigation
Add ideas from GitHub issues labeled idea - 2026-10-27 - #81
Merged
Merged
Conversation
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This was referenced Oct 27, 2026
Contributor
There was a problem hiding this comment.
All reported issues were addressed across 7 files
Reply with feedback, questions, or to request a fix.
View guided diff | Turn on auto-fix | Re-trigger cubic
Yann-CV
commented
Oct 27, 2026
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com> Co-authored-by: Yann Chéné <yann.chene.tni@gmail.com>
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Migrates the 12 open GitHub issues labeled
ideainto the topicIDEAS.mdfiles.Per file
model_design/IDEAS.md: Explain mode decision by comparing embeddings with the training #42, Is it possible to detect failure mode by comparing model performance between clusters? #71, Can we make sample error analysis based on the closest embedding in the training set ? #72 (model failure analysis and explanation from embeddings/clusters, next to the existing "Make model failure analysis from embedded clustering…" and "analyse model failure from closest in training set" entries); find similar datasets from embedding similarity and reuse public studies to select best hyperparameters #63 (hyperparameter choice from similar datasets, next to "Is the best model+config for dataset A the same for dataset B…").data_selection/IDEAS.md: Data required to optimize the performance depends on the training status, would it be possible to know this per task in advance ? #75 (how much data a task needs depending on training status); use pretrained embeddings to select the best samples for test time in context injection #62 (selecting samples for test-time in-context injection).out_of_distribution/IDEAS.md: Is it possible to detect out of distribution samples by comparing predictions in the same semantic cluster? #70 (OOD detection by comparing predictions inside a semantic cluster).drift/IDEAS.md: Does clustering helpful to detect data drift from embedding distribution comparison #64 (clustering to detect drift from embedding distributions).losses/IDEAS.md: weight the loss contribution based on the embeddings of the full training set #60 (loss weighting from full-training-set embeddings).batching/IDEAS.md: assess the difference between batches to analyse/justify gradient variations #55 (batch differences to explain gradient variations).IDEAS.md(root): Is reidentification possible from simple embedding comparison ? #74, make data registration/alignement based on foundational features #58 — see below.Possible new topics
retrieval(similarity search / re-identification). Not data selection, drift, OOD or labeling (not about choosing, monitoring or annotating data); not model design (no architecture/config search).preprocessing(registration, alignment, normalization of raw data). Not augmentation (no synthetic variants), not data selection/labeling/drift/OOD; other topics are about training or monitoring.Duplicates
None.
In progress (covered by an open PR)
None.
🤖 Generated with Claude Code
Summary by cubic
Migrates 12 open GitHub issues labeled
ideainto the topic-specificIDEAS.mdfiles.model_design,data_selection,out_of_distribution,drift,losses,batching, and rootIDEAS.md.model_design, and adds two new topics (retrieval,preprocessing) to the root file for issues not covered by existing files.Written for commit d4c39f4. Summary will update on new commits.