Skip to content

Mixer Benchmarks#137

Open
farhadrgh wants to merge 21 commits into
mainfrom
farhadr/2d_bench
Open

Mixer Benchmarks#137
farhadrgh wants to merge 21 commits into
mainfrom
farhadr/2d_bench

Conversation

@farhadrgh

Copy link
Copy Markdown
Collaborator

Summary

Environment setup

Create the conda environment (required to run tests):

bash setup_conda_env.sh
conda activate nvsubquadratic

Test plan

  • pre-commit run --all-files passes (pre-commit install if not yet set up).
  • Existing tests pass (pytest tests/).
  • New tests added, or explain why not needed:

Documentation checklist

For every new or modified public symbol in nvsubquadratic/ or experiments/:

  • Every new module has a module-level docstring explaining what it contains and why.
  • Every new public class has a class docstring covering purpose, math/motivation, and key attributes.
  • Every new public method / function has Args: and Returns: blocks with tensor shapes where applicable.
  • Math notation is consistent with the paper (or a comment explains any deviation).
  • Docstrings containing backslashes use r"""...""" (required by ruff D301).
  • If a new file was added, a row has been added to docs-tracker.md with status [x].

See CONVENTIONS.md for the full style guide.

farhadrgh added 17 commits July 20, 2026 08:03
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
@farhadrgh
farhadrgh requested a review from saeepaliwal as a code owner July 23, 2026 21:46
farhadrgh and others added 4 commits July 23, 2026 14:46
JSONL data and time/memory plots for the GB200 forward-time sweeps:
- results_8_hidden_16M_tokens/: hidden 8 reach sweep (HyenaND / Attention /
  Mamba2 out to 16M tokens; attention is the non-flash head_dim-4 path).
- results_512_hidden/: hidden 512, head_dim 128 flash-kernel comparison
  (HyenaND vs SDPA / FlexAttention / FlashAttention-4 / Mamba2).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Signed-off-by: Farhad Ramezanghorbani <farhadr@nvidia.com>
Consolidate the two benchmark sets under benchmarks/results/ and document
them in one README (protocol, configs, headline numbers, reproduce steps):
- reach_hidden8/   (hidden 8, head_dim 4 — scaling reach to 16M tokens)
- flash_hidden512/ (hidden 512, head_dim 128 — SDPA/Flex/FA4/Mamba2 comparison)

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant