Skip to content

Add MI355X hybrid GDN profiling and SGLang correlation - #31

Draft
powderluv wants to merge 1 commit into
NetX-lab:mainfrom
powderluv:codex/mi355x-rocm
Draft

Add MI355X hybrid GDN profiling and SGLang correlation#31
powderluv wants to merge 1 commit into
NetX-lab:mainfrom
powderluv:codex/mi355x-rocm

Conversation

@powderluv

@powderluv powderluv commented Sep 8, 2026

Copy link
Copy Markdown

Summary

  • Add ROCm MI355X device and Qwen3.8 hybrid GDN model contracts.
  • Add ROCm-aware profiling support for GDN, attention, dense, routed-MoE, and collectives.
  • Add strict SGLang capture, routing, graph-event, replay, and exact-cost validation tooling.
  • Document reproducible workflows while keeping generated traces, profiles, captures, and benchmark reports external.

Validation

  • 411 changed-file tests passed; 2 GPU-dependent tests skipped in the local suite.
  • Additional ROCm-host coverage passed for tests requiring PyTorch/ROCm.
  • Diff formatting, compilation, runtime identity, exact query coverage, rank coverage, and perturbation gates were checked.

Scope

The runtime-cost validation is limited to one-node TP-only non-speculative decode. It does not claim serving, expert-parallel, multi-node, or full-forward parity. No generated performance results are included in this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant