You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit f3295bb
Browse filesBrowse the repository at this point in the historyBrowse files
This override selects a ref in `gpu-mode/reference-kernels`; it does not upload
186
-
a local working tree or select an arbitrary fork. Brev uses its own deployed
187
-
checkout, so the Modal override does not update that service.
179
+
The CLI saves the leaderboard, GPU, selected shapes, capture options, and a
180
+
SHA-256 digest of the evaluation configuration in `manifest.json`. This digest
181
+
identifies evaluated content, not a repository commit. Record the synced
182
+
reference-kernels commit separately in the problem PR or operator validation
183
+
record. Brev has its own deployed checkout and must be refreshed separately.
188
184
189
185
In the problem PR, record the resolved problem directory, reference-kernels
190
186
commit, GPU, benchmark indices tested, kernel filter/launch limit, and observed
191
-
artifacts. For example, the existing Modal integration was verified against
187
+
artifacts. For example, the NCU GPU integration was verified against
192
188
`problems/linalg/qr_v2`, benchmark 0, on B200 at reference-kernels
193
189
`51e22db671d36c1c76091c43c36a44546ba324a1`. That is evidence for that run, not a
194
190
claim that every problem in this repository already supports NCU.
@@ -201,5 +197,5 @@ claim that every problem in this repository already supports NCU.
201
197
| No kernels captured | Check the exact NVTX push/pop range name, matching kernel filter, and child-process capture. |
202
198
| Only setup kernels appear | Move generation, cloning, and reference work outside the range; select the intended kernel or expand the launch limit. |
203
199
| Profiling initialization fails | Ensure the NCU path does not also start PyTorch's profiler; inspect the NCU version and driver/runtime errors. |
204
-
| Wrong shape or missing recent evaluator changes | Inspect `manifest.json` and the remote source ref; local edits are not automatically uploaded. |
200
+
| Wrong shape or missing recent evaluator changes | Inspect `manifest.json` and the operator's synced source revision; local edits are not automatically uploaded. |
205
201
| Timeout | Start with one shape and a bounded kernel capture; NCU replay can be much slower than a normal benchmark. |
0 commit comments