Search results

Qwen3 shows different output when compiled vs not compiled

module: torch.compile

Status: Open.

Bug

#2196 In pytorch/torchtitan;

· halflearned opened on Jan 5, 2026

Qwen3-VL-30B-A3B-Instruct + fsdp: RuntimeError: Expected all tensors to be on the same device, but got index is on cpu, different from other tensors on cuda

Status: Open.

#2195 In pytorch/torchtitan;

· li126com opened on Jan 3, 2026

RuntimeError: "Cannot redistribute to Partial" when increasing sequence length from 4k to 8k with MoE

Status: Open.

Bug

#2189 In pytorch/torchtitan;

· HzZHoO opened on Dec 31, 2025

[RFC] Introduce a Plugin-Mechanism for hardware-specific optimazations

Status: Open.

Feature

#2183 In pytorch/torchtitan;

· hahazhky opened on Dec 29, 2025

[ROCm] most integration tests for Native TorchTitan is missing

module: rocm

Status: Open.

#2159 In pytorch/torchtitan;

· functionstackx opened on Dec 16, 2025

[Question] composable activation checkpoint

questionFurther information is requestedFurther information is requested

Status: Open.

#2153 In pytorch/torchtitan;

· Irvingwangjr opened on Dec 15, 2025

Triton Cache Error for MI250

Status: Open.

Bug

#2146 In pytorch/torchtitan;

· zixianwang2022 opened on Dec 11, 2025

Validation breaking with FlashAttention

Status: Open.

Task

#2140 In pytorch/torchtitan;

· francesco-bertolotti opened on Dec 11, 2025

TorchComms backend (NCCLX and TorchComms NCCL) initializes but is ignored / not bound to PG in Torchtitan FSDP + DeviceMesh pipeline → large model hangs

Status: Open.

Bug

#2139 In pytorch/torchtitan;

· sk2693 opened on Dec 10, 2025

Missing model.safetensors.index.json in final hf checkpoint

Status: Open.

Task

#2137 In pytorch/torchtitan;

· legarwin opened on Dec 10, 2025

Duplicated AG/RS issued from Simple FSDP if there are multiple reference to the same parameters

module: torch.compile

Status: Open.

Bug

#2133 In pytorch/torchtitan;

· yanboliang opened on Dec 10, 2025

precommit run fails to install all dependencies on 3.14

Status: Open.

Bug

#2126 In pytorch/torchtitan;

· divyanshk opened on Dec 9, 2025