Search results

[BUG] LinearFunctionForZeroStage3 crashes with torch.func transforms (missing setup_context)

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7913 In deepspeedai/DeepSpeed;

· roycho96 opened on Mar 19, 2026

[REQUEST] Put NVTX instrumentation in its own domain (and potentially categories)

enhancementNew feature or requestNew feature or request

Status: Open.

#7912 In deepspeedai/DeepSpeed;

· clasqui opened on Mar 18, 2026

Trouble running tests: Failed to find precompiled modules

Status: Open.

#7909 In deepspeedai/DeepSpeed;

· Flamefire opened on Mar 17, 2026

[BUG] SuperOffload Fails when having more than one optimizer group

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7905 In deepspeedai/DeepSpeed;

· Mahmoud363 opened on Mar 14, 2026

Deepspeed zero 3 seems to save empty adapter_model.safetensors

Status: Open.

#7900 In deepspeedai/DeepSpeed;

· savitha-suresh opened on Mar 13, 2026

[RFC] SDMA-Based Collective Communication Backend for ZeRO-3 on AMD GPUs

Status: Open.

#7884 In deepspeedai/DeepSpeed;

· inkcherry opened on Mar 4, 2026

Let PyTorch set -gencode flags

Status: Open.

#7871 In deepspeedai/DeepSpeed;

· Flamefire opened on Feb 24, 2026

(Draft) [Roadmap] DeepSpeed Roadmap Q2 2026

Status: Open.

#7861 In deepspeedai/DeepSpeed;

· tohtana opened on Feb 19, 2026

[Bug] Missing input validation for fp16 loss_scale accepts float('inf')

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7852 In deepspeedai/DeepSpeed;

· amadhan882 opened on Feb 13, 2026

[BUG] DeepSpeed ZeRO-3 deadlock in engine.step() at step 0 under 2-GPU execution (RTX 3090, torch 2.2.1, DS 0.14.2)

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7844 In deepspeedai/DeepSpeed;

· griffinstalha opened on Feb 11, 2026

[BUG] DistributedAttention produces numerically incorrect results vs its own SeqAllToAll-equivalent baseline when sequence length is not divisible by world size

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7842 In deepspeedai/DeepSpeed;

· griffinstalha opened on Feb 10, 2026

[BUG] Multiple missing zero-guards cause ZeroDivisionError / non-finite values across DeepSpeed (4 locations)

Status: Open.

#7838 In deepspeedai/DeepSpeed;

· thehalleyyoung opened on Feb 9, 2026