Search results

test allreduce failures for diloco

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchftnumber 226

#226 In pytorch/torchft;

· tushar00jain opened on Jun 24, 2025

enable merging parameters for diloco

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Draft (not ready).

pytorch/torchftnumber 212

#212 In pytorch/torchft;

· tushar00jain opened on Jun 10, 2025

[WIP] Streaming DiLoCo prototype

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Draft (not ready).

pytorch/torchftnumber 203

#203 In pytorch/torchft;

· H-Huang opened on May 28, 2025

Add config sharing from Lighthouse with UI support (#130)

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Draft (not ready).

pytorch/torchftnumber 202

#202 In pytorch/torchft;

· WarrenZhu050413 opened on May 24, 2025

Added example training scripts for localsgd, DiLoCo, Live Checkpoint Recovery, and proactive failure detection with DDP (#198)

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchftnumber 200

#200 In pytorch/torchft;

· WarrenZhu050413 opened on May 22, 2025

ParallelProcessGroup: 200gbps with Gloo -- what if we just run like 20 of them in parallel???

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchftnumber 199

#199 In pytorch/torchft;

· d4l3k opened on May 21, 2025

Added proactive heartbeat timeout failure propagation (#164) (#188)

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchftnumber 196

#196 In pytorch/torchft;

· WarrenZhu050413 opened on May 20, 2025

Support multiple quorums on a single LighthouseServer using gRPC metadata-based room assignment

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchftnumber 189

#189 In pytorch/torchft;

· MattKotzbauer opened on May 5, 2025

wip hang

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Draft (not ready).

pytorch/torchftnumber 148

#148 In pytorch/torchft;

· H-Huang opened on Mar 25, 2025

fork ProcessGroupNCCL

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Draft (not ready).

pytorch/torchftnumber 134

#134 In pytorch/torchft;

· d4l3k opened on Mar 14, 2025

abort PG on error

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Draft (not ready).

pytorch/torchftnumber 133

#133 In pytorch/torchft;

· d4l3k opened on Mar 12, 2025

[WIP Fix pipe close warnings

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Draft (not ready).

pytorch/torchftnumber 129

#129 In pytorch/torchft;

· H-Huang opened on Mar 10, 2025