Search results

More options of input/output types in coord_check

Status: Open.

#80 In microsoft/mup;

· francois-rozet opened on Oct 18, 2024

MuP for RNNs

Status: Open.

#77 In microsoft/mup;

· norikazu99 opened on Jul 26, 2024

Not getting perf improvements from muP at ~1.5B scale

Status: Open.

#76 In microsoft/mup;

· gordicaleksa opened on Jul 19, 2024

MuP for Mamba

Status: Open.

#74 In microsoft/mup;

· norikazu99 opened on May 30, 2024

Increasing coord check for the network output

Status: Open.

#71 In microsoft/mup;

· AkshitaB opened on Apr 11, 2024

mu parametrization for gated-mlp and group-query attention

Status: Open.

#70 In microsoft/mup;

· ftgreat opened on Mar 22, 2024

Reproducing Figure 1 using 'examples/Transformer/main.py'

Status: Open.

#69 In microsoft/mup;

· jndean opened on Jan 16, 2024

coord_check for model that returns loss function directly

Status: Open.

#68 In microsoft/mup;

· ad8e opened on Jan 8, 2024

Reproducing the validation accuracy vs learning rates curve on ResNet

Status: Open.

#67 In microsoft/mup;

· liulei277 opened on Dec 21, 2023

About Learning rate decay

Status: Open.

#64 In microsoft/mup;

· afcruzs opened on Oct 17, 2023

Usage with torch.compile in Pytorch 2?

Status: Open.

#60 In microsoft/mup;

· dreavjr opened on Sep 28, 2023

FSDP support?

Status: Open.

#59 In microsoft/mup;

· platers opened on Sep 25, 2023