Feasibility of Reproducing DeepCoder-1.5B-Preview 16k and 24k Tasks on a Single A100 8×80GB Machine

[Go4miii]

Can I use a single A100 machine with 8 × 80GB GPUs to reproduce the 16k and 24k tasks of DeepCoder-1.5B-Preview?

[michaelzhiluo]

Yes, the scripts to run such things are already there!