v0.3.0: torchdyn goes sequential

[Zymrael]

Major:

• HybridNeuralDE API: modular ODE-RNN and friends
• VariationalNeuralDE API
• NeuralSDE compatibility (torchsde)
• Cheap trace eval.: https://papers.nips.cc/paper/9187-neural-networks-with-cheap-differential-operators.pdf
• Adaptive checkpointing: https://arxiv.org/abs/2006.02493

Minor:

• A variety of TimeSeriesDataset
• Optimal control example
• Improved image classification architecture and tutorial
• DC and Stable normalizing flow tutorials

Miscellaneous:

• Performance tests

[kivo360]

Starting Tuesday I'm going full tilt on pytorch and DiffEq. If I write code to learn I'll learn faster.

How can I contribute? Something small that would give me confidence would be a good start. I noticed you added help wanted.

[Zymrael]

Hey @kivo360, thank you for offering to help! Join us in Slack, we'll find together a first contribution that's interesting and can help you get familiar with the codebase.

[ExtinctionEvent]

Hello, Id like to contribute to this, if that is possible.

[Zymrael]

We're a bit busy with NeurIPS at the moment, but feel free to join us on Slack - unless you've joined already (and posted on #torchdyn-dev?)

[lucaslie]

I was wondering if there is any progress on including adaptive checkpointing?

Sounds like a really useful addition to the repo. :)

[Zymrael]

We had to pause active development due to other obligations, but there should be more coming in the third quarter of 2021, including some of the newer advances in the field.

[Zymrael]

Closing as we're jumping ahead to v1.0 with a whole host of new features (currently in dev.)