#

optimizers

Here are 43 public repositories matching this topic...

annotated_deep_learning_paper_implementations

labmlai / annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

machine-learning reinforcement-learning deep-learning transformers pytorch transformer gan neural-networks literate-programming attention lora deep-learning-tutorial optimizers

Updated Aug 24, 2024
Python

lucidrains / lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

deep-learning artificial-intelligence optimizers evolutionary-search

Updated Jun 15, 2024
Python

gugarosa / opytimizer

🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.

python optimization artificial-intelligence meta-heuristic optimizers bioinspired meta-heuristic-optimization

Updated Oct 22, 2024
Python

Yonghongwei / Gradient-Centralization

A New Optimization Technique for Deep Neural Networks

deep-neural-networks optimizers optimization-technique gradient-centralization

Updated Jan 13, 2022
Python

CyberZHG / keras-radam

RAdam implemented in Keras & TensorFlow

tensorflow keras adam optimizers radam rectified-adam

Updated Jan 22, 2022
Python

OverLordGoldDragon / keras-adamw

Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

tensorflow keras sgd adamw adamwr nadam optimizers learning-rate-multipliers warm-restarts

Updated Jan 6, 2022
Python

clovaai / frostnet

FrostNet: Towards Quantization-Aware Network Architecture Search

computer-vision deep-learning pytorch style-transfer classification object-detection quantization network-architecture semantic-segmentation optimizers quantization-aware-training int8-quantization post-quantization quantization-efficient-network

Updated May 3, 2024
Python

Gradient-Centralization-TensorFlow

Rishit-dagli / Gradient-Centralization-TensorFlow

Instantly improve your training performance of TensorFlow models with just 2 lines of code!

python machine-learning deep-neural-networks deep-learning neural-network tensorflow python3 pip python-package tensorflow2 optimizers optimization-technique gradient-centralization

Updated Feb 9, 2022
Python

lucidrains / adam-atan2-pytorch

Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch

deep-learning artificial-intelligence stability adam optimizers

Updated Oct 23, 2024
Python

hfxunlp / transformer

Neutron: A pytorch based implementation of Transformer and its variants.

natural-language-processing python3 pytorch transformer seq2seq ensemble beam-search neural-machine-translation multi-gpu attention-is-all-you-need multilingual-nmt average-attention-network dynamic-sentence-sampling robust-neural-machine-translation average-models optimizers sentential-context context-aware-nmt relative-position dynamic-batch-size

Updated Aug 10, 2023
Python

warner-benjamin / optimi

Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers

deep-learning pytorch optimizers

Updated Jul 15, 2024
Python

CyberZHG / keras-lookahead

Lookahead mechanism for optimizers in Keras.

keras lookahead optimizers

Updated Jun 24, 2021
Python

ProudElm / solaredgeoptimizers

Intergration to get optimizers information from the SolarEdge portal

python solaredge-api optimizers

Updated Jul 26, 2024
Python

shreyansh26 / ML-Optimizers-JAX

Toy implementations of some popular ML optimizers using Python/JAX

machine-learning momentum gradient-descent optimization-algorithms adam adam-optimizer jax optimizers

Updated Jun 20, 2021
Python

ShivamShrirao / dnn_from_scratch

A high level deep learning library for Convolutional Neural Networks,GANs and more, made from scratch(numpy/cupy implementation).

python machine-learning library deep-neural-networks computer-vision deep-learning neural-network numpy keras cnn generative-adversarial-network gan mnist convolutional-neural-networks cifar cnn-from-scratch backpropagate ml-from-scratch optimizers

Updated Jun 19, 2021
Python

nestordemeure / flaxOptimizers

A collection of optimizers, some arcane others well known, for Flax.

flax optimizers

Updated Aug 6, 2021
Python

sail-sg / optim4rl

Optim4RL is a Jax framework of learning to optimize for reinforcement learning.

reinforcement-learning optimization optimizer reinforcement-learning-algorithms optimization-algorithms meta-learning jax learning-to-learn optimizers meta-learning-algorithms learning-to-optimize meta-learning-algorithm

Updated Aug 6, 2024
Python

devzhk / cgds-package

Package for CGD and ACGD optimizers

pytorch optimizers

Updated Aug 11, 2022
Python

chanzer0 / NBA-DFS-Tools

A set of NBA optimizers and GPP tools to help you win daily fantasy sports

ownership draftkings fanduel player-data optimizers

Updated Nov 13, 2024
Python

SamsungSAILMontreal / nino

Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks"

transformers optimization-algorithms graph-neural-networks optimizers neural-graphs

Updated Nov 1, 2024
Python

Improve this page

Add a description, image, and links to the optimizers topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the optimizers topic, visit your repo's landing page and select "manage topics."