EPFL Machine Learning and Optimization Laboratory
- 394 followers
- Lausanne, Switzerland
- http://mlo.epfl.ch
Popular repositories Loading
-
OptML_course
OptML_course PublicEPFL Course - Optimization for Machine Learning - CS-439
-
attention-cnn
attention-cnn PublicSource code for "On the Relationship between Self-Attention and Convolutional Layers"
-
landmark-attention
landmark-attention PublicLandmark Attention: Random-Access Infinite Context Length for Transformers
Repositories
- disco Public
DISCO is a code-free and installation-free browser platform that allows any non-technical user to collaboratively train machine learning models without sharing any private data.
- grad-norm-smooth Public
Official implementation of "Gradient-Normalized Smoothness for Optimization with Approximate Hessians"
- fineweb2-hq Public
Code for the paper "Enhancing Multilingual LLM Pretraining with Model-Based Data Selection"
-
-
- schedules-and-scaling Public
Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
- powersgd Public
Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
Top languages
Loading…
Most used topics
Loading…