Position: Adopt Constraints Over Penalties in Deep Learning

Setup

We use uv for installing dependencies. To install uv, please refer to the uv documentation.

Experiments

To run the experiments, you can use the following command:

Concave Example:

uv run concave.py

Sparsity:

uv run sparsity.py

Rate Constraints:

uv run rate_constraints.py