Can this project run on a Mac mini with 16GB of RAM and an M4 chip?

[haima95]

Can this project run on a Mac mini with 16GB of RAM and an M4 chip?

[vishalgurnule]

I guess it will not run since Apple has its own GPU and the requirement is AI GPU which is Nvidia H100

[robaji]

Yes, the Mac fork is the readme.

[morozow]

@haima95 review this PR: #248
It adds support for Apple MPS GPU alongside CUDA. The PR is related to benchmark runs that I performed locally on my Mac.
The changes are minimal and only affect a few lines of code in prepare.py, train.py, and pyproject.toml configuration.

[ediestel]

yes, easily. I modified the code for os x: https://github.com/ediestel/picochat-mlx; in case you need to tweak anything, use claude code inside the repo; it i sworking properly in my setup, e.g. mac mini 16 gb M4. It includes the changes (rust code) that were recommended by anwi(?), formerly with apple.