Add multi OS binary portability support via Cosmopolitan libc toolchain

[trholding]

It is possible to compile once and run the binary on multiple OS via Cosmopolitan libc toolchain. I have added the necessary pre processor directives to enable that. Please have a look.

These are the features that come nearly free:

• Executable that runs on

  • GNU/Systemd
  • FreeBSD
  • OpenBSD
  • NetBSD
  • XNU's Not UNIX
  • Bare Metal (-D COSMO_METAL) [Not fully functional]
  • Windows

• Runs on

  • ARM64 via Blink x86-64 emulation (-D COSMO_BLINK)
  • x86_64

• Standalone

  • Embedded model in executable (-D COSMO_ZIP)

Instructions

Get and build the comopolitan libc toolchain:

Follow instructions at https://github.com/jart/cosmopolitan

Or do:

sudo mkdir -p /opt
sudo chmod 1777 /opt
git clone https://github.com/jart/cosmopolitan /opt/cosmo
cd /opt/cosmo
make -j8 toolchain
mkdir -p /opt/cosmos/bin
export PATH="/opt/cosmos/bin:$PATH"
echo 'PATH="/opt/cosmos/bin:$PATH"' >>~/.profile
sudo ln -sf /opt/cosmo/tool/scripts/cosmocc /opt/cosmos/bin/cosmocc
sudo ln -sf /opt/cosmo/tool/scripts/cosmoc++ /opt/cosmos/bin/cosmoc++

Example build to generate a Actually Portable Executable (APE):

$ cosmocc -O3 -Ofast -funsafe-math-optimizations -ffast-math -D COSMO_BLINK \
-D COSMO_METAL -D COSMO_ZIP -o run.com run.c -lm

Add model.bin and tokenizer.bin to executable:
$ zip run.com out/model.bin
$ zip run.com tokenizer.bin

Run or copy to any supported system and run:

If model is embedded:

$ ./run.com

Else

$ ./run.com model.bin

[trholding]

On a low end x86_64 machine:

On a aarch64 (runs very slow due to emulation)

[karpathy]

There's a lot going on here, I won't merge sorry. I am happy to link to your fork from the Readme though, if you'd like (see bottom of the Readme and the contributing section).

[trholding]

There's a lot going on here, I won't merge sorry. I am happy to link to your fork from the Readme though, if you'd like (see bottom of the Readme and the contributing section).

I agree that it would destroy the simplicity / elegance of llama2.c. I am continuing a friendly fork which will sync from yours but also will keep adding experimental features there with the final goal of booting a system directly into llama2.

Here is the link to the fork: https://github.com/trholding/llama2.c

I'd be honored if you would list it in the Readme section in the hope that some folks may find it useful.