Is there a plan to support 8bits (FP8 or INT8)?

[ifromeast]

No description provided.

[karpathy]

There is plan for fp8, but not int8 - that is usually used in context of inference, this repo focuses on training right now. We will very likely get around to model inference as well and int8 will be relevant then, but that is still fairly far out, likely on the scale of few ~months. fp8 is more like scale of few ~weeks.