Plan for providing pre-compiled binaries from PyPi for pip install?

[TheBloke]

Hi @PanQiWei

I was wondering what your project plan was for providing pre-compiled binaries via PyPi?

oobabooga mentioned this a key issue for integration in text-gen-UI.

Do you have a thought as to when you would like to look at this? Eg whether for 0.2.0, or beyond?

If you're not already looking at it, I'd be happy to look at the process and try a Github Actions type setup. I could do that this weekend.

Let me know.

[PanQiWei]

To my knowledge, providing pre-compiled binaries require building CI first, I haven't a plan to do this so far. It would be great if you can help to do this ❤️

[TheBloke]

OK I will look into it and let you know!

[yhyu13]

@PanQiWei I've this dockerfile in my fork that successfully build the whl for anypython with cuda11.8
https://github.com/yhyu13/AutoGPTQ/tree/cuda_dev

[TheBloke]

That looks great @yhyu13 !

It would be great to get auto builds via Github Actions but this is a great base to work from.

I am expecting the biggest challenge to be Windows. I'm going to start investigating that tomorrow

[yhyu13]

@PanQiWei I've this dockerfile in my fork that successfully build the whl for anypython with cuda11.8 https://github.com/yhyu13/AutoGPTQ/tree/cuda_dev

@ALL Notice, I was using local proxy and pypl mirror index, they are not really universal, you can comment out or remove those if you want