You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, I made some testing on 4bit and 8bit version of PhoGPT. I got issue with 4bit version detail is below:
Environment:
PhoGPT Version: 4bit
Execution Environment: Google Colab with T4 GPU
Issue Description:
When using the 4bit version of PhoGPT with the provided initialization code from the documentation, the model returns an incomplete response. Specifically, it only returns a newline character \n, in contrast to the 8bit version, which functions correctly and returns a comprehensive output.
Steps to Reproduce:
Initialize the 4bit PhoGPT model using the sample code from the official documentation.
Use instruction = "Viết bài văn nghị luận xã hội về an toàn giao thông"
Observe that the response is only a newline character, indicating an incomplete or failed generation.
Expected Behavior:
The 4bit version of PhoGPT should return a complete and coherent response similar to the 8bit version, which returns detailed and lengthy outputs.
Actual Behavior:
The 4bit version outputs only a newline character \n, indicating an error or issue in processing the input prompt.
8bit
4bit
The text was updated successfully, but these errors were encountered:
Hello, I made some testing on 4bit and 8bit version of PhoGPT. I got issue with 4bit version detail is below:
Environment:
PhoGPT Version: 4bit
Execution Environment: Google Colab with T4 GPU
Issue Description:
When using the 4bit version of PhoGPT with the provided initialization code from the documentation, the model returns an incomplete response. Specifically, it only returns a newline character \n, in contrast to the 8bit version, which functions correctly and returns a comprehensive output.
Steps to Reproduce:
Initialize the 4bit PhoGPT model using the sample code from the official documentation.
Use instruction = "Viết bài văn nghị luận xã hội về an toàn giao thông"
Observe that the response is only a newline character, indicating an incomplete or failed generation.
Expected Behavior:
The 4bit version of PhoGPT should return a complete and coherent response similar to the 8bit version, which returns detailed and lengthy outputs.
Actual Behavior:
The 4bit version outputs only a newline character \n, indicating an error or issue in processing the input prompt.
8bit
![Screenshot 2024-04-02 at 22 08 56](https://private-user-images.githubusercontent.com/165785337/318840925-a4588ee5-5920-4a8d-9c1c-69cb785546e9.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkyODA2MDUsIm5iZiI6MTcxOTI4MDMwNSwicGF0aCI6Ii8xNjU3ODUzMzcvMzE4ODQwOTI1LWE0NTg4ZWU1LTU5MjAtNGE4ZC05YzFjLTY5Y2I3ODU1NDZlOS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjI1JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYyNVQwMTUxNDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0wMTQ4ZTM4NTdmY2JhZTY0Mzk5NjFjNzQxNDkwNDk2N2QxNjVhMjk4ZTczMjIyYTQ4MTdlNDdlOWExODEyYmY4JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.5SERVTkaaOkSzfZ1lhGOFhSfJsEhhUl7-B_Ft053-1c)
![Screenshot 2024-04-02 at 22 07 12](https://private-user-images.githubusercontent.com/165785337/318840238-01d418e1-e47e-4737-948e-048c096777f2.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkyODA2MDUsIm5iZiI6MTcxOTI4MDMwNSwicGF0aCI6Ii8xNjU3ODUzMzcvMzE4ODQwMjM4LTAxZDQxOGUxLWU0N2UtNDczNy05NDhlLTA0OGMwOTY3NzdmMi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjI1JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYyNVQwMTUxNDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT05ZjE0N2UyM2Q5MmY5MmVhYzYzN2E4NDM0ZTU5MDYwOWM5NDUyZDk4M2Y5ZTM1OTc5YmY0MTY4YjhmOWQ5NGRkJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.spwvlLqHrwIiblT9aVG55id-LDjt-9wzCtAvNSpgD-A)
4bit
The text was updated successfully, but these errors were encountered: