Questions about modifications on transformers library

[lgduu]

Thanks for sharing your code!
Would you please share which module of (like ... .py) the transformers library have modified for your method, since it still belongs to your original code.

[passionate11]

Sorry for the late response. Regarding the LLaMA model, the primary modification is in src/models/llama/modeling.py. Additionally, there are some changes in the initialization process to allow the model to be loaded auto.

If I don't respond promptly on GitHub, feel free to email me.