cannot import name 'ImagesKwargs' from 'transformer.processing_utils'

[SidneyRey]

请问这是transformers和lmdeploy版本不兼容的问题吗？
版本是
transformers 4.37.2
lmdeploy 0.8.0

不跟换Transformers版本，该怎么操作来解这个问题。

[lvhan028]

你可以先看看模型侧的config.json对于 transformers 版本的最低要求。如果超过了 4.37.2，那么得升级 transformers。
如果config.json中没有，尝试下能不能通过 transformers 直接推理，如果不能的话，还得升级。如果能的话，lmdeploy应该也能推理

[SidneyRey]

我是用internvl源码Finetune 1B的模型，源码requirements中，transformers版本是 4.37.2。huggingface上1B模型config.json中"transformers_version": "4.48.3"。
训练用的是4.37.2，用transformers是可以直接推理的，lmdeploy推理会报错：cannot import name 'ImagesKwargs' from 'transformer.processing_utils'
我试下升级transformers到4.48.3看看

[TianCuteQY]

transformers==4.42.0 lmdeploy==0.8.0 works for me

[github-actions]

This issue is marked as stale because it has been marked as invalid or awaiting response for 7 days without any further response. It will be closed in 5 days if the stale label is not removed or if there is no further response.

[github-actions]

This issue is closed because it has been stale for 5 days. Please open a new issue if you have similar issues or you have any new updates now.