[版本冲突]环境配置要求版本冲突

[l-show]

Describe the issue

Issue:I encountered the following problem

[Usage] ImportError: cannot import name 'LlavaLlamaForCausalLM' from 'llava.model' #1101
There was a version compatibility issue when I tried the following

pip uninstall  flash-attn
pip install -e ".[train]"
pip install flash-attn --no-build-isolation --no-cache-dir

[Version conflict] The environment configuration requires a version conflict

[The first try]-Command:

pip install -e ".[train]"

[The first try]-Log:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
vllm 0.4.3 requires tokenizers>=0.19.1, but you have tokenizers 0.15.1 which is incompatible.
vllm 0.4.3 requires torch==2.3.0, but you have torch 2.1.2 which is incompatible.
vllm 0.4.3 requires transformers>=4.40.0, but you have transformers 4.37.2 which is incompatible.
vllm-flash-attn 2.5.8.post2 requires torch==2.3.0, but you have torch 2.1.2 which is incompatible.
xformers 0.0.26.post1 requires torch==2.3.0, but you have torch 2.1.2 which is incompatible.

[Repair]-Command:

pip install tokenizers==0.19.1

[Repair]-Log:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
llava 1.2.2.post1 requires tokenizers==0.15.1, but you have tokenizers 0.19.1 which is incompatible.
transformers 4.37.2 requires tokenizers<0.19,>=0.14, but you have tokenizers 0.19.1 which is incompatible.
vllm 0.4.3 requires torch==2.3.0, but you have torch 2.1.2 which is incompatible.
vllm 0.4.3 requires transformers>=4.40.0, but you have transformers 4.37.2 which is incompatible.

issues

torch ==2.3.0 or 2.1.2?
and tokenizers ? ..........
Every time I change the version, it's incompatible

It doesn't seem to be working

[l-show]

Package Version Editable project location

---

absl-py 1.4.0
accelerate 0.21.0
aiofiles 22.1.0
aiohttp 3.9.5
aiosignal 1.3.1
aiosqlite 0.18.0
altair 5.3.0
annotated-types 0.7.0
anthropic 0.28.0
anyio 3.6.2
argon2-cffi 21.3.0
argon2-cffi-bindings 21.2.0
arrow 1.2.3
asttokens 2.2.1
async-timeout 4.0.3
attrs 22.2.0
Babel 2.12.1
backcall 0.2.0
beautifulsoup4 4.11.2
bitsandbytes 0.43.1
bleach 6.0.0
brotlipy 0.7.0
cachetools 5.3.0
certifi 2021.5.30
cffi 1.14.6
chardet 4.0.0
charset-normalizer 3.1.0
click 8.1.7
cloudpickle 3.0.0
cmake 3.26.0
comm 0.1.2
conda 4.10.3
conda-package-handling 1.7.3
contourpy 1.0.7
cryptography 3.4.7
cycler 0.11.0
debugpy 1.6.6
decorator 5.1.1
deepspeed 0.12.6
defusedxml 0.7.1
diskcache 5.6.3
distro 1.9.0
dnspython 2.6.1
docker-pycreds 0.4.0
einops 0.6.1
einops-exts 0.0.4
email_validator 2.1.1
executing 1.2.0
fastapi 0.111.0
fastapi-cli 0.0.4
fastjsonschema 2.16.3
ffmpy 0.3.2
filelock 3.14.0
flash-attn 2.5.9.post1
fonttools 4.39.0
fqdn 1.5.1
frozenlist 1.4.1
fsspec 2024.6.0
gitdb 4.0.11
GitPython 3.1.43
google-auth 2.16.2
google-auth-oauthlib 0.4.6
gradio 4.16.0
gradio_client 0.8.1
grpcio 1.51.3
h11 0.14.0
hf_transfer 0.1.6
hjson 3.1.0
httpcore 0.17.3
httptools 0.6.1
httpx 0.24.0
huggingface-hub 0.23.3
idna 2.10
importlib_metadata 7.1.0
importlib-resources 5.12.0
interegular 0.3.3
ipykernel 6.21.3
ipython 8.11.0
ipython-genutils 0.2.0
ipywidgets 8.0.4
isoduration 20.11.0
jedi 0.18.2
Jinja2 3.1.2
jiter 0.4.1
joblib 1.4.2
json5 0.9.11
jsonpointer 2.3
jsonschema 4.17.3
jupyter_client 8.0.3
jupyter_core 5.2.0
jupyter-events 0.6.3
jupyter_server 2.4.0
jupyter_server_fileid 0.8.0
jupyter_server_terminals 0.4.4
jupyter_server_ydoc 0.6.1
jupyter-ydoc 0.2.3
jupyterlab 3.6.1
jupyterlab-language-pack-zh-CN 3.6.post0
jupyterlab-pygments 0.2.2
jupyterlab_server 2.20.0
jupyterlab-widgets 3.0.5
kiwisolver 1.4.4
lark 1.1.9
lfs 0.2
lit 15.0.7
litellm 1.40.7
llava 1.2.2.post1 /root/autodl-tmp/LLaVA
llvmlite 0.41.1
lm-format-enforcer 0.10.1
Markdown 3.4.1
markdown-it-py 3.0.0
markdown2 2.4.13
MarkupSafe 2.1.2
matplotlib 3.7.1
matplotlib-inline 0.1.6
mdurl 0.1.2
mistune 2.0.5
mpmath 1.3.0
msgpack 1.0.8
multidict 6.0.5
nbclassic 0.5.3
nbclient 0.7.2
nbconvert 7.2.10
nbformat 5.7.3
nest-asyncio 1.5.6
networkx 3.0
ninja 1.11.1.1
notebook 6.5.3
notebook_shim 0.2.2
numba 0.58.1
numpy 1.24.2
nvidia-cublas-cu12 12.1.3.1
nvidia-cuda-cupti-cu12 12.1.105
nvidia-cuda-nvrtc-cu12 12.1.105
nvidia-cuda-runtime-cu12 12.1.105
nvidia-cudnn-cu12 8.9.2.26
nvidia-cufft-cu12 11.0.2.54
nvidia-curand-cu12 10.3.2.106
nvidia-cusolver-cu12 11.4.5.107
nvidia-cusparse-cu12 12.1.0.106
nvidia-ml-py 12.555.43
nvidia-nccl-cu12 2.18.1
nvidia-nvjitlink-cu12 12.5.40
nvidia-nvtx-cu12 12.1.105
oauthlib 3.2.2
openai 1.33.0
orjson 3.10.3
outlines 0.0.34
packaging 23.0
pandas 2.0.3
pandocfilters 1.5.0
parso 0.8.3
peft 0.11.1
pexpect 4.8.0
pickleshare 0.7.5
Pillow 9.4.0
pip 24.0
pkgutil_resolve_name 1.3.10
platformdirs 3.1.1
plumbum 1.8.3
prometheus_client 0.20.0
prometheus-fastapi-instrumentator 7.0.0
prompt-toolkit 3.0.38
protobuf 4.22.1
psutil 5.9.4
ptyprocess 0.7.0
pure-eval 0.2.2
py-cpuinfo 9.0.0
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycosat 0.6.3
pycparser 2.20
pydantic 2.7.3
pydantic_core 2.18.4
pydub 0.25.1
Pygments 2.14.0
pynvml 11.5.0
pyOpenSSL 20.0.1
pyparsing 3.0.9
pyrsistent 0.19.3
PySocks 1.7.1
python-dateutil 2.8.2
python-dotenv 1.0.1
python-json-logger 2.0.7
python-multipart 0.0.9
pytz 2022.7.1
PyYAML 6.0
pyzmq 25.0.1
ray 2.10.0
referencing 0.35.1
regex 2024.5.15
requests 2.32.3
requests-oauthlib 1.3.1
rfc3339-validator 0.1.4
rfc3986-validator 0.1.1
rich 13.7.1
rpds-py 0.18.1
rpyc 6.0.0
rsa 4.9
ruamel-yaml-conda 0.15.100
ruff 0.4.8
safetensors 0.4.3
scikit-learn 1.2.2
scipy 1.10.1
semantic-version 2.10.0
Send2Trash 1.8.0
sentencepiece 0.1.99
sentry-sdk 2.5.1
setproctitle 1.3.3
setuptools 52.0.0.post20210125
sglang 0.1.17
shellingham 1.5.4
shortuuid 1.0.13
six 1.16.0
smmap 5.0.1
sniffio 1.3.0
soupsieve 2.4
stack-data 0.6.2
starlette 0.37.2
supervisor 4.2.5
svgwrite 1.4.3
sympy 1.11.1
tensorboard 2.12.0
tensorboard-data-server 0.7.0
tensorboard-plugin-wit 1.8.1
terminado 0.17.1
threadpoolctl 3.5.0
tiktoken 0.7.0
timm 0.6.13
tinycss2 1.2.1
tokenizers 0.19.1
tomli 2.0.1
tomlkit 0.12.0
toolz 0.12.1
torch 2.1.2
torchvision 0.16.2
tornado 6.2
tqdm 4.61.2
traitlets 5.9.0
transformers 4.37.2
triton 2.1.0
typer 0.12.3
typing_extensions 4.12.2
tzdata 2024.1
ujson 5.10.0
uri-template 1.2.0
urllib3 1.26.18
uvicorn 0.30.1
uvloop 0.19.0
vllm 0.4.3
vllm-flash-attn 2.5.8.post2
wandb 0.17.1
watchfiles 0.22.0
wavedrom 2.0.3.post3
wcwidth 0.2.6
webcolors 1.12
webencodings 0.5.1
websocket-client 1.5.1
websockets 11.0.3
Werkzeug 2.2.3
wheel 0.36.2
widgetsnbextension 4.0.5
xformers 0.0.26.post1
y-py 0.5.9
yarl 1.9.4
ypy-websocket 0.8.2
zipp 3.15.0
zmq 0.0.0

[l-show]

cuda 只支持12.1吗？

[Yuxinyi-Qiyu]

请问您解决了嘛？我也遇到了同样的问题，不匹配的版本