Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

安装了Xtuner但是无法识别到 #388

Closed
LumenScope opened this issue Feb 1, 2024 · 2 comments
Closed

安装了Xtuner但是无法识别到 #388

LumenScope opened this issue Feb 1, 2024 · 2 comments

Comments

@LumenScope
Copy link

(trainer) [root@VM-0-12-centos tzz]# pip install -U 'xtuner[deepspeed]'
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Requirement already satisfied: xtuner[deepspeed] in /root/usr/lib/python3.10/site-packages (0.1.13)
Requirement already satisfied: bitsandbytes>=0.40.0.post4 in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (0.41.3.post2)
Requirement already satisfied: datasets>=2.16.0 in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (2.16.1)
Requirement already satisfied: einops in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (0.4.1)
Requirement already satisfied: lagent>=0.1.2 in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (0.2.1)
Requirement already satisfied: mmengine>=0.10.1 in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (0.10.3)
Requirement already satisfied: openpyxl in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (3.1.2)
Requirement already satisfied: peft>=0.4.0 in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (0.6.0)
Requirement already satisfied: scipy in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (1.11.4)
Requirement already satisfied: SentencePiece in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (0.1.99)
Requirement already satisfied: tiktoken in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (0.5.2)
Requirement already satisfied: torch in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (2.0.0)
Requirement already satisfied: transformers!=4.34.1,!=4.35.0,!=4.35.1,!=4.35.2,>=4.32.1 in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (4.37.2)
Requirement already satisfied: transformers-stream-generator in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (0.0.4)
Requirement already satisfied: deepspeed>=0.12.3 in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (0.13.1)
Requirement already satisfied: mpi4py-mpich in /root/usr/lib/python3.10/site-packages (from xtuner[deepspeed]) (3.1.2)
Requirement already satisfied: filelock in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (3.13.1)
Requirement already satisfied: numpy>=1.17 in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (1.26.1)
Requirement already satisfied: pyarrow>=8.0.0 in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (14.0.1)
Requirement already satisfied: pyarrow-hotfix in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (0.6)
Requirement already satisfied: dill<0.3.8,>=0.3.0 in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (0.3.7)
Requirement already satisfied: pandas in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (2.1.4)
Requirement already satisfied: requests>=2.19.0 in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (2.31.0)
Requirement already satisfied: tqdm>=4.62.1 in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (4.66.1)
Requirement already satisfied: xxhash in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (3.4.1)
Requirement already satisfied: multiprocess in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (0.70.15)
Requirement already satisfied: fsspec<=2023.10.0,>=2023.1.0 in /root/usr/lib/python3.10/site-packages (from fsspec[http]<=2023.10.0,>=2023.1.0->datasets>=2.16.0->xtuner[deepspeed]) (2023.10.0)
Requirement already satisfied: aiohttp in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (3.9.1)
Requirement already satisfied: huggingface-hub>=0.19.4 in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (0.19.4)
Requirement already satisfied: packaging in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (23.2)
Requirement already satisfied: pyyaml>=5.1 in /root/usr/lib/python3.10/site-packages (from datasets>=2.16.0->xtuner[deepspeed]) (6.0.1)
Requirement already satisfied: hjson in /root/usr/lib/python3.10/site-packages (from deepspeed>=0.12.3->xtuner[deepspeed]) (3.1.0)
Requirement already satisfied: ninja in /root/usr/lib/python3.10/site-packages (from deepspeed>=0.12.3->xtuner[deepspeed]) (1.11.1.1)
Requirement already satisfied: psutil in /root/usr/lib/python3.10/site-packages (from deepspeed>=0.12.3->xtuner[deepspeed]) (5.9.5)
Requirement already satisfied: py-cpuinfo in /root/usr/lib/python3.10/site-packages (from deepspeed>=0.12.3->xtuner[deepspeed]) (9.0.0)
Requirement already satisfied: pydantic in /root/usr/lib/python3.10/site-packages (from deepspeed>=0.12.3->xtuner[deepspeed]) (1.9.2)
Requirement already satisfied: pynvml in /root/usr/lib/python3.10/site-packages (from deepspeed>=0.12.3->xtuner[deepspeed]) (11.5.0)
Requirement already satisfied: arxiv in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (2.1.0)
Requirement already satisfied: distro in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (1.9.0)
Requirement already satisfied: func-timeout in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (4.3.5)
Requirement already satisfied: google-search-results in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (2.4.2)
Requirement already satisfied: griffe in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (0.40.0)
Requirement already satisfied: json5 in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (0.9.14)
Requirement already satisfied: jsonschema in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (4.20.0)
Requirement already satisfied: jupyter in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (1.0.0)
Requirement already satisfied: jupyter-client in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (8.6.0)
Requirement already satisfied: phx-class-registry in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (4.1.0)
Requirement already satisfied: pillow in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (9.5.0)
Requirement already satisfied: python-pptx in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (0.6.23)
Requirement already satisfied: timeout-decorator in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (0.5.0)
Requirement already satisfied: typing-extensions in /root/usr/lib/python3.10/site-packages (from lagent>=0.1.2->xtuner[deepspeed]) (4.9.0)
Requirement already satisfied: addict in /root/usr/lib/python3.10/site-packages (from mmengine>=0.10.1->xtuner[deepspeed]) (2.4.0)
Requirement already satisfied: matplotlib in /root/usr/lib/python3.10/site-packages (from mmengine>=0.10.1->xtuner[deepspeed]) (3.8.2)
Requirement already satisfied: rich in /root/usr/lib/python3.10/site-packages (from mmengine>=0.10.1->xtuner[deepspeed]) (13.7.0)
Requirement already satisfied: termcolor in /root/usr/lib/python3.10/site-packages (from mmengine>=0.10.1->xtuner[deepspeed]) (2.4.0)
Requirement already satisfied: yapf in /root/usr/lib/python3.10/site-packages (from mmengine>=0.10.1->xtuner[deepspeed]) (0.40.2)
Requirement already satisfied: opencv-python>=3 in /root/usr/lib/python3.10/site-packages (from mmengine>=0.10.1->xtuner[deepspeed]) (4.8.1.78)
Requirement already satisfied: accelerate>=0.21.0 in /root/usr/lib/python3.10/site-packages (from peft>=0.4.0->xtuner[deepspeed]) (0.21.0)
Requirement already satisfied: safetensors in /root/usr/lib/python3.10/site-packages (from peft>=0.4.0->xtuner[deepspeed]) (0.4.2)
Requirement already satisfied: sympy in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (1.12)
Requirement already satisfied: networkx in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (3.2.1)
Requirement already satisfied: jinja2 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (3.1.2)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (11.7.99)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (11.7.99)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (11.7.101)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (8.5.0.96)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (11.10.3.66)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (10.9.0.58)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (10.2.10.91)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (11.4.0.1)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (11.7.4.91)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (2.14.3)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (11.7.91)
Requirement already satisfied: triton==2.0.0 in /root/usr/lib/python3.10/site-packages (from torch->xtuner[deepspeed]) (2.0.0)
Requirement already satisfied: setuptools in /root/usr/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch->xtuner[deepspeed]) (65.5.0)
Requirement already satisfied: wheel in /root/usr/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch->xtuner[deepspeed]) (0.42.0)
Requirement already satisfied: cmake in /root/usr/lib/python3.10/site-packages (from triton==2.0.0->torch->xtuner[deepspeed]) (3.28.0)
Requirement already satisfied: lit in /root/usr/lib/python3.10/site-packages (from triton==2.0.0->torch->xtuner[deepspeed]) (17.0.6)
Requirement already satisfied: regex!=2019.12.17 in /root/usr/lib/python3.10/site-packages (from transformers!=4.34.1,!=4.35.0,!=4.35.1,!=4.35.2,>=4.32.1->xtuner[deepspeed]) (2023.10.3)
Requirement already satisfied: tokenizers<0.19,>=0.14 in /root/usr/lib/python3.10/site-packages (from transformers!=4.34.1,!=4.35.0,!=4.35.1,!=4.35.2,>=4.32.1->xtuner[deepspeed]) (0.15.1)
Requirement already satisfied: et-xmlfile in /root/usr/lib/python3.10/site-packages (from openpyxl->xtuner[deepspeed]) (1.1.0)
Requirement already satisfied: attrs>=17.3.0 in /root/usr/lib/python3.10/site-packages (from aiohttp->datasets>=2.16.0->xtuner[deepspeed]) (23.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /root/usr/lib/python3.10/site-packages (from aiohttp->datasets>=2.16.0->xtuner[deepspeed]) (6.0.4)
Requirement already satisfied: yarl<2.0,>=1.0 in /root/usr/lib/python3.10/site-packages (from aiohttp->datasets>=2.16.0->xtuner[deepspeed]) (1.9.4)
Requirement already satisfied: frozenlist>=1.1.1 in /root/usr/lib/python3.10/site-packages (from aiohttp->datasets>=2.16.0->xtuner[deepspeed]) (1.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in /root/usr/lib/python3.10/site-packages (from aiohttp->datasets>=2.16.0->xtuner[deepspeed]) (1.3.1)
Requirement already satisfied: async-timeout<5.0,>=4.0 in /root/usr/lib/python3.10/site-packages (from aiohttp->datasets>=2.16.0->xtuner[deepspeed]) (4.0.3)
Requirement already satisfied: charset-normalizer<4,>=2 in /root/usr/lib/python3.10/site-packages (from requests>=2.19.0->datasets>=2.16.0->xtuner[deepspeed]) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /root/usr/lib/python3.10/site-packages (from requests>=2.19.0->datasets>=2.16.0->xtuner[deepspeed]) (3.6)
Requirement already satisfied: urllib3<3,>=1.21.1 in /root/usr/lib/python3.10/site-packages (from requests>=2.19.0->datasets>=2.16.0->xtuner[deepspeed]) (1.26.18)
Requirement already satisfied: certifi>=2017.4.17 in /root/usr/lib/python3.10/site-packages (from requests>=2.19.0->datasets>=2.16.0->xtuner[deepspeed]) (2023.11.17)
Requirement already satisfied: feedparser==6.0.10 in /root/usr/lib/python3.10/site-packages (from arxiv->lagent>=0.1.2->xtuner[deepspeed]) (6.0.10)
Requirement already satisfied: sgmllib3k in /root/usr/lib/python3.10/site-packages (from feedparser==6.0.10->arxiv->lagent>=0.1.2->xtuner[deepspeed]) (1.0.0)
Requirement already satisfied: colorama>=0.4 in /root/usr/lib/python3.10/site-packages (from griffe->lagent>=0.1.2->xtuner[deepspeed]) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in /root/usr/lib/python3.10/site-packages (from jinja2->torch->xtuner[deepspeed]) (2.1.3)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /root/usr/lib/python3.10/site-packages (from jsonschema->lagent>=0.1.2->xtuner[deepspeed]) (2023.12.1)
Requirement already satisfied: referencing>=0.28.4 in /root/usr/lib/python3.10/site-packages (from jsonschema->lagent>=0.1.2->xtuner[deepspeed]) (0.32.0)
Requirement already satisfied: rpds-py>=0.7.1 in /root/usr/lib/python3.10/site-packages (from jsonschema->lagent>=0.1.2->xtuner[deepspeed]) (0.15.2)
Requirement already satisfied: notebook in /root/usr/lib/python3.10/site-packages (from jupyter->lagent>=0.1.2->xtuner[deepspeed]) (7.0.7)
Requirement already satisfied: qtconsole in /root/usr/lib/python3.10/site-packages (from jupyter->lagent>=0.1.2->xtuner[deepspeed]) (5.5.1)
Requirement already satisfied: jupyter-console in /root/usr/lib/python3.10/site-packages (from jupyter->lagent>=0.1.2->xtuner[deepspeed]) (6.6.3)
Requirement already satisfied: nbconvert in /root/usr/lib/python3.10/site-packages (from jupyter->lagent>=0.1.2->xtuner[deepspeed]) (7.14.2)
Requirement already satisfied: ipykernel in /root/usr/lib/python3.10/site-packages (from jupyter->lagent>=0.1.2->xtuner[deepspeed]) (6.29.0)
Requirement already satisfied: ipywidgets in /root/usr/lib/python3.10/site-packages (from jupyter->lagent>=0.1.2->xtuner[deepspeed]) (8.1.1)
Requirement already satisfied: jupyter-core!=5.0.*,>=4.12 in /root/usr/lib/python3.10/site-packages (from jupyter-client->lagent>=0.1.2->xtuner[deepspeed]) (5.7.1)
Requirement already satisfied: python-dateutil>=2.8.2 in /root/usr/lib/python3.10/site-packages (from jupyter-client->lagent>=0.1.2->xtuner[deepspeed]) (2.8.2)
Requirement already satisfied: pyzmq>=23.0 in /root/usr/lib/python3.10/site-packages (from jupyter-client->lagent>=0.1.2->xtuner[deepspeed]) (25.1.2)
Requirement already satisfied: tornado>=6.2 in /root/usr/lib/python3.10/site-packages (from jupyter-client->lagent>=0.1.2->xtuner[deepspeed]) (6.4)
Requirement already satisfied: traitlets>=5.3 in /root/usr/lib/python3.10/site-packages (from jupyter-client->lagent>=0.1.2->xtuner[deepspeed]) (5.14.1)
Requirement already satisfied: contourpy>=1.0.1 in /root/usr/lib/python3.10/site-packages (from matplotlib->mmengine>=0.10.1->xtuner[deepspeed]) (1.2.0)
Requirement already satisfied: cycler>=0.10 in /root/usr/lib/python3.10/site-packages (from matplotlib->mmengine>=0.10.1->xtuner[deepspeed]) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /root/usr/lib/python3.10/site-packages (from matplotlib->mmengine>=0.10.1->xtuner[deepspeed]) (4.47.0)
Requirement already satisfied: kiwisolver>=1.3.1 in /root/usr/lib/python3.10/site-packages (from matplotlib->mmengine>=0.10.1->xtuner[deepspeed]) (1.4.5)
Requirement already satisfied: pyparsing>=2.3.1 in /root/usr/lib/python3.10/site-packages (from matplotlib->mmengine>=0.10.1->xtuner[deepspeed]) (3.1.1)
Requirement already satisfied: pytz>=2020.1 in /root/usr/lib/python3.10/site-packages (from pandas->datasets>=2.16.0->xtuner[deepspeed]) (2023.3.post1)
Requirement already satisfied: tzdata>=2022.1 in /root/usr/lib/python3.10/site-packages (from pandas->datasets>=2.16.0->xtuner[deepspeed]) (2023.3)
Requirement already satisfied: lxml>=3.1.0 in /root/usr/lib/python3.10/site-packages (from python-pptx->lagent>=0.1.2->xtuner[deepspeed]) (4.9.4)
Requirement already satisfied: XlsxWriter>=0.5.7 in /root/usr/lib/python3.10/site-packages (from python-pptx->lagent>=0.1.2->xtuner[deepspeed]) (3.1.9)
Requirement already satisfied: markdown-it-py>=2.2.0 in /root/usr/lib/python3.10/site-packages (from rich->mmengine>=0.10.1->xtuner[deepspeed]) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /root/usr/lib/python3.10/site-packages (from rich->mmengine>=0.10.1->xtuner[deepspeed]) (2.17.2)
Requirement already satisfied: mpmath>=0.19 in /root/usr/lib/python3.10/site-packages (from sympy->torch->xtuner[deepspeed]) (1.3.0)
Requirement already satisfied: importlib-metadata>=6.6.0 in /root/usr/lib/python3.10/site-packages (from yapf->mmengine>=0.10.1->xtuner[deepspeed]) (6.11.0)
Requirement already satisfied: platformdirs>=3.5.1 in /root/usr/lib/python3.10/site-packages (from yapf->mmengine>=0.10.1->xtuner[deepspeed]) (4.1.0)
Requirement already satisfied: tomli>=2.0.1 in /root/usr/lib/python3.10/site-packages (from yapf->mmengine>=0.10.1->xtuner[deepspeed]) (2.0.1)
Requirement already satisfied: zipp>=0.5 in /root/usr/lib/python3.10/site-packages (from importlib-metadata>=6.6.0->yapf->mmengine>=0.10.1->xtuner[deepspeed]) (3.17.0)
Requirement already satisfied: mdurl~=0.1 in /root/usr/lib/python3.10/site-packages (from markdown-it-py>=2.2.0->rich->mmengine>=0.10.1->xtuner[deepspeed]) (0.1.2)
Requirement already satisfied: six>=1.5 in /root/usr/lib/python3.10/site-packages (from python-dateutil>=2.8.2->jupyter-client->lagent>=0.1.2->xtuner[deepspeed]) (1.16.0)
Requirement already satisfied: comm>=0.1.1 in /root/usr/lib/python3.10/site-packages (from ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.2.1)
Requirement already satisfied: debugpy>=1.6.5 in /root/usr/lib/python3.10/site-packages (from ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.8.0)
Requirement already satisfied: ipython>=7.23.1 in /root/usr/lib/python3.10/site-packages (from ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (8.21.0)
Requirement already satisfied: matplotlib-inline>=0.1 in /root/usr/lib/python3.10/site-packages (from ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.1.6)
Requirement already satisfied: nest-asyncio in /root/usr/lib/python3.10/site-packages (from ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.6.0)
Requirement already satisfied: widgetsnbextension~=4.0.9 in /root/usr/lib/python3.10/site-packages (from ipywidgets->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (4.0.9)
Requirement already satisfied: jupyterlab-widgets~=3.0.9 in /root/usr/lib/python3.10/site-packages (from ipywidgets->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (3.0.9)
Requirement already satisfied: prompt-toolkit>=3.0.30 in /root/usr/lib/python3.10/site-packages (from jupyter-console->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (3.0.43)
Requirement already satisfied: beautifulsoup4 in /root/usr/lib/python3.10/site-packages (from nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (4.12.2)
Requirement already satisfied: bleach!=5.0.0 in /root/usr/lib/python3.10/site-packages (from nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (6.1.0)
Requirement already satisfied: defusedxml in /root/usr/lib/python3.10/site-packages (from nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.7.1)
Requirement already satisfied: jupyterlab-pygments in /root/usr/lib/python3.10/site-packages (from nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.3.0)
Requirement already satisfied: mistune<4,>=2.0.3 in /root/usr/lib/python3.10/site-packages (from nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (3.0.2)
Requirement already satisfied: nbclient>=0.5.0 in /root/usr/lib/python3.10/site-packages (from nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.9.0)
Requirement already satisfied: nbformat>=5.7 in /root/usr/lib/python3.10/site-packages (from nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (5.9.2)
Requirement already satisfied: pandocfilters>=1.4.1 in /root/usr/lib/python3.10/site-packages (from nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.5.1)
Requirement already satisfied: tinycss2 in /root/usr/lib/python3.10/site-packages (from nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.2.1)
Requirement already satisfied: jupyter-server<3,>=2.4.0 in /root/usr/lib/python3.10/site-packages (from notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.12.5)
Requirement already satisfied: jupyterlab-server<3,>=2.22.1 in /root/usr/lib/python3.10/site-packages (from notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.25.2)
Requirement already satisfied: jupyterlab<5,>=4.0.2 in /root/usr/lib/python3.10/site-packages (from notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (4.0.12)
Requirement already satisfied: notebook-shim<0.3,>=0.2 in /root/usr/lib/python3.10/site-packages (from notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.2.3)
Requirement already satisfied: qtpy>=2.4.0 in /root/usr/lib/python3.10/site-packages (from qtconsole->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.4.1)
Requirement already satisfied: webencodings in /root/usr/lib/python3.10/site-packages (from bleach!=5.0.0->nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.5.1)
Requirement already satisfied: decorator in /root/usr/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (5.1.1)
Requirement already satisfied: jedi>=0.16 in /root/usr/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.19.1)
Requirement already satisfied: stack-data in /root/usr/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.6.3)
Requirement already satisfied: exceptiongroup in /root/usr/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.2.0)
Requirement already satisfied: pexpect>4.3 in /root/usr/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (4.9.0)
Requirement already satisfied: anyio>=3.1.0 in /root/usr/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (3.7.1)
Requirement already satisfied: argon2-cffi in /root/usr/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (23.1.0)
Requirement already satisfied: jupyter-events>=0.9.0 in /root/usr/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.9.0)
Requirement already satisfied: jupyter-server-terminals in /root/usr/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.5.2)
Requirement already satisfied: overrides in /root/usr/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (7.4.0)
Requirement already satisfied: prometheus-client in /root/usr/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.19.0)
Requirement already satisfied: send2trash>=1.8.2 in /root/usr/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.8.2)
Requirement already satisfied: terminado>=0.8.3 in /root/usr/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.18.0)
Requirement already satisfied: websocket-client in /root/usr/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.7.0)
Requirement already satisfied: async-lru>=1.0.0 in /root/usr/lib/python3.10/site-packages (from jupyterlab<5,>=4.0.2->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.0.4)
Requirement already satisfied: jupyter-lsp>=2.0.0 in /root/usr/lib/python3.10/site-packages (from jupyterlab<5,>=4.0.2->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.2.2)
Requirement already satisfied: babel>=2.10 in /root/usr/lib/python3.10/site-packages (from jupyterlab-server<3,>=2.22.1->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.14.0)
Requirement already satisfied: fastjsonschema in /root/usr/lib/python3.10/site-packages (from nbformat>=5.7->nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.19.1)
Requirement already satisfied: wcwidth in /root/usr/lib/python3.10/site-packages (from prompt-toolkit>=3.0.30->jupyter-console->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.2.12)
Requirement already satisfied: soupsieve>1.2 in /root/usr/lib/python3.10/site-packages (from beautifulsoup4->nbconvert->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.5)
Requirement already satisfied: sniffio>=1.1 in /root/usr/lib/python3.10/site-packages (from anyio>=3.1.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.3.0)
Requirement already satisfied: parso<0.9.0,>=0.8.3 in /root/usr/lib/python3.10/site-packages (from jedi>=0.16->ipython>=7.23.1->ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.8.3)
Requirement already satisfied: python-json-logger>=2.0.4 in /root/usr/lib/python3.10/site-packages (from jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.0.7)
Requirement already satisfied: rfc3339-validator in /root/usr/lib/python3.10/site-packages (from jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.1.4)
Requirement already satisfied: rfc3986-validator>=0.1.1 in /root/usr/lib/python3.10/site-packages (from jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.1.1)
Requirement already satisfied: ptyprocess>=0.5 in /root/usr/lib/python3.10/site-packages (from pexpect>4.3->ipython>=7.23.1->ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.7.0)
Requirement already satisfied: argon2-cffi-bindings in /root/usr/lib/python3.10/site-packages (from argon2-cffi->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (21.2.0)
Requirement already satisfied: executing>=1.2.0 in /root/usr/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.0.1)
Requirement already satisfied: asttokens>=2.1.0 in /root/usr/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.4.1)
Requirement already satisfied: pure-eval in /root/usr/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (0.2.2)
Requirement already satisfied: fqdn in /root/usr/lib/python3.10/site-packages (from jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.5.1)
Requirement already satisfied: isoduration in /root/usr/lib/python3.10/site-packages (from jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (20.11.0)
Requirement already satisfied: jsonpointer>1.13 in /root/usr/lib/python3.10/site-packages (from jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.4)
Requirement already satisfied: uri-template in /root/usr/lib/python3.10/site-packages (from jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.3.0)
Requirement already satisfied: webcolors>=1.11 in /root/usr/lib/python3.10/site-packages (from jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.13)
Requirement already satisfied: cffi>=1.0.1 in /root/usr/lib/python3.10/site-packages (from argon2-cffi-bindings->argon2-cffi->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.16.0)
Requirement already satisfied: pycparser in /root/usr/lib/python3.10/site-packages (from cffi>=1.0.1->argon2-cffi-bindings->argon2-cffi->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.21)
Requirement already satisfied: arrow>=0.15.0 in /root/usr/lib/python3.10/site-packages (from isoduration->jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (1.3.0)
Requirement already satisfied: types-python-dateutil>=2.8.10 in /root/usr/lib/python3.10/site-packages (from arrow>=0.15.0->isoduration->jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->lagent>=0.1.2->xtuner[deepspeed]) (2.8.19.20240106)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
(trainer) [root@VM-0-12-centos tzz]# xtuner list-cfg
Traceback (most recent call last):
  File "/root/usr/lib/python3.10/site-packages/xtuner/tools/list_cfg.py", line 4, in <module>
    from xtuner.configs import cfgs_name_path
ModuleNotFoundError: No module named 'xtuner'
@LZHgrla
Copy link
Collaborator

LZHgrla commented Feb 1, 2024

pip所安装的位置有问题
显示安装到了
/root/usr/lib/python3.10/site-packages

而非你的anaconda环境

需要确保pip是你anaconda python环境所对应的pip命令

@LumenScope
Copy link
Author

pip所安装的位置有问题 显示安装到了 /root/usr/lib/python3.10/site-packages

而非你的anaconda环境

需要确保pip是你anaconda python环境所对应的pip命令

重装miniconda解决了问题!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants