哈工大LTP的安装与使用

[Garbage-boop]

前言

先前在网上查资料，发现基本都是要先安装pyltp这个库，命令安装尝试失败后发现网络上用wheel文件安装的方法成功率相对较高，但是网络上已存在的wheel文件只适用于py35和py36两个版本，对py38无能为力。后来得知最新的LTP4.0已经提供python原生支持，故进行LTP4.0的安装

步骤

直接安装ltp库

pip install ltp
报错

根据错误信息，更新torch到1.4.0

再次安装ltp，但不幸又遇上了EnvironmentError

后来看教程说要关闭网络代理还有浏览器中的，还说用conda装问题较少

尝试用conda，结果仍然失败

快被气哭了，还是用pip吧

再回去装竟然成功了 OMG

Microsoft Windows [版本 10.0.18363.900]
(c) 2019 Microsoft Corporation。保留所有权利。

C:\Users\17272>pip install ltp
Collecting ltp
  Using cached ltp-4.0.4-py3-none-any.whl (103 kB)
Collecting fire
  Using cached fire-0.3.1.tar.gz (81 kB)
Collecting tqdm
  Using cached tqdm-4.47.0-py2.py3-none-any.whl (66 kB)
Collecting cytoolz~=0.10.1
  Using cached cytoolz-0.10.1.tar.gz (475 kB)
Collecting torchtext==0.5.0
  Using cached torchtext-0.5.0-py3-none-any.whl (73 kB)
Collecting transformers>=3.0
  Using cached transformers-3.0.2-py3-none-any.whl (769 kB)
Requirement already satisfied: torch>=1.4.0 in c:\users\17272\appdata\local\programs\python\python38\lib\site-packages (from ltp) (1.4.0+cu92)
Collecting torch-optimizer
  Using cached torch_optimizer-0.0.1a13-py3-none-any.whl (35 kB)
Collecting toml
  Using cached toml-0.10.1-py2.py3-none-any.whl (19 kB)
Collecting six
  Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting termcolor
  Downloading termcolor-1.1.0.tar.gz (3.9 kB)
Collecting toolz>=0.8.0
  Downloading toolz-0.10.0.tar.gz (49 kB)
     |████████████████████████████████| 49 kB 969 kB/s
Collecting requests
  Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB)
     |████████████████████████████████| 61 kB 168 kB/s
Collecting sentencepiece
  Downloading sentencepiece-0.1.91-cp38-cp38-win_amd64.whl (1.2 MB)
     |████████████████████████████████| 1.2 MB 6.4 MB/s
Collecting numpy
  Downloading numpy-1.19.0-cp38-cp38-win_amd64.whl (13.0 MB)
     |████████████████████████████████| 13.0 MB 3.3 MB/s
Collecting filelock
  Downloading filelock-3.0.12-py3-none-any.whl (7.6 kB)
Collecting tokenizers==0.8.1.rc1
  Downloading tokenizers-0.8.1rc1-cp38-cp38-win_amd64.whl (1.9 MB)
     |████████████████████████████████| 1.9 MB 6.8 MB/s
Collecting regex!=2019.12.17
  Downloading regex-2020.6.8-cp38-cp38-win_amd64.whl (264 kB)
     |████████████████████████████████| 264 kB 6.4 MB/s
Collecting packaging
  Downloading packaging-20.4-py2.py3-none-any.whl (37 kB)
Collecting sacremoses
  Downloading sacremoses-0.0.43.tar.gz (883 kB)
     |████████████████████████████████| 883 kB 6.8 MB/s
Collecting pytorch-ranger>=0.1.1
  Downloading pytorch_ranger-0.1.1-py3-none-any.whl (14 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
  Downloading urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
     |████████████████████████████████| 126 kB 6.4 MB/s
Collecting idna<3,>=2.5
  Downloading idna-2.10-py2.py3-none-any.whl (58 kB)
     |████████████████████████████████| 58 kB 3.0 MB/s
Collecting chardet<4,>=3.0.2
  Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB)
     |████████████████████████████████| 133 kB 6.4 MB/s
Collecting certifi>=2017.4.17
  Downloading certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
     |████████████████████████████████| 156 kB 6.8 MB/s
Collecting pyparsing>=2.0.2
  Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting click
  Downloading click-7.1.2-py2.py3-none-any.whl (82 kB)
     |████████████████████████████████| 82 kB 160 kB/s
Collecting joblib
  Downloading joblib-0.16.0-py3-none-any.whl (300 kB)
     |████████████████████████████████| 300 kB 6.4 MB/s
Building wheels for collected packages: fire, cytoolz, termcolor, toolz, sacremoses
  Building wheel for fire (setup.py) ... done
  Created wheel for fire: filename=fire-0.3.1-py2.py3-none-any.whl size=111010 sha256=ebbb5e627eb29774ca886ae91b645f9154e6f97334ca97e088a5a283b4116a04
  Stored in directory: c:\users\17272\appdata\local\pip\cache\wheels\35\a0\e2\7c4d0cd36f74f5ca64306f2553b3438af7d158e359a17e8382
  Building wheel for cytoolz (setup.py) ... done
  Created wheel for cytoolz: filename=cytoolz-0.10.1-cp38-cp38-win_amd64.whl size=398343 sha256=d145a7f3ceba110c4b3386968c99d03bffc4de727959972e1f8a8b8256b8930e
  Stored in directory: c:\users\17272\appdata\local\pip\cache\wheels\7f\71\e7\690b241fea90859f7ed6defe9c56e37ab9b7dcd80a4067dc54
  Building wheel for termcolor (setup.py) ... done
  Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl size=4835 sha256=f35030f7f94af544fcb8c7e4be75e7299ba4847af50a15c9f68711e4b7eb0f1e
  Stored in directory: c:\users\17272\appdata\local\pip\cache\wheels\a0\16\9c\5473df82468f958445479c59e784896fa24f4a5fc024b0f501
  Building wheel for toolz (setup.py) ... done
  Created wheel for toolz: filename=toolz-0.10.0-py3-none-any.whl size=55579 sha256=e2ac19d3feb00eb4ea90a9287d6f783898a9f4de1139668d4005263f7908e1e1
  Stored in directory: c:\users\17272\appdata\local\pip\cache\wheels\a5\2b\b5\05758d5828d65f2adef8fbb5d5484e4adb946ae1827a973a01
  Building wheel for sacremoses (setup.py) ... done
  Created wheel for sacremoses: filename=sacremoses-0.0.43-py3-none-any.whl size=893262 sha256=04b51ff2af2356393bf4a0b377678e5bb15d0d2f1b21eb8809be455e57d8c236
  Stored in directory: c:\users\17272\appdata\local\pip\cache\wheels\7b\78\f4\27d43a65043e1b75dbddaa421b573eddc67e712be4b1c80677
Successfully built fire cytoolz termcolor toolz sacremoses
Installing collected packages: six, termcolor, fire, tqdm, toolz, cytoolz, urllib3, idna, chardet, certifi, requests, sentencepiece, numpy, torchtext, filelock, tokenizers, regex, pyparsing, packaging, click, joblib, sacremoses, transformers, pytorch-ranger, torch-optimizer, toml, ltp
Successfully installed certifi-2020.6.20 chardet-3.0.4 click-7.1.2 cytoolz-0.10.1 filelock-3.0.12 fire-0.3.1 idna-2.10 joblib-0.16.0 ltp-4.0.4 numpy-1.19.0 packaging-20.4 pyparsing-2.4.7 pytorch-ranger-0.1.1 regex-2020.6.8 requests-2.24.0 sacremoses-0.0.43 sentencepiece-0.1.91 six-1.15.0 termcolor-1.1.0 tokenizers-0.8.1rc1 toml-0.10.1 toolz-0.10.0 torch-optimizer-0.0.1a13 torchtext-0.5.0 tqdm-4.47.0 transformers-3.0.2 urllib3-1.25.9

C:\Users\17272>

简直了，快搞了一天了

最后用官方给出的例子测试一下

可以正常使用

后续

这次真心折腾了一天，中间好几次都特别崩溃，最近遇到的问题越来越少见了，还是要自己看报错日志，看看到底是哪个地方出错，不要一味地查教程