I can't install apache-airflow due to psutil error

[ZackyZabi]

I have been trying to install apache-airflow on my windows 10 machine but i couldn't. Initially, i got the "Microsoft Visual C++ 14.0 missing" error, then i installed it through visual studio installer. Now i am getting some new error:

Installing collected packages: psutil, pygments, docutils, lockfile, python-daemon, text-unidecode, python-slugify, python-nvd3, idna, urllib3, certifi, chardet, requests, setproctitle, tabulate, monotonic, tenacity, thrift, unicodecsv, zope.deprecation, apache-airflow
  Found existing installation: psutil 5.4.8
    Uninstalling psutil-5.4.8:
      Successfully uninstalled psutil-5.4.8
  Running setup.py install for psutil ... error
    Complete output from command c:\users\farhath\appdata\local\programs\python\python37\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\farhaI~1\\AppData\\Local\\Temp\\pip-install-6xcc7tns\\psutil\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:\Users\farhaI~1\AppData\Local\Temp\pip-record-8gjefaoy\install-record.txt --single-version-externally-managed --compile:
    running install
    running build
    running build_py
    creating build
    creating build\lib.win-amd64-3.7
    creating build\lib.win-amd64-3.7\psutil
    copying psutil\_common.py -> build\lib.win-amd64-3.7\psutil
    copying psutil\_compat.py -> build\lib.win-amd64-3.7\psutil
    copying psutil\_psbsd.py -> build\lib.win-amd64-3.7\psutil
    copying psutil\_pslinux.py -> build\lib.win-amd64-3.7\psutil
    copying psutil\_psosx.py -> build\lib.win-amd64-3.7\psutil
    copying psutil\_psposix.py -> build\lib.win-amd64-3.7\psutil
    copying psutil\_pssunos.py -> build\lib.win-amd64-3.7\psutil
    copying psutil\_pswindows.py -> build\lib.win-amd64-3.7\psutil
    copying psutil\__init__.py -> build\lib.win-amd64-3.7\psutil
    creating build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\runner.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\test_bsd.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\test_linux.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\test_memory_leaks.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\test_misc.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\test_osx.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\test_posix.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\test_process.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\test_sunos.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\test_system.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\test_windows.py -> build\lib.win-amd64-3.7\psutil\tests
    copying psutil\tests\__init__.py -> build\lib.win-amd64-3.7\psutil\tests
    running build_ext
    building 'psutil._psutil_windows' extension
    creating build\temp.win-amd64-3.7
    creating build\temp.win-amd64-3.7\Release
    creating build\temp.win-amd64-3.7\Release\psutil
    creating build\temp.win-amd64-3.7\Release\psutil\arch
    creating build\temp.win-amd64-3.7\Release\psutil\arch\windows
    C:\Program Files (x86)\Microsoft Visual Studio\2017\BuildTools\VC\Tools\MSVC\14.16.27023\bin\HostX86\x64\cl.exe /c /nologo /Ox /W3 /GL /DNDEBUG /MD -DPSUTIL_WINDOWS=1 -DPSUTIL_VERSION=442 -D_WIN32_WINNT=0x01000 -D_AVAIL_WINVER_=0x01000 -D_CRT_SECURE_NO_WARNINGS -DPSAPI_VERSION=1 -Ic:\users\farhath\appdata\local\programs\python\python37\include -Ic:\users\farhath\appdata\local\programs\python\python37\include "-IC:\Program Files (x86)\Microsoft Visual Studio\2017\BuildTools\VC\Tools\MSVC\14.16.27023\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\winrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\cppwinrt" "-IC:\Program Files (x86)\Microsoft Visual Studio\2017\BuildTools\VC\Tools\MSVC\14.16.27023\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\winrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\cppwinrt" /Tcpsutil/_psutil_windows.c /Fobuild\temp.win-amd64-3.7\Release\psutil/_psutil_windows.obj
    _psutil_windows.c
    c:\users\farhath\appdata\local\temp\pip-install-6xcc7tns\psutil\psutil\arch\windows\ntextapi.h(166): error C2011: '_CLIENT_ID': 'struct' type redefinition
    C:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\um\winternl.h(80): note: see declaration of '_CLIENT_ID'
    c:\users\farhath\appdata\local\temp\pip-install-6xcc7tns\psutil\psutil\arch\windows\ntextapi.h(172): error C2011: '_SYSTEM_THREAD_INFORMATION': 'struct' type redefinition
    C:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\um\winternl.h(286): note: see declaration of '_SYSTEM_THREAD_INFORMATION'
    c:\users\farhath\appdata\local\temp\pip-install-6xcc7tns\psutil\psutil\arch/windows/inet_ntop.h(10): warning C4028: formal parameter 2 different from declaration
    psutil/_psutil_windows.c(246): warning C4244: '=': conversion from 'float' to 'ULONGLONG', possible loss of data
    psutil/_psutil_windows.c(880): warning C4267: '=': conversion from 'size_t' to 'DWORD', possible loss of data
    psutil/_psutil_windows.c(1445): warning C4267: '=': conversion from 'size_t' to 'ULONG', possible loss of data
    psutil/_psutil_windows.c(1446): warning C4267: '=': conversion from 'size_t' to 'ULONG', possible loss of data
    psutil/_psutil_windows.c(2111): warning C4312: 'type cast': conversion from 'int' to 'PVOID' of greater size
    psutil/_psutil_windows.c(2810): error C2039: 'ContextSwitches': is not a member of '_SYSTEM_THREAD_INFORMATION'
    C:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\um\winternl.h(286): note: see declaration of '_SYSTEM_THREAD_INFORMATION'
    psutil/_psutil_windows.c(2907): warning C4133: 'function': incompatible types - from 'MEMORY_BASIC_INFORMATION64 *' to 'PMEMORY_BASIC_INFORMATION'
    psutil/_psutil_windows.c(2935): warning C4047: '=': 'PVOID' differs in levels of indirection from 'ULONGLONG'
    error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio\\2017\\BuildTools\\VC\\Tools\\MSVC\\14.16.27023\\bin\\HostX86\\x64\\cl.exe' failed with exit status 2

    ----------------------------------------
  Rolling back uninstall of psutil
Command "c:\users\farhath\appdata\local\programs\python\python37\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\farhaI~1\\AppData\\Local\\Temp\\pip-install-6xcc7tns\\psutil\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:\Users\farhaI~1\AppData\Local\Temp\pip-record-8gjefaoy\install-record.txt --single-version-externally-managed --compile" failed with error code 1 in C:\Users\farhaI~1\AppData\Local\Temp\pip-install-6xcc7tns\psutil\

I tried re-installing the visual studio, still no luck, i don't know what else to do. Can you please suggest some solution ?

[giampaolo]

MMm weird. What happens if you do pip install psutil? That is supposed to use the wheel version hosted on PYPI (instead of trying to compile from sources).

[giampaolo]

Closing out as outdated. In the meantime the code changed quite a bit so you may want to retry and reopen if the issue is still there.