build not working with pip in Windows

[karthyyy]

Hi,

I am trying to build Pinocchio for Windows. I understand installation through conda is preferred. But all my other frameworks are in pip environment. My configuration is as follows

OS :- Windows 11 Home
Python :- Python 3.9
PIP version :- 24.3.1

So while executing "pip install pin", the terminal is automatically invoking VSCode with following application having more than 420 lines of code.

and at the end throwing following error after closing VSCode.

(env_test) C:\Users\karth>pip install pin
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting pin
  Downloading pin-2.7.0.tar.gz (61.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.8/61.8 MB 2.3 MB/s eta 0:00:00
  Installing build dependencies ... error
  error: subprocess-exited-with-error

  × pip subprocess to install build dependencies did not run successfully.
  │ exit code: 1
  ╰─> [206 lines of output]
      Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com, https://pypi.ngc.nvidia.com
      Collecting cmeel-boost~=1.83.0
        Downloading cmeel_boost-1.83.0.tar.gz (4.0 kB)
        Installing build dependencies: started
        Installing build dependencies: finished with status 'done'
        Getting requirements to build wheel: started
        Getting requirements to build wheel: finished with status 'done'
        Preparing metadata (pyproject.toml): started
        Preparing metadata (pyproject.toml): still running...
        Preparing metadata (pyproject.toml): still running...
        Preparing metadata (pyproject.toml): still running...
        Preparing metadata (pyproject.toml): finished with status 'error'
        error: subprocess-exited-with-error

        Preparing metadata (pyproject.toml) did not run successfully.
        exit code: 1

        [177 lines of output]
        -- Building for: Visual Studio 17 2022
        -- Selecting Windows SDK version 10.0.22621.0 to target Windows 10.0.22631.
        -- The C compiler identification is MSVC 19.41.34123.0
        -- The CXX compiler identification is MSVC 19.41.34123.0
        -- Detecting C compiler ABI info
        -- Detecting C compiler ABI info - done
        -- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/VC/Tools/MSVC/14.41.34120/bin/Hostx64/x64/cl.exe - skipped
        -- Detecting C compile features
        -- Detecting C compile features - done
        -- Detecting CXX compiler ABI info
        -- Detecting CXX compiler ABI info - done
        -- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/VC/Tools/MSVC/14.41.34120/bin/Hostx64/x64/cl.exe - skipped
        -- Detecting CXX compile features
        -- Detecting CXX compile features - done
        -- Found Python3: C:\Users\karth\env_test\Scripts\python.exe (found version "3.9.0") found components: Interpreter Development.Module
        -- CONFIGURE_COMMAND: ./bootstrap.sh;--prefix=C:/Users/karth/AppData/Local/Temp/cmeel-wek9tk8d/whl/cmeel.prefix
        -- BUILD_COMMAND: ./b2;hardcode-dll-paths=true;dll-path='$ORIGIN';link=shared;python=3.9
        -- Configuring done (15.6s)
        -- Generating done (0.3s)
        CMake Warning:
          Manually-specified variables were not used by the project:

            BUILD_TESTING
            Boost_NO_WARN_NEW_VERSIONS
            CMAKE_APPLE_SILICON_PROCESSOR
            CMAKE_INSTALL_LIBDIR
            CMEEL_JOBS
            PYTHON_SITELIB


        -- Build files have been written to: C:/Users/karth/AppData/Local/Temp/cmeel-wek9tk8d/bld
        MSBuild version 17.11.9+a69bbaaf5 for .NET Framework

        C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppBuild.targets(541,5): warning MSB8029: The Intermediate directory or Output directory cannot reside under the Temporary directory as it could lead to issues with incremental build. [C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\ZERO_CHECK.vcxproj]
          1>Checking Build System
        C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppBuild.targets(541,5): warning MSB8029: The Intermediate directory or Output directory cannot reside under the Temporary directory as it could lead to issues with incremental build. [C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\Boost.vcxproj]
          Creating directories for 'Boost'
          Building Custom Rule C:/Users/karth/AppData/Local/Temp/pip-install-aleh537c/cmeel-boost_ec91ccd182dd4d58afc27bb9a807728c/CMakeLists.txt
          Performing download step (download, verify and extract) for 'Boost'
          -- Downloading...
             dst='C:/Users/karth/AppData/Local/Temp/cmeel-wek9tk8d/bld/Boost-prefix/src/boost_1_83_0.tar.bz2'
             timeout='none'
             inactivity timeout='none'
          -- Using src='https://boostorg.jfrog.io/artifactory/main/release/1.83.0/source/boost_1_83_0.tar.bz2'
          -- [download 0% complete]
          -- [download 1% complete]
          -- ......
          -- [download 98% complete]
          -- [download 99% complete]
          -- [download 100% complete]
          -- verifying file...
                 file='C:/Users/karth/AppData/Local/Temp/cmeel-wek9tk8d/bld/Boost-prefix/src/boost_1_83_0.tar.bz2'
          -- Downloading... done
          -- extracting...
               src='C:/Users/karth/AppData/Local/Temp/cmeel-wek9tk8d/bld/Boost-prefix/src/boost_1_83_0.tar.bz2'
               dst='C:/Users/karth/AppData/Local/Temp/cmeel-wek9tk8d/bld/Boost-prefix/src/Boost'
          -- extracting... [tar xfz]
          -- extracting... [analysis]
          -- extracting... [rename]
          -- extracting... [clean up]
          -- extracting... done
          No update step for 'Boost'
          No patch step for 'Boost'
          Performing configure step for 'Boost'
          Traceback (most recent call last):
            File "<string>", line 1, in <module>
          FileNotFoundError: [Errno 2] No such file or directory: 'project-config.jam'
        C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB8066: Custom build for 'C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\CMakeFiles\e09cedc7c9bee061978c6972959be710\Boost-mkdir.rule;C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\CMakeFiles\e09cedc7c9bee061978c6972959be710\Boost-download.rule;C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\CMakeFiles\e09cedc7c9bee061978c6972959be710\Boost-update.rule;C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\CMakeFiles\e09cedc7c9bee061978c6972959be710\Boost-patch.rule;C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\CMakeFiles\e09cedc7c9bee061978c6972959be710\Boost-configure.rule;C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\CMakeFiles\e09cedc7c9bee061978c6972959be710\Boost-build.rule;C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\CMakeFiles\e09cedc7c9bee061978c6972959be710\Boost-install.rule;C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\CMakeFiles\4c5d24099afb40ad25b7e427817ae046\Boost-complete.rule;C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\CMakeFiles\9ecc378aec9483949516110ceccaa28b\Boost.rule;C:\Users\karth\AppData\Local\Temp\pip-install-aleh537c\cmeel-boost_ec91ccd182dd4d58afc27bb9a807728c\CMakeLists.txt' exited with code 1. [C:\Users\karth\AppData\Local\Temp\cmeel-wek9tk8d\bld\Boost.vcxproj]
        Traceback (most recent call last):
          File "C:\Users\karth\env_test\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 353, in <module>
            main()
          File "C:\Users\karth\env_test\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 335, in main
            json_out['return_val'] = hook(**hook_input['kwargs'])
          File "C:\Users\karth\env_test\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 152, in prepare_metadata_for_build_wheel
            whl_basename = backend.build_wheel(metadata_directory, config_settings)
          File "C:\Users\karth\AppData\Local\Temp\pip-build-env-0g4if658\overlay\Lib\site-packages\cmeel\build.py", line 26, in build_wheel
            return build_impl(wheel_directory, editable=False)
          File "C:\Users\karth\AppData\Local\Temp\pip-build-env-0g4if658\overlay\Lib\site-packages\cmeel\impl.py", line 105, in build_impl
            check_call(build_cmd)
          File "C:\Users\karth\AppData\Local\Programs\Python\Python39\lib\subprocess.py", line 373, in check_call
            raise CalledProcessError(retcode, cmd)
        subprocess.CalledProcessError: Command '['cmake', '--build', 'C:\\Users\\karth\\AppData\\Local\\Temp\\cmeel-wek9tk8d\\bld', '-j4']' returned non-zero exit status 1.
        [end of output]

        note: This error originates from a subprocess, and is likely not a problem with pip.
      error: metadata-generation-failed

      Encountered error while generating package metadata.

      See above for output.

      note: This is an issue with the package mentioned above, not pip.
      hint: See above for details.
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

This is similar to the github issue

#2231

But the solution mentioned is updating pip and pip in my system is the latest version.

Please help with the same. Thanks in advance

Regards
Karthik R

[jcarpent]

We don't yet support pip install on Windows systems. As you mentionned as @karthyyy, it is better to use conda, which is also compliant with pip.

[karthyyy]

Hi @jcarpent ,

Thanks for the clarification. You know by any means, to install "conda" packages in "pip" environment ? reverse is possible. The issue is that, I am working on an offline PC which is not connected to internet. So I download packages in an internet PC, take it to offline PC and locally install it. Its difficult to switch my entire development environment (which took few months to setup fully) from pip to conda.

My final objective is to use Pinocchio on embedded microcontroller using bare metal C. So in-case the above option doesn't work, I will try development (first using Python and then C) on Linux PC and use the generated code in the final application itself. Hope it works.

Thanks and Regards
Karthik

[jcarpent]

Just reinstall your pip packages into the conda env and use conda to install Pinocchio. It might work.

[karthyyy]

@jcarpent ,

Thanks. Will try that.

Thanks and Regards
Karthik R