Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pipenv install fails to lock on recursive sub dependencies from private repos #3328

Closed
mskoenz opened this issue Nov 29, 2018 · 2 comments · Fixed by #3298
Closed

Pipenv install fails to lock on recursive sub dependencies from private repos #3328

mskoenz opened this issue Nov 29, 2018 · 2 comments · Fixed by #3298
Labels
Category: VCS Type: Bug 🐛 Type: Vendored Dependencies

Comments

@mskoenz
Copy link

mskoenz commented Nov 29, 2018

This issue is very similar to the closed issue #920, I just added recursive to the title and changed install to lock.

Issue description

pipenv fails during locking to resolve a private dependency of a private dependency. By private I mean the URL/git-repo is specified via dependency_links in setup.py and not (yet) available on pipy.

The module structure is:
demo_lib: no dependency
demo_measure: depends on demo_lib
demo_paper: depends on demo_measure

running PIP_PROCESS_DEPENDENCY_LINKS=1 pipenv install -e . in project demo_lib or demo_measure (the situation of issue #920) works fine, but running it in demo_paper yields a resolve error for demo_lib.

Expected result

It should work like pip install -e . --process-dependency-links.

Not sure if it easy to fix, since one needs to inspect the dependency_links of all setup.py of all dependencies, not just the current project's one. But from installing, it should be possible to track the source (i.e. the private git repo specified in dependency_links).

Running my own pip-server is not impossible, but it's just so convenient to use dependency_links during closed dev and then just drop it in setup.py when published.

Actual result

install is fine, output:

Creating a virtualenv for this project…
Pipfile: /Users/mskoenz/Desktop/workbench/install_test/demo_paper/Pipfile
Using /Users/mskoenz/.pyenv/versions/3.7.0/bin/python3.7 (3.7.0) to create virtualenv…
Running virtualenv with interpreter /Users/mskoenz/.pyenv/versions/3.7.0/bin/python3.7
Using base prefix '/Users/mskoenz/.pyenv/versions/3.7.0'
/Users/mskoenz/.pyenv/versions/3.7.0/lib/python3.7/site-packages/virtualenv.py:1041: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
New python executable in /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/bin/python3.7
Also creating executable in /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/bin/python
Installing setuptools, pip, wheel...done.

Virtualenv location: /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb
Installing -e .…
Installing 'demo_paper'
$ ['/Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/bin/pip', 'install', '--verbose', '--upgrade', '-e', '"."', '-i', 'https://pypi.org/simple']
Created temporary directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-ephem-wheel-cache-izce1hqy
Created temporary directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony
Created requirements tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony'
Created temporary directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv
Obtaining file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper
  Added file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper to build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony'
  Running setup.py (path:/Users/mskoenz/Desktop/workbench/install_test/demo_paper/setup.py) egg_info for package from file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper
    Running command python setup.py egg_info
    running egg_info
    writing demo_paper.egg-info/PKG-INFO
    writing dependency_links to demo_paper.egg-info/dependency_links.txt
    writing requirements to demo_paper.egg-info/requires.txt
    writing top-level names to demo_paper.egg-info/top_level.txt
    reading manifest file 'demo_paper.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    warning: no files found matching 'version.txt'
    writing manifest file 'demo_paper.egg-info/SOURCES.txt'
  Source in /Users/mskoenz/Desktop/workbench/install_test/demo_paper has version 0.0.0, which satisfies requirement demo-paper==0.0.0 from file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper
  Removed demo-paper==0.0.0 from file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper from build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony'
Collecting fsc.export (from demo-paper==0.0.0)
  2 location(s) to search for versions of fsc.export:
  * https://pypi.org/simple/fsc-export/
  * git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0
  Getting page https://pypi.org/simple/fsc-export/
  Looking up "https://pypi.org/simple/fsc-export/" in the cache
  Request header has "max_age" as 0, cache bypassed
  Starting new HTTPS connection (1): pypi.org:443
  https://pypi.org:443 "GET /simple/fsc-export/ HTTP/1.1" 304 0
  Analyzing links from page https://pypi.org/simple/fsc-export/
    Found link https://files.pythonhosted.org/packages/01/1e/347dbb1a05b1c0e1d75e9cc2c07166229a33c5c55360c9d6227db4aa9c12/fsc.export-1.0.0.tar.gz#sha256=b0ed27ca73c6625e91573927004ed42071ac54ffb70d890e9b6c879f65fd06eb (from https://pypi.org/simple/fsc-export/), version: 1.0.0
    Found link https://files.pythonhosted.org/packages/bf/e4/38ade48f528664ac57219cc047cf07d59c19b706eb9c7ffb001b63f05595/fsc.export-1.1.0.tar.gz#sha256=d456f2bd518e46212806702688dd61d4ee9a1af014156d4398dce2e471fb4558 (from https://pypi.org/simple/fsc-export/), version: 1.1.0
  Cannot look at git URL git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0
  Skipping link git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0; Missing project version for fsc.export
  Using version 1.1.0 (newest of versions: 1.0.0, 1.1.0)
  Using cached wheel link: file:///Users/mskoenz/Library/Caches/pipenv/wheels/98/ee/cb/1b278c0df7ebf3de77f14fff5b56e779183b571ebc77ff5b6a/fsc.export-1.1.0-cp37-none-any.whl
  Added fsc.export from file:///Users/mskoenz/Library/Caches/pipenv/wheels/98/ee/cb/1b278c0df7ebf3de77f14fff5b56e779183b571ebc77ff5b6a/fsc.export-1.1.0-cp37-none-any.whl (from demo-paper==0.0.0) to build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony'
  Removed fsc.export from file:///Users/mskoenz/Library/Caches/pipenv/wheels/98/ee/cb/1b278c0df7ebf3de77f14fff5b56e779183b571ebc77ff5b6a/fsc.export-1.1.0-cp37-none-any.whl (from demo-paper==0.0.0) from build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony'
Collecting demo_measure (from demo-paper==0.0.0)
  2 location(s) to search for versions of demo-measure:
  * https://pypi.org/simple/demo-measure/
  * git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0
  Getting page https://pypi.org/simple/demo-measure/
  Looking up "https://pypi.org/simple/demo-measure/" in the cache
  Request header has "max_age" as 0, cache bypassed
  https://pypi.org:443 "GET /simple/demo-measure/ HTTP/1.1" 404 13
  Status code 404 not in (200, 203, 300, 301)
  Could not fetch URL https://pypi.org/simple/demo-measure/: 404 Client Error: Not Found for url: https://pypi.org/simple/demo-measure/ - skipping
  Cannot look at git URL git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0
  Found link git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0, version: 0.0.0
  dependency_links found: git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0
  Using version 0.0.0 (newest of versions: 0.0.0)
  Cloning ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git (to revision master) to /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-measure
  Running command git clone -q ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-measure
  Running command git show-ref master
  13a3f0752bc60ab3046e527df671f8261a40d84e refs/heads/master
  13a3f0752bc60ab3046e527df671f8261a40d84e refs/remotes/origin/master
  Running command git rev-parse --abbrev-ref HEAD
  master
  Added demo_measure from git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0 (from demo-paper==0.0.0) to build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony'
  Running setup.py (path:/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-measure/setup.py) egg_info for package demo-measure
    Running command python setup.py egg_info
    running egg_info
    creating pip-egg-info/demo_measure.egg-info
    writing pip-egg-info/demo_measure.egg-info/PKG-INFO
    writing dependency_links to pip-egg-info/demo_measure.egg-info/dependency_links.txt
    writing requirements to pip-egg-info/demo_measure.egg-info/requires.txt
    writing top-level names to pip-egg-info/demo_measure.egg-info/top_level.txt
    writing manifest file 'pip-egg-info/demo_measure.egg-info/SOURCES.txt'
    reading manifest file 'pip-egg-info/demo_measure.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    warning: no files found matching 'version.txt'
    writing manifest file 'pip-egg-info/demo_measure.egg-info/SOURCES.txt'
  Source in /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-measure has version 0.0.0, which satisfies requirement demo_measure from git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0 (from demo-paper==0.0.0)
  Removed demo_measure from git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0 (from demo-paper==0.0.0) from build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony'
Collecting demo_lib (from demo_measure->demo-paper==0.0.0)
  3 location(s) to search for versions of demo-lib:
  * https://pypi.org/simple/demo-lib/
  * git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0
  * git+ssh://git@gitlab.fubar.science/mskoenz/demo_lib.git@master#egg=demo_lib-0.0.1
  Getting page https://pypi.org/simple/demo-lib/
  Looking up "https://pypi.org/simple/demo-lib/" in the cache
  Request header has "max_age" as 0, cache bypassed
  https://pypi.org:443 "GET /simple/demo-lib/ HTTP/1.1" 404 13
  Status code 404 not in (200, 203, 300, 301)
  Could not fetch URL https://pypi.org/simple/demo-lib/: 404 Client Error: Not Found for url: https://pypi.org/simple/demo-lib/ - skipping
  Cannot look at git URL git+ssh://git@gitlab.fubar.science/mskoenz/demo_measure.git@master#egg=demo_measure-0.0.0
  Cannot look at git URL git+ssh://git@gitlab.fubar.science/mskoenz/demo_lib.git@master#egg=demo_lib-0.0.1
  Found link git+ssh://git@gitlab.fubar.science/mskoenz/demo_lib.git@master#egg=demo_lib-0.0.1, version: 0.0.1
  dependency_links found: git+ssh://git@gitlab.fubar.science/mskoenz/demo_lib.git@master#egg=demo_lib-0.0.1
  Using version 0.0.1 (newest of versions: 0.0.1)
  Cloning ssh://git@gitlab.fubar.science/mskoenz/demo_lib.git (to revision master) to /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-lib
  Running command git clone -q ssh://git@gitlab.fubar.science/mskoenz/demo_lib.git /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-lib
  Running command git show-ref master
  849ad818deda4214bd53ee6d6b558994d166221e refs/heads/master
  849ad818deda4214bd53ee6d6b558994d166221e refs/remotes/origin/master
  Running command git rev-parse --abbrev-ref HEAD
  master
  Added demo_lib from git+ssh://git@gitlab.fubar.science/mskoenz/demo_lib.git@master#egg=demo_lib-0.0.1 (from demo_measure->demo-paper==0.0.0) to build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony'
  Running setup.py (path:/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-lib/setup.py) egg_info for package demo-lib
    Running command python setup.py egg_info
    running egg_info
    creating pip-egg-info/demo_lib.egg-info
    writing pip-egg-info/demo_lib.egg-info/PKG-INFO
    writing dependency_links to pip-egg-info/demo_lib.egg-info/dependency_links.txt
    writing requirements to pip-egg-info/demo_lib.egg-info/requires.txt
    writing top-level names to pip-egg-info/demo_lib.egg-info/top_level.txt
    writing manifest file 'pip-egg-info/demo_lib.egg-info/SOURCES.txt'
    reading manifest file 'pip-egg-info/demo_lib.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    warning: no files found matching 'version.txt'
    writing manifest file 'pip-egg-info/demo_lib.egg-info/SOURCES.txt'
  Source in /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-lib has version 0.0.1, which satisfies requirement demo_lib from git+ssh://git@gitlab.fubar.science/mskoenz/demo_lib.git@master#egg=demo_lib-0.0.1 (from demo_measure->demo-paper==0.0.0)
  Removed demo_lib from git+ssh://git@gitlab.fubar.science/mskoenz/demo_lib.git@master#egg=demo_lib-0.0.1 (from demo_measure->demo-paper==0.0.0) from build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony'
Building wheels for collected packages: demo-measure, demo-lib
  Created temporary directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-wheel-0hmwolzp
  Running setup.py bdist_wheel for demo-measure: started
  Destination directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-wheel-0hmwolzp
  Running command /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/bin/python3.7 -u -c "import setuptools, tokenize;__file__='/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-measure/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-wheel-0hmwolzp --python-tag cp37
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib
  creating build/lib/demo_measure
  copying demo_measure/__init__.py -> build/lib/demo_measure
  copying demo_measure/_demo_measure.py -> build/lib/demo_measure
  running egg_info
  creating demo_measure.egg-info
  writing demo_measure.egg-info/PKG-INFO
  writing dependency_links to demo_measure.egg-info/dependency_links.txt
  writing requirements to demo_measure.egg-info/requires.txt
  writing top-level names to demo_measure.egg-info/top_level.txt
  writing manifest file 'demo_measure.egg-info/SOURCES.txt'
  reading manifest file 'demo_measure.egg-info/SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  warning: no files found matching 'version.txt'
  writing manifest file 'demo_measure.egg-info/SOURCES.txt'
  warning: build_py: byte-compiling is disabled, skipping.

  installing to build/bdist.macosx-10.13-x86_64/wheel
  running install
  running install_lib
  creating build/bdist.macosx-10.13-x86_64
  creating build/bdist.macosx-10.13-x86_64/wheel
  creating build/bdist.macosx-10.13-x86_64/wheel/demo_measure
  copying build/lib/demo_measure/__init__.py -> build/bdist.macosx-10.13-x86_64/wheel/demo_measure
  copying build/lib/demo_measure/_demo_measure.py -> build/bdist.macosx-10.13-x86_64/wheel/demo_measure
  warning: install_lib: byte-compiling is disabled, skipping.

  running install_egg_info
  Copying demo_measure.egg-info to build/bdist.macosx-10.13-x86_64/wheel/demo_measure-0.0.0-py3.7.egg-info
  running install_scripts
  creating build/bdist.macosx-10.13-x86_64/wheel/demo_measure-0.0.0.dist-info/WHEEL
  creating '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-wheel-0hmwolzp/demo_measure-0.0.0-cp37-none-any.whl' and adding 'build/bdist.macosx-10.13-x86_64/wheel' to it
  adding 'demo_measure/__init__.py'
  adding 'demo_measure/_demo_measure.py'
  adding 'demo_measure-0.0.0.dist-info/METADATA'
  adding 'demo_measure-0.0.0.dist-info/WHEEL'
  adding 'demo_measure-0.0.0.dist-info/dependency_links.txt'
  adding 'demo_measure-0.0.0.dist-info/top_level.txt'
  adding 'demo_measure-0.0.0.dist-info/RECORD'
  removing build/bdist.macosx-10.13-x86_64/wheel
  Running setup.py bdist_wheel for demo-measure: finished with status 'done'
  Stored in directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-ephem-wheel-cache-izce1hqy/wheels/7f/55/f0/8f51f8a5e623e1d6e03633870e7ae1a61a130b527641ae0f01
  Removing source in /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-measure
  Created temporary directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-wheel-b687omp7
  Running setup.py bdist_wheel for demo-lib: started
  Destination directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-wheel-b687omp7
  Running command /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/bin/python3.7 -u -c "import setuptools, tokenize;__file__='/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-lib/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-wheel-b687omp7 --python-tag cp37
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib
  creating build/lib/demo_lib
  copying demo_lib/__init__.py -> build/lib/demo_lib
  copying demo_lib/_demo_lib.py -> build/lib/demo_lib
  running egg_info
  creating demo_lib.egg-info
  writing demo_lib.egg-info/PKG-INFO
  writing dependency_links to demo_lib.egg-info/dependency_links.txt
  writing requirements to demo_lib.egg-info/requires.txt
  writing top-level names to demo_lib.egg-info/top_level.txt
  writing manifest file 'demo_lib.egg-info/SOURCES.txt'
  reading manifest file 'demo_lib.egg-info/SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  warning: no files found matching 'version.txt'
  writing manifest file 'demo_lib.egg-info/SOURCES.txt'
  warning: build_py: byte-compiling is disabled, skipping.

  installing to build/bdist.macosx-10.13-x86_64/wheel
  running install
  running install_lib
  creating build/bdist.macosx-10.13-x86_64
  creating build/bdist.macosx-10.13-x86_64/wheel
  creating build/bdist.macosx-10.13-x86_64/wheel/demo_lib
  copying build/lib/demo_lib/__init__.py -> build/bdist.macosx-10.13-x86_64/wheel/demo_lib
  copying build/lib/demo_lib/_demo_lib.py -> build/bdist.macosx-10.13-x86_64/wheel/demo_lib
  warning: install_lib: byte-compiling is disabled, skipping.

  running install_egg_info
  Copying demo_lib.egg-info to build/bdist.macosx-10.13-x86_64/wheel/demo_lib-0.0.1-py3.7.egg-info
  running install_scripts
  creating build/bdist.macosx-10.13-x86_64/wheel/demo_lib-0.0.1.dist-info/WHEEL
  creating '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-wheel-b687omp7/demo_lib-0.0.1-cp37-none-any.whl' and adding 'build/bdist.macosx-10.13-x86_64/wheel' to it
  adding 'demo_lib/__init__.py'
  adding 'demo_lib/_demo_lib.py'
  adding 'demo_lib-0.0.1.dist-info/METADATA'
  adding 'demo_lib-0.0.1.dist-info/WHEEL'
  adding 'demo_lib-0.0.1.dist-info/top_level.txt'
  adding 'demo_lib-0.0.1.dist-info/RECORD'
  removing build/bdist.macosx-10.13-x86_64/wheel
  Running setup.py bdist_wheel for demo-lib: finished with status 'done'
  Stored in directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-ephem-wheel-cache-izce1hqy/wheels/0c/69/40/ced675a5ac09cb9ddb9aa6de8f8f0818a8e32c0d895eed8d06
  Removing source in /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-dsx4qycv/demo-lib
Successfully built demo-measure demo-lib
Installing collected packages: fsc.export, demo-lib, demo-measure, demo-paper



  Running setup.py develop for demo-paper
    Running command /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/bin/python3.7 -c "import setuptools, tokenize;__file__='/Users/mskoenz/Desktop/workbench/install_test/demo_paper/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" develop --no-deps
    running develop
    running egg_info
    writing demo_paper.egg-info/PKG-INFO
    writing dependency_links to demo_paper.egg-info/dependency_links.txt
    writing requirements to demo_paper.egg-info/requires.txt
    writing top-level names to demo_paper.egg-info/top_level.txt
    reading manifest file 'demo_paper.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    warning: no files found matching 'version.txt'
    writing manifest file 'demo_paper.egg-info/SOURCES.txt'
    running build_ext
    Creating /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/lib/python3.7/site-packages/demo-paper.egg-link (link to .)
    Adding demo-paper 0.0.0 to easy-install.pth file

    Installed /Users/mskoenz/Desktop/workbench/install_test/demo_paper
Successfully installed demo-lib-0.0.1 demo-measure-0.0.0 demo-paper fsc.export-1.1.0
Cleaning up...
Removed build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-4xuv5ony'

Adding demo_paper to Pipfile's [packages]…
Installing -e .…
Installing 'demo_paper'
$ ['/Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/bin/pip', 'install', '--verbose', '--upgrade', '-e', '"."', '-i', 'https://pypi.org/simple']
Created temporary directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-ephem-wheel-cache-bglk6o8u
Created temporary directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-nklq_awd
Created requirements tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-nklq_awd'
Created temporary directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-install-2ts4v2rj
Obtaining file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper
  Added file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper to build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-nklq_awd'
  Running setup.py (path:/Users/mskoenz/Desktop/workbench/install_test/demo_paper/setup.py) egg_info for package from file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper
    Running command python setup.py egg_info
    running egg_info
    writing demo_paper.egg-info/PKG-INFO
    writing dependency_links to demo_paper.egg-info/dependency_links.txt
    writing requirements to demo_paper.egg-info/requires.txt
    writing top-level names to demo_paper.egg-info/top_level.txt
    reading manifest file 'demo_paper.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    warning: no files found matching 'version.txt'
    writing manifest file 'demo_paper.egg-info/SOURCES.txt'
  Source in /Users/mskoenz/Desktop/workbench/install_test/demo_paper has version 0.0.0, which satisfies requirement demo-paper==0.0.0 from file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper
  Removed demo-paper==0.0.0 from file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper from build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-nklq_awd'
Requirement already satisfied, skipping upgrade: fsc.export in /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/lib/python3.7/site-packages (from demo-paper==0.0.0) (1.1.0)
Requirement already satisfied, skipping upgrade: demo_measure in /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/lib/python3.7/site-packages (from demo-paper==0.0.0) (0.0.0)
Requirement already satisfied, skipping upgrade: demo-lib in /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/lib/python3.7/site-packages (from demo_measure->demo-paper==0.0.0) (0.0.1)
Installing collected packages: demo-paper
  Found existing installation: demo-paper 0.0.0
    Uninstalling demo-paper-0.0.0:
      Created temporary directory: /private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-uninstall-x6s11c5j
      Removing file or directory /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/lib/python3.7/site-packages/demo-paper.egg-link
      Removing pth entries from /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/lib/python3.7/site-packages/easy-install.pth:
      Removing entry: /Users/mskoenz/Desktop/workbench/install_test/demo_paper
      Successfully uninstalled demo-paper-0.0.0
  Running setup.py develop for demo-paper
    Running command /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/bin/python3.7 -c "import setuptools, tokenize;__file__='/Users/mskoenz/Desktop/workbench/install_test/demo_paper/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" develop --no-deps
    running develop
    running egg_info
    writing demo_paper.egg-info/PKG-INFO
    writing dependency_links to demo_paper.egg-info/dependency_links.txt
    writing requirements to demo_paper.egg-info/requires.txt
    writing top-level names to demo_paper.egg-info/top_level.txt
    reading manifest file 'demo_paper.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    warning: no files found matching 'version.txt'
    writing manifest file 'demo_paper.egg-info/SOURCES.txt'
    running build_ext
    Creating /Users/mskoenz/.virtualenvs/demo_paper-UIF4C6Eb/lib/python3.7/site-packages/demo-paper.egg-link (link to .)
    Adding demo-paper 0.0.0 to easy-install.pth file

    Installed /Users/mskoenz/Desktop/workbench/install_test/demo_paper
Successfully installed demo-paper
Cleaning up...
Removed build tracker '/private/var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pip-req-tracker-nklq_awd'

locking fails, output:

Adding demo_paper to Pipfile's [packages]…
Pipfile.lock not found, creating…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…
using sources: [{'url': 'https://pypi.org/simple', 'verify_ssl': True, 'name': 'pypi'}]
Using pip: -i https://pypi.org/simple

                          ROUND 1                           
Current constraints:
  file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper (from -r /var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pipenv-wgpd6fzp-requirements/pipenv-v1n0ko69-constraints.txt (line 2))

Finding the best candidates:
  found candidate -e file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper (constraint was <any>)

Finding secondary dependencies:

New dependencies found in this round:
  adding ['demo-measure', '', '[]']
  adding ['fsc.export', '', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 1: not stable

                          ROUND 2                           
Current constraints:
  demo_measure
  demo-paper==0.0.0 from file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper (from -r /var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pipenv-wgpd6fzp-requirements/pipenv-v1n0ko69-constraints.txt (line 2))
  fsc.export

Finding the best candidates:
  found candidate demo-measure==0.0.0 (constraint was <any>)
  found candidate -e file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper (constraint was ==0.0.0)
  found candidate fsc.export==1.1.0 (constraint was <any>)

Finding secondary dependencies:
  fsc.export==1.1.0         requires -
  demo-measure==0.0.0       requires demo_lib, fsc.export

New dependencies found in this round:
  adding ['demo-lib', '', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 2: not stable

                          ROUND 3                           
Current constraints:
  demo_lib
  demo_measure
  demo-paper==0.0.0 from file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper (from -r /var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pipenv-wgpd6fzp-requirements/pipenv-v1n0ko69-constraints.txt (line 2))
  fsc.export

Finding the best candidates:
Using pip: -i https://pypi.org/simple

                          ROUND 1                           
Current constraints:
  file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper (from -r /var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pipenv-wgpd6fzp-requirements/pipenv-j5980jv9-constraints.txt (line 2))

Finding the best candidates:
  found candidate -e file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper (constraint was <any>)

Finding secondary dependencies:

New dependencies found in this round:
  adding ['demo-measure', '', '[]']
  adding ['fsc.export', '', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 1: not stable

                          ROUND 2                           
Current constraints:
  demo_measure
  demo-paper==0.0.0 from file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper (from -r /var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pipenv-wgpd6fzp-requirements/pipenv-j5980jv9-constraints.txt (line 2))
  fsc.export

Finding the best candidates:
  found candidate demo-measure==0.0.0 (constraint was <any>)
  found candidate -e file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper (constraint was ==0.0.0)
  found candidate fsc.export==1.1.0 (constraint was <any>)

Finding secondary dependencies:
  demo-measure==0.0.0       requires demo_lib, fsc.export
  fsc.export==1.1.0         requires -

New dependencies found in this round:
  adding ['demo-lib', '', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 2: not stable

                          ROUND 3                           
Current constraints:
  demo_lib
  demo_measure
  demo-paper==0.0.0 from file:///Users/mskoenz/Desktop/workbench/install_test/demo_paper (from -r /var/folders/4s/v9gwnq215kdg5sx99pfh0n440000gn/T/pipenv-wgpd6fzp-requirements/pipenv-j5980jv9-constraints.txt (line 2))
  fsc.export

Finding the best candidates:

/Users/mskoenz/.pyenv/versions/3.7.0/lib/python3.7/site-packages/pipenv/patched/notpip/_internal/index.py:223: PipDeprecationWarning: DEPRECATION: Dependency Links processing has been deprecated and will be removed in a future release. You can find discussion regarding this at https://github.com/pypa/pip/issues/4187.
  issue=4187,
Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  First try clearing your dependency cache with $ pipenv lock --clear, then try the original command again.
 Alternatively, you can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
  Hint: try $ pipenv lock --pre if it is a pre-release dependency.
Could not find a version that matches demo_lib
No versions found
Was https://pypi.org/simple reachable?
Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  First try clearing your dependency cache with $ pipenv lock --clear, then try the original command again.
 Alternatively, you can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
  Hint: try $ pipenv lock --pre if it is a pre-release dependency.
Could not find a version that matches demo_lib
No versions found
Was https://pypi.org/simple reachable?

Steps to replicate

I made the three dummy-repos on my gitlab public for reproducibility (https://gitlab.fubar.science/mskoenz/demo_paper)
git clone git@gitlab.fubar.science:mskoenz/demo_paper.git
cd demo_paper
PIP_PROCESS_DEPENDENCY_LINKS=1 pipenv install -e . -v


$ pipenv --support

Pipenv version: '2018.10.13'

Pipenv location: '/Users/mskoenz/.pyenv/versions/3.7.0/lib/python3.7/site-packages/pipenv'

Python location: '/Users/mskoenz/.pyenv/versions/3.7.0/bin/python3'

Python installations found:

  • 3.7.0: /Users/mskoenz/.pyenv/shims/python3
  • 3.7.0: /Users/mskoenz/.pyenv/shims/python
  • 3.7.0: /Users/mskoenz/.pyenv/shims/python3.7m
  • 3.7.0: /Users/mskoenz/.pyenv/shims/python3.7
  • 3.7.0: /Users/mskoenz/.pyenv/versions/3.7.0/bin/python3.7
  • 3.7.0: /Users/mskoenz/.pyenv/versions/3.7.0/bin/python3.7m
  • 3.7.0: /usr/local/Cellar/python/3.7.0/Frameworks/Python.framework/Versions/3.7/bin/python3.7
  • 3.7.0: /usr/local/Cellar/python/3.7.0/Frameworks/Python.framework/Versions/3.7/bin/python3.7m
  • 3.6.6: /Users/mskoenz/.pyenv/shims/python3.6
  • 3.6.6: /Users/mskoenz/.pyenv/shims/python3.6m
  • 3.6.6: /Users/mskoenz/.pyenv/versions/3.6.6/bin/python3.6
  • 3.6.6: /Users/mskoenz/.pyenv/versions/3.6.6/bin/python3.6m
  • 3.5.6: /Users/mskoenz/.pyenv/shims/python3.5m
  • 3.5.6: /Users/mskoenz/.pyenv/shims/python3.5
  • 3.5.6: /Users/mskoenz/.pyenv/versions/3.5.6/bin/python3.5
  • 3.5.6: /Users/mskoenz/.pyenv/versions/3.5.6/bin/python3.5m
  • 3.4.9: /Users/mskoenz/.pyenv/shims/python3.4m
  • 3.4.9: /Users/mskoenz/.pyenv/shims/python3.4
  • 3.4.9: /Users/mskoenz/.pyenv/versions/3.4.9/bin/python3.4
  • 3.4.9: /Users/mskoenz/.pyenv/versions/3.4.9/bin/python3.4m
  • 2.7.15: /Users/mskoenz/.pyenv/shims/python2
  • 2.7.15: /Users/mskoenz/.pyenv/shims/python2.7
  • 2.7.15: /Users/mskoenz/.pyenv/versions/2.7.15/bin/python2.7
  • 2.7.15: /usr/local/Cellar/python@2/2.7.15_1/Frameworks/Python.framework/Versions/2.7/bin/python2.7
  • 2.7.10: /Users/mskoenz/.pyenv/versions/2.7.10/bin/python2.7
  • 2.7.10: /usr/bin/python
  • 2.7.10: /usr/bin/pythonw
  • 2.7.10: /System/Library/Frameworks/Python.framework/Versions/2.7/bin/python2.7

PEP 508 Information:

{'implementation_name': 'cpython',
 'implementation_version': '3.7.0',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '18.2.0',
 'platform_system': 'Darwin',
 'platform_version': 'Darwin Kernel Version 18.2.0: Fri Oct  5 19:41:49 PDT '
                     '2018; root:xnu-4903.221.2~2/RELEASE_X86_64',
 'python_full_version': '3.7.0',
 'python_version': '3.7',
 'sys_platform': 'darwin'}

System environment variables:

  • CPLUS_INCLUDE_PATH
  • LDFLAGS
  • VIRTUALENVWRAPPER_SCRIPT
  • VIRTUALENVWRAPPER_PROJECT_FILENAME
  • TERM_PROGRAM
  • PYENV_ROOT
  • SHELL
  • TERM
  • CPPFLAGS
  • TMPDIR
  • PERL5LIB
  • Apple_PubSub_Socket_Render
  • PERL_MB_OPT
  • PYENV_VERSION
  • USER
  • SSH_AUTH_SOCK
  • PYENV_DIR
  • __CF_USER_TEXT_ENCODING
  • WORKON_HOME
  • VIRTUALENVWRAPPER_PYTHON
  • PATH
  • VIRTUALENVWRAPPER_HOOK_DIR
  • C_INCLUDE_PATH
  • PWD
  • LANG
  • PYENV_HOOK_PATH
  • XPC_FLAGS
  • XPC_SERVICE_NAME
  • PYENV_SHELL
  • SHLVL
  • HOME
  • PERL_LOCAL_LIB_ROOT
  • LOGNAME
  • VIRTUALENVWRAPPER_WORKON_CD
  • PERL_MM_OPT
  • PYENV_VIRTUALENVWRAPPER_PREFER_PYVENV
  • PYTHONDONTWRITEBYTECODE
  • PIP_SHIMS_BASE_MODULE
  • PIP_PYTHON_PATH

Pipenv–specific environment variables:

Debug–specific environment variables:

  • PATH: /Users/mskoenz/.pyenv/versions/3.7.0/bin:/usr/local/Cellar/pyenv/1.2.7/libexec:/Users/mskoenz/.pyenv/plugins/pyenv-install-latest/bin:/Users/mskoenz/perl5/bin:/Users/mskoenz/.pyenv/shims:/usr/local/opt/sqlite/bin:/usr/local/opt/coreutils/libexec/gnubin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Library/TeX/texbin:/Users/mskoenz/perl5/bin:/Users/mskoenz/.pyenv/shims:/usr/local/opt/sqlite/bin:/usr/local/opt/coreutils/libexec/gnubin
  • SHELL: /bin/bash
  • LANG: en_US.UTF-8
  • PWD: /Users/mskoenz/Desktop/workbench/install_test/demo_paper

Contents of Pipfile ('/Users/mskoenz/Desktop/workbench/install_test/demo_paper/Pipfile'):

[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"

[packages]
demo-paper = {editable = true, path = "."}

[dev-packages]

[requires]
python_version = "3.7"
@mab4058
Copy link

mab4058 commented Jan 14, 2019

I'm having the same issue.

I'll just add that I'm using PEP508 syntax to include VCS depencencies in the install_requires section of setup.py (pip version 18.1). I was going to open a similar bug report when I noticed this.

Edit: One difference is that I experience a whole bunch of os.unlink - PermissionError: [WinError 5] Access is denied exceptions along with the same end result. I'm not sure if that makes mine a different bug or not.

@techalchemy techalchemy added Type: Bug 🐛 Category: VCS Type: Vendored Dependencies labels Jan 21, 2019
@techalchemy
Copy link
Member

techalchemy commented Mar 5, 2019

This will be resolved when #3298 is merged, thanks for your patience

Do note that dependency_links are not a thing anymore. Sorry for the trouble again and thanks for the report!

fwojciak pushed a commit to fwojciak/pipenv that referenced this issue May 29, 2020
2020.5.28 (2020-05-28)
======================

Features & Improvements
-----------------------

-   `pipenv install` and `pipenv sync` will no longer attempt to install satisfied dependencies during installation. pypa#3057, pypa#3506
-   Added support for resolution of direct-url dependencies in `setup.py` files to respect `PEP-508` style URL dependencies. pypa#3148
-   Added full support for resolution of all dependency types including direct URLs, zip archives, tarballs, etc.
    -   Improved error handling and formatting.
    -   Introduced improved cross platform stream wrappers for better `stdout` and `stderr` consistency. pypa#3298
-   For consistency with other commands and the `--dev` option description, `pipenv lock --requirements --dev` now emits both default and development dependencies. The new `--dev-only` option requests the previous behaviour (e.g. to generate a `dev-requirements.txt` file). pypa#3316
-   Pipenv will now successfully recursively lock VCS sub-dependencies. pypa#3328
-   Added support for `--verbose` output to `pipenv run`. pypa#3348
-   Pipenv will now discover and resolve the intrinsic dependencies of **all** VCS dependencies, whether they are editable or not, to prevent resolution conflicts. pypa#3368
-   Added a new environment variable, `PIPENV_RESOLVE_VCS`, to toggle dependency resolution off for non-editable VCS, file, and URL based dependencies. pypa#3577
-   Added the ability for Windows users to enable emojis by setting `PIPENV_HIDE_EMOJIS=0`. pypa#3595
-   Allow overriding `PIPENV_INSTALL_TIMEOUT` environment variable (in seconds). pypa#3652
-   Allow overriding `PIP_EXISTS_ACTION` evironment variable (value is passed to pip install). Possible values here: <https://pip.pypa.io/en/stable/reference/pip/#exists-action-option> Useful when you need to `PIP\_EXISTS\_ACTION=i` (ignore existing packages) - great for CI environments, where you need really fast setup. pypa#3738
-   Pipenv will no longer forcibly override `PIP_NO_DEPS` on all vcs and file dependencies as resolution happens on these in a pre-lock step. pypa#3763
-   Improved verbose logging output during `pipenv lock` will now stream output to the console while maintaining a spinner. pypa#3810
-   Added support for automatic python installs via `asdf` and associated `PIPENV_DONT_USE_ASDF` environment variable. pypa#4018
-   Pyenv/asdf can now be used whether or not they are available on PATH. Setting `PYENV_ROOT`/`ASDF_DIR` in a `.env` file allows Pipenv to install an interpreter without any shell customizations, so long as pyenv/asdf is installed. pypa#4245
-   Added `--key` command line parameter for including personal PyUp.io API tokens when running `pipenv check`. pypa#4257

Behavior Changes
----------------

-   Make conservative checks of known exceptions when subprocess returns output, so user won\'t see the whole traceback - just the error. pypa#2553
-   Do not touch Pipfile early and rely on it so that one can do `pipenv sync` without a Pipfile. pypa#3386
-   Re-enable `--help` option for `pipenv run` command. pypa#3844
-   Make sure `pipenv lock -r --pypi-mirror {MIRROR_URL}` will respect the pypi-mirror in requirements output. pypa#4199

Bug Fixes
---------

-   Raise `PipenvUsageError` when \[\[source\]\] does not contain url field. pypa#2373
-   Fixed a bug which caused editable package resolution to sometimes fail with an unhelpful setuptools-related error message. pypa#2722
-   Fixed an issue which caused errors due to reliance on the system utilities `which` and `where` which may not always exist on some
    systems.
-   Fixed a bug which caused periodic failures in python discovery when executables named `python` were not present on the target `$PATH`. pypa#2783
-   Dependency resolution now writes hashes for local and remote files to the lockfile. pypa#3053
-   Fixed a bug which prevented `pipenv graph` from correctly showing all dependencies when running from within `pipenv shell`. pypa#3071
-   Fixed resolution of direct-url dependencies in `setup.py` files to respect `PEP-508` style URL dependencies. pypa#3148
-   Fixed a bug which caused failures in warning reporting when running pipenv inside a virtualenv under some circumstances.
-   Fixed a bug with package discovery when running `pipenv clean`. pypa#3298
-   Quote command arguments with carets (`^`) on Windows to work around unintended shell escapes. pypa#3307
-   Handle alternate names for UTF-8 encoding. pypa#3313
-   Abort pipenv before adding the non-exist package to Pipfile. pypa#3318
-   Don\'t normalize the package name user passes in. pypa#3324
-   Fix a bug where custom virtualenv can not be activated with pipenv shell pypa#3339
-   Fix a bug that `--site-packages` flag is not recognized. pypa#3351
-   Fix a bug where `pipenv --clear` is not working pypa#3353
-   Fix unhashable type error during `$ pipenv install --selective-upgrade` pypa#3384
-   Dependencies with direct `PEP508` compliant VCS URLs specified in their `install_requires` will now be successfully locked during the resolution process. pypa#3396
-   Fixed a keyerror which could occur when locking VCS dependencies in
    some cases. pypa#3404
-   Fixed a bug that `ValidationError` is thrown when some fields are missing in source section. pypa#3427
-   Updated the index names in lock file when source name in Pipfile is changed. pypa#3449
-   Fixed an issue which caused `pipenv install --help` to show duplicate entries for `--pre`. pypa#3479
-   Fix bug causing `[SSL: CERTIFICATE_VERIFY_FAILED]` when Pipfile `[[source]]` has `verify_ssl=false` and url with custom port. pypa#3502
-   Fix `sync --sequential` ignoring `pip install` errors and logs. pypa#3537
-   Fix the issue that lock file can\'t be created when `PIPENV_PIPFILE` is not under working directory. pypa#3584
-   Pipenv will no longer inadvertently set `editable=True` on all vcs dependencies. pypa#3647
-   The `--keep-outdated` argument to `pipenv install` and `pipenv lock` will now drop specifier constraints when encountering editable dependencies.
    -   In addition, `--keep-outdated` will retain specifiers that would otherwise be dropped from any entries that have not been updated. pypa#3656
-   Fixed a bug which sometimes caused pipenv to fail to respect the `--site-packages` flag when passed with `pipenv install`. pypa#3718
-   Normalize the package names to lowercase when comparing used and in-Pipfile packages. pypa#3745
-   `pipenv update --outdated` will now correctly handle comparisons between pre/post-releases and normal releases. pypa#3766
-   Fixed a `KeyError` which could occur when pinning outdated VCS dependencies via `pipenv lock --keep-outdated`. pypa#3768
-   Resolved an issue which caused resolution to fail when encountering poorly formatted `python_version` markers in `setup.py` and `setup.cfg` files. pypa#3786
-   Fix a bug that installation errors are displayed as a list. pypa#3794
-   Update `pythonfinder` to fix a problem that `python.exe` will be mistakenly chosen for virtualenv creation under WSL. pypa#3807
-   Fixed several bugs which could prevent editable VCS dependencies from being installed into target environments, even when reporting
    successful installation. pypa#3809
-   `pipenv check --system` should find the correct Python interpreter when `python` does not exist on the system. pypa#3819
-   Resolve the symlinks when the path is absolute. pypa#3842
-   Pass `--pre` and `--clear` options to `pipenv update --outdated`. pypa#3879
-   Fixed a bug which prevented resolution of direct URL dependencies which have PEP508 style direct url VCS sub-dependencies with
    subdirectories. pypa#3976
-   Honor `PIPENV_SPINNER` environment variable pypa#4045
-   Fixed an issue with `pipenv check` failing due to an invalid API key from `pyup.io`. pypa#4188
-   Fixed a bug which caused versions from VCS dependencies to be included in `Pipfile.lock` inadvertently. pypa#4217
-   Fixed a bug which caused pipenv to search non-existent virtual environments for `pip` when installing using `--system`. pypa#4220
-   `Requires-Python` values specifying constraint versions of python starting from `1.x` will now be parsed successfully. pypa#4226
-   Fix a bug of `pipenv update --outdated` that can\'t print output correctly. pypa#4229
-   Fixed a bug which caused pipenv to prefer source distributions over wheels from `PyPI` during the dependency resolution phase. Fixed an issue which prevented proper build isolation using `pep517` based builders during dependency resolution. pypa#4231
-   Don\'t fallback to system Python when no matching Python version is found. pypa#4232

Vendored Libraries
------------------

- Updated `pip_shims` to support `--outdated` with new pip versions. pypa#3766
- Update vendored dependencies and invocations
  - Update vendored and patched dependencies
  - Update patches on `piptools`, `pip`, `pip-shims`, `tomlkit`
  - Fix invocations of dependencies
  - Fix custom `InstallCommand` instantiation
  - Update `PackageFinder` usage
  - Fix `Bool` stringify attempts from `tomlkit`
  - Updated vendored dependencies:
    -   **attrs**: `18.2.0 => `19.1.0`
    -   **certifi**: `2018.10.15 => `2019.3.9`
    -   **cached\_property**: `1.4.3 => `1.5.1`
    -   **cerberus**: `1.2.0 => `1.3.1`
    -   **click**: `7.0.0 => `7.1.1`
    -   **click-completion**: `0.5.0 => `0.5.1`
    -   **colorama**: `0.3.9 => `0.4.3`
    -   **contextlib2**: `(new) => `0.6.0.post1`
    -   **distlib**: `0.2.8 => `0.2.9`
    -   **funcsigs**: `(new) => `1.0.2`
    -   **importlib\_metadata** `1.3.0 => `1.5.1`
    -   **importlib-resources**: `(new) => `1.4.0`
    -   **idna**: `2.7 => `2.9`
    -   **jinja2**: `2.10.0 => `2.11.1`
    -   **markupsafe**: `1.0 => `1.1.1`
    -   **more-itertools**: `(new) => `5.0.0`
    -   **orderedmultidict**: `(new) => `1.0`
    -   **packaging**: `18.0 => `19.0`
    -   **parse**: `1.9.0 => `1.15.0`
    -   **pathlib2**: `2.3.2 => `2.3.3`
    -   **pep517**: `(new) => `0.5.0`
    -   **pexpect**: `4.6.0 => `4.8.0`
    -   **pip-shims**: `0.2.0 => `0.5.1`
    -   **pipdeptree**: `0.13.0 => `0.13.2`
    -   **pyparsing**: `2.2.2 => `2.4.6`
    -   **python-dotenv**: `0.9.1 => `0.10.2`
    -   **pythonfinder**: `1.1.10 => `1.2.2`
    -   **pytoml**: `(new) => `0.1.20`
    -   **requests**: `2.20.1 => `2.23.0`
    -   **requirementslib**: `1.3.3 => `1.5.4`
    -   **scandir**: `1.9.0 => `1.10.0`
    -   **shellingham**: `1.2.7 => `1.3.2`
    -   **six**: `1.11.0 => `1.14.0`
    -   **tomlkit**: `0.5.2 => `0.5.11`
    -   **urllib3**: `1.24 => `1.25.8`
    -   **vistir**: `0.3.0 => `0.5.0`
    -   **yaspin**: `0.14.0 => `0.14.3`
    -   **zipp**: `0.6.0`
    - Removed vendored dependency **cursor**. pypa#4169

-   Add and update vendored dependencies to accommodate `safety` vendoring:
    -   **safety** `(none)` => `1.8.7`
    -   **dparse** `(none)` => `0.5.0`
    -   **pyyaml** `(none)` => `5.3.1`
    -   **urllib3** `1.25.8` => `1.25.9`
    -   **certifi** `2019.11.28` => `2020.4.5.1`
    -   **pyparsing** `2.4.6` => `2.4.7`
    -   **resolvelib** `0.2.2` => `0.3.0`
    -   **importlib-metadata** `1.5.1` => `1.6.0`
    -   **pip-shims** `0.5.1` => `0.5.2`
    -   **requirementslib** `1.5.5` => `1.5.6` pypa#4188

-   Updated vendored `pip` => `20.0.2` and `pip-tools` => `5.0.0`. pypa#4215
-   Updated vendored dependencies to latest versions for security and bug fixes:
    -   **requirementslib** `1.5.8` => `1.5.9`
    -   **vistir** `0.5.0` => `0.5.1`
    -   **jinja2** `2.11.1` => `2.11.2`
    -   **click** `7.1.1` => `7.1.2`
    -   **dateutil** `(none)` => `2.8.1`
    -   **backports.functools\_lru\_cache** `1.5.0` => `1.6.1`
    -   **enum34** `1.1.6` => `1.1.10`
    -   **toml** `0.10.0` => `0.10.1`
    -   **importlib\_resources** `1.4.0` => `1.5.0` pypa#4226
-   Changed attrs import path in vendored dependencies to always import from `pipenv.vendor`. pypa#4267

Improved Documentation
----------------------

-   Added documenation about variable expansion in `Pipfile` entries. pypa#2317
-   Consolidate all contributing docs in the rst file pypa#3120
-   Update the out-dated manual page. pypa#3246
-   Move CLI docs to its own page. pypa#3346
-   Replace (non-existant) video on docs index.rst with equivalent gif. pypa#3499
-   Clarify wording in Basic Usage example on using double quotes to escape shell redirection pypa#3522
-   Ensure docs show navigation on small-screen devices pypa#3527
-   Added a link to the TOML Spec under General Recommendations & Version Control to clarify how Pipfiles should be written. pypa#3629
-   Updated the documentation with the new `pytest` entrypoint. pypa#3759
-   Fix link to GIF in README.md demonstrating Pipenv\'s usage, and add descriptive alt text. pypa#3911
-   Added a line describing potential issues in fancy extension. pypa#3912
-   Documental description of how Pipfile works and association with Pipenv. pypa#3913
-   Clarify the proper value of `python_version` and `python_full_version`. pypa#3914
-   Write description for `--deploy` extension and few extensions differences. pypa#3915
-   More documentation for `.env` files pypa#4100
-   Updated documentation to point to working links. pypa#4137
-   Replace docs.pipenv.org with pipenv.pypa.io pypa#4167
-   Added functionality to check spelling in documentation and cleaned up existing typographical issues. pypa#4209
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Category: VCS Type: Bug 🐛 Type: Vendored Dependencies
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants