removing lib/<module>.pypi after initial build fails

[adam-stokes]

I have 2 files in lib/:

lib/
   requests.pypi
   pep8.pypi

Their contents only contain the module name required. Next I run charm-compose and it builds successfully and includes both pep8 and requests modules in the final lib/ directory.

Now if you remove lib/requests.pypi and re-run charm-compose you get an unexpected file failure:

‹master*› »»»» charm-compose -l DEBUG                                                                      0|22:35:18
composer: Composing into /home/adam/charms
composer: {
  "COMPOSER_PATH": null, 
  "INTERFACE_PATH": null, 
  "JUJU_REPOSITORY": "/home/adam/charms", 
  "_charm": ".", 
  "_name": "node", 
  "config": "<charmtools.compose.config.ComposerConfig object at 0x7fef5deb2a90>", 
  "deps": "/home/adam/charms/deps/trusty", 
  "force": false, 
  "interface_service": "http://interfaces.juju.solutions", 
  "log_level": "DEBUG", 
  "output_dir": "/home/adam/charms", 
  "repo": "/home/adam/charms/trusty", 
  "series": "trusty", 
  "target_dir": "/home/adam/charms/trusty/node"
}
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/__init__.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/connection.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/sbcharsetprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/langbulgarianmodel.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/gb2312prober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/utf8prober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/mbcssm.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/util/request.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/charsetprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/euctwprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/constants.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/compat.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/universaldetector.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/escsm.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/poolmanager.py
composer: Added unexpected file, should be in a base layer: lib/requests-2.8.1.dist-info/metadata.json
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/fields.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/_collections.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/packages/ssl_match_hostname/__init__.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/exceptions.py
composer: Added unexpected file, should be in a base layer: lib/requests/certs.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/__init__.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/jpcntx.py
composer: Added unexpected file, should be in a base layer: lib/requests/api.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/sjisprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/util/response.py
composer: Added unexpected file, should be in a base layer: lib/requests/utils.py
composer: Added unexpected file, should be in a base layer: lib/requests/structures.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/util/__init__.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/util/connection.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/packages/ordered_dict.py
composer: Added unexpected file, should be in a base layer: lib/requests-2.8.1.dist-info/METADATA
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/connectionpool.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/packages/ssl_match_hostname/_implementation.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/big5freq.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/util/timeout.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/contrib/ntlmpool.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/euckrprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/langcyrillicmodel.py
composer: Added unexpected file, should be in a base layer: lib/requests/compat.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/util/url.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/response.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/chardistribution.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/langgreekmodel.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/escprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/big5prober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/charsetgroupprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/status_codes.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/contrib/appengine.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/hebrewprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/auth.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/langhungarianmodel.py
composer: Added unexpected file, should be in a base layer: lib/requests/exceptions.py
composer: Added unexpected file, should be in a base layer: lib/requests/__init__.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/request.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/mbcharsetprober.py
composer: Added unexpected file, should be in a base layer: lib/requests-2.8.1.dist-info/DESCRIPTION.rst
composer: Added unexpected file, should be in a base layer: lib/requests/cacert.pem
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/euctwfreq.py
composer: Added unexpected file, should be in a base layer: lib/requests-2.8.1.dist-info/top_level.txt
composer: Added unexpected file, should be in a base layer: lib/requests/packages/__init__.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/util/ssl_.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/contrib/pyopenssl.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/packages/six.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/euckrfreq.py
composer: Added unexpected file, should be in a base layer: lib/requests-2.8.1.dist-info/RECORD
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/latin1prober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/gb2312freq.py
composer: Added unexpected file, should be in a base layer: lib/requests/hooks.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/jisfreq.py
composer: Added unexpected file, should be in a base layer: lib/requests/adapters.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/eucjpprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/cookies.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/filepost.py
composer: Added unexpected file, should be in a base layer: lib/requests/models.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/contrib/__init__.py
composer: Added unexpected file, should be in a base layer: lib/requests-2.8.1.dist-info/WHEEL
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/langthaimodel.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/sbcsgroupprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/codingstatemachine.py
composer: Added unexpected file, should be in a base layer: lib/requests/sessions.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/mbcsgroupprober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/cp949prober.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/chardetect.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/chardet/langhebrewmodel.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/util/retry.py
composer: Added unexpected file, should be in a base layer: lib/requests/packages/urllib3/packages/__init__.py
Traceback (most recent call last):
  File "/usr/bin/charm-compose", line 9, in <module>
    load_entry_point('charm-tools==1.7.1', 'console_scripts', 'charm-compose')()
  File "/usr/lib/python2.7/dist-packages/charmtools/compose/__init__.py", line 468, in main
    composer()
  File "/usr/lib/python2.7/dist-packages/charmtools/compose/__init__.py", line 392, in __call__
    self.validate()
  File "/usr/lib/python2.7/dist-packages/charmtools/compose/__init__.py", line 384, in validate
    "Unable to continue due to unexpected modifications (try --force)")
ValueError: Unable to continue due to unexpected modifications (try --force)

I also noticed that subsequent charm-compose commands do not clean out the existing final charm's python dependencies.

[marcoceppi]

This issue was moved to juju/charm-tools#19