Django Package Monitor
A Django app for keeping track of dependency updates.
At YunoJuno we have a Django project that includes almost 100 external packages. In order to manage updates to these we have a rolling development task that comes around in the first week of each month, and includes the following:
pip list --outdatedlist out all available updates
- Group updates (using semver) into Major, Minor, Patch, Other
- Apply patch updates in a single update / commit
- Apply minor updates as a group, see what breaks, remove, rinse, repeat
- Take a view on major updates
This task is a PITA, and so we decided to make it simpler.
This project contains a Django app that can be used to monitor your packages.
It consists of a single model,
PackageVersion, an admin list view that you
can use to view current package versions, and load latest versions from PyPI,
and a single management command that can be used to load local requirements and
update remote versions from the shell - which you could run overnight if you
felt the need.
It is important to note that this app does not update your requirements for you - it simply displays the requirements that you have, and the latest that is available on PyPI.
In order to illustrate how it works, the app itself contains a Django project that can be used to demonstrate the feature.
Download / install the app using pip:
pip install django-package-monitor
Add the app
package_monitor to your
INSTALLED_APPS Django setting:
# settings.py INSTALLED_APPS = ( 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.messages', 'django.contrib.staticfiles', 'package_monitor', ... )
PACKAGE_MONITOR_REQUIREMENTS_FILE setting to point to your project
# settings.py PACKAGE_MONITOR_REQUIREMENTS_FILE = path.join(PROJECT_ROOT, 'requirements.txt')
Add the app URLs to your project - NB it must have the namespace set:
# urls.py urlpatterns = patterns( '', url(r'^admin/', include(admin.site.urls)), url(r'^package_monitor/', include('package_monitor.urls', namespace='package_monitor')), )
At this point you should have a working implementation. You can test this by running the management command to load your local requirements:
# load up the local requirements file $ python manage.py refresh_packages --local
This will load all of the requirements it finds in the requirements file specified into the
database. If you then want to check PyPI for updated version, run the command with the
option. You can run both of these command together:
# load up the local requirements file, and check PyPI $ python manage.py refresh_packages --local --remote
If you want to clean out the existing
PackageVersion table before loading the local file, use the
# clear out database, load up the local requirements file, and check PyPI $ python manage.py refresh_packages --clean --local --remote
There is a test suite that can be run using tox:
$ pip install -r requirements $ tox
In addition to the unit tests, the source distribution also includes a fully-functioning Django project, that can be run from the repo root, and used to demonstrate how it works:
$ git clone email@example.com:yunojuno/django-package-monitor.git $ cd django-package-monitor $ pip install -r requirements.txt # you will need to create a superuser in order to access the admin site $ python manage.py createsuperuser $ python manage.py runserver
If you then log in to the app (http://localhost:8000/admin by default), you can then see the admin list page:
If you click on the "Reload local requirements" button in the top-right, it will load up the contents of the requirements file that you used earlier:
NB If any requirements cannot be parsed by the
semantic_version.Version.coerce method, then the
is_parseable property is set to False, and the package is in effect unmanaged.
At this point it has parsed the requirements file, and stored the current working version of
each package (as
current_version). In order to see what the latest versions are, select all the packages,
and choose "Update selected packages from PyPI" form the actions list:
This may take some time, as it will call the PyPI API for each package (excluding those that are
marked as editable), and download the latest version info for each. At the end of this, you should
see the page updated with the new version information (as
latest_version) - as well as the licence
information that is stored in the PyPI metadata:
If you drill down to the detail on an individual package, you can see all of the available versions:
This is by no means complete - it can't cope with requirements that are anything other than '==', and it doesn't (yet) help with updating the requirements file itself. However, it's good enough to be of value, hence releasing it. If you would like to contribute to the project, usual Github rules apply:
- Fork the repo to your own account
- Submit a pull request
- Add tests for any new code
- Follow coding style of existing project
This project is MIT licensed - see the LICENCE file for details.