Biggest user-facing change was allowing nested directories in a
custom-dir.

Internally we did a bit of refactoring to accommodate this, most notably
switching to pytest from the now deprecated nosetests.