Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reorganize packaging #111

Merged
merged 2 commits into from Jun 10, 2021
Merged

Reorganize packaging #111

merged 2 commits into from Jun 10, 2021

Conversation

gadomski
Copy link
Member

@gadomski gadomski commented May 11, 2021

This pull request is a major edit of the stactools packaging story. By splitting off packages into their own repositories, we:

  • Provide an easier on-ramp for developers new to stactools to contribute a new dataset package
  • Prevent bitrot in some packages (e.g. landsat) from blocking progress in other datasets or in stactools.core.

Overview

  • Removes all dataset-specific packages and stactools_browse. These packages are being moved to their own repositories in the stactools-packages organization.
  • Add a conda environment.yml file and instructions on running stactools with conda.
  • Improves CI.
  • Adds a stactools.testing module with some testing helper functions to be used by other stactools packages.

Other effects

Path forward

Once this PR is reviewed and approved, I hope to merge it then cut a v0.2.0-alpha.0 release. This release can then be used by packages to get their CI passing.

@gadomski gadomski added this to the v0.2 milestone May 11, 2021
@gadomski gadomski modified the milestones: v0.2.0, v0.3.0 May 28, 2021
@gadomski gadomski added the enhancement New feature or request label Jun 1, 2021
@gadomski gadomski mentioned this pull request Jun 9, 2021
@gadomski gadomski marked this pull request as ready for review June 9, 2021 18:40
@gadomski gadomski requested review from lossyrob and matthewhanson and removed request for lossyrob June 9, 2021 19:13
@gadomski
Copy link
Member Author

gadomski commented Jun 9, 2021

@matthewhanson (and anyone else reviewing), if you can take and extra look at https://github.com/stac-utils/stactools/pull/111/files#diff-2e3c7d1bc0706a094cc1cac241569dd21973b559d51dd45b0640ef1ee7600e29 during the review, this is some of the tomfoolery I had to do to get the test path stuff working.

Copy link
Contributor

@jbants jbants left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't get to in depth into the scripts folder

README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
docs/index.rst Outdated Show resolved Hide resolved
Copy link
Collaborator

@cuttlefish cuttlefish left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've run across some problems while porting the aster subpackage.
Most of the tests are working, but one of them requires a custom build GDAL. I've got some ideas about how we can structure the Docker images. We can discuss it tomorrow.

src/stactools/testing/test_data.py Show resolved Hide resolved
docker/Dockerfile Show resolved Hide resolved
@gadomski gadomski mentioned this pull request Jun 10, 2021
2 tasks
gadomski added a commit to stactools-packages/template that referenced this pull request Jun 10, 2021
- Removes all subpackages other than `core` and `cli`
- Moves code into a more traditional package namespace structure in
  `src`
- Switches to a static `setup.cfg` file
- Adds more CI, including actually testing the Python matrix
- Updates .gitignore
- Updates README
This allows packages to use test utils without having to copy the code
directly.
@gadomski gadomski merged commit e294375 into stac-utils:master Jun 10, 2021
@gadomski gadomski deleted the feature/reorganization branch June 10, 2021 19:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
4 participants