update the 860m doi

[cmgosnell]

Overview

Closes #3186.

What problem does this address?
We had to make a new zenodo archive with eia860m a years worth of monthly files zipped together into one resource because file upload limits. So this pr

What did you change?
basically nothing except the DOI. bc @e-belfer added a little logic into the datastore to work with partitions that are lists of partitions. And the excel extractor/the datastore combined already knows how to grab a file out of a zipped file bc of course it does bc so many of our one partition resources have many files. The main place where this is happening is load_excel_file.

We could remove the first try in load_excel_file because the old eia860m archive being individual files was actually the edge case.

Testing

How did you make sure this worked? How can a reviewer verify this?
I ran the fast etl locally. But first I thought I was going to have to muck with the excel extractor so I setup a little notebook testing situation and the simplest setup gave me the eia860m outputs:

from pudl.extract.eia860m import Extractor
from pudl.workspace.datastore import Datastore

ds = Datastore(local_cache_path=pudl.workspace.setup.PudlPaths().pudl_input)
self = Extractor(ds=ds)
raw_eia860m_dfs = self.extract(year_month=pudl.metadata.sources.SOURCES["eia860m"]["working_partitions"]["year_month"])

To-do list

Edit tasklist title

Beta Give feedback Tasklist To-do list, more options

• Rename
• Copy markdown
• Delete tasklist

Delete tasklist

Delete tasklist block?

Are you sure? All relationships in this tasklist will be removed.

Cancel Delete

1. Make sure full ETL runs & `make pytest-integration-full` passes locally

   Make sure full ETL runs & make pytest-integration-full passes locally
   Options

   • Convert to issue
   • Toggle completion
   • Rename
   • Remove
2. For major data coverage & analysis changes, [run data validation tests](https://catalystcoop-pudl.readthedocs.io/en/latest/dev/testing.html#data-validation)

   For major data coverage & analysis changes, run data validation tests
   Options

   • Convert to issue
   • Toggle completion
   • Rename
   • Remove
3. If updating analyses or data processing functions: make sure to update or write data validation tests

   If updating analyses or data processing functions: make sure to update or write data validation tests
   Options

   • Convert to issue
   • Toggle completion
   • Rename
   • Remove
4. Update the [release notes](../docs/release_notes.rst): reference the PR and related issues.

   Update the release notes: reference the PR and related issues.
   Options

   • Convert to issue
   • Toggle completion
   • Rename
   • Remove
5. Review the PR yourself and call out any questions or issues you have

   Review the PR yourself and call out any questions or issues you have
   Options

   • Convert to issue
   • Toggle completion
   • Rename
   • Remove

Add item to To-do list Loading

[e-belfer]

Looks good! I'll do the final validation in the CEMS branch.

[zaneselvans]

The change to allow lists in the partitions has broken the docs build script, which reads those partitions to generate the dataset docs and.

[e-belfer]

The change to allow lists in the partitions has broken the docs build script, which reads those partitions to generate the dataset docs and.

Already on it!

[zaneselvans]

The documentation build script isn't expecting to find lists in the partitions, and so is failing when it attempts to build the data source specific docs pages using the Jinja templates. It needs to be updated to accommodate the new metadata structure associated with the newly bundled raw archives.