Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

May-24-Data-Uploads #3405

Merged
merged 15 commits into from May 15, 2024
Merged

May-24-Data-Uploads #3405

merged 15 commits into from May 15, 2024

Conversation

cthomasONRR
Copy link
Collaborator

@cthomasONRR cthomasONRR commented Apr 19, 2024

😎 PREVIEW

Changes proposed in this pull request:

  • CY23 production data
  • Jan 24 monthly production data
  • Jan 24 monthly OGOR-B data
  • Moved 2013 OGOR-B data into the Historical file (DORC will only be updating from 2014 onward now).
  • April 24 monthly revenue data
  • April 24 monthly disbursement data
  • Updated the BIA FAQ link in Native American Ownership and Governance webpage
  • Removed the "train the trainer" link in Plan Language webpage
  • Removed extra sitemap.xml file
  • Updated robots.txt to remove archived site, added pattern library to be disallowed, and changed sitemap to the one we are keeping
  • Added robots-dev.txt to block preview & dev sites from being crawled
  • Added No Fear Act link to footer

@cthomasONRR cthomasONRR added the Maintenance Regular updates and other maintenance. label Apr 19, 2024
@cthomasONRR cthomasONRR self-assigned this Apr 19, 2024
@cthomasONRR cthomasONRR changed the title May-25-Data-Uploads May-24-Data-Uploads Apr 19, 2024
@cthomasONRR
Copy link
Collaborator Author

cthomasONRR commented Apr 19, 2024

Production Calendar Year
NOTE: "Mixed Exploratory" land category is removed from the product totals seen in Query and Explore.

  • Make sure the downloaded data matches the raw data. Raw data saved here (Insert Teams link to raw file)

Explore Data - Map and Detail Card

  • Select a year and select a state with data, verify information on the detail cards are correct as well as the Production Over Time line graph. Repeat with the latest available year.

    • Period - Calendar Year
    • With 2-3 additional commodities
  • Select a year and select a county with data, verify information on the detail cards are correct as well as the Production Over Time line graph. Repeat with the latest available year.

    • Period - Calendar Year
    • With 2-3 additional commodities
  • Select a year and select an offshore area, verify information on the detail cards are correct as well as the Production Over Time line graph. Repeat with the latest available year.

    • Period - Calendar Year
    • With 2-3 additional commodities
  • Select a state and county without data and verify the expected information is displayed.

  • Add Nationwide Federal Card and verify the expected information is displayed

  • Add Native American Card and verify the expected information is displayed..

Explore Data - Nationwide Production Summary and Top Nationwide Locations

  • Verify breakdowns by production type and source are correct as well nationwide locations for the conditions below.
    • Not current Calendar Year
    • Current Calendar Year

Query Data, in the 'Period' category, filter to either 'Calendar Year' or 'Fiscal Year' and check the following:

  • One Land Type filter
  • One State
  • One Offshore Region
  • One to three Product
  • Downloads matches filtered data

Download Page

  • Dates and file size are correct for csv and excel

@cthomasONRR
Copy link
Collaborator Author

@greensomes This doesn't need to be fixed today. Just want to give you a heads up that I uploaded the new calendar year production data, and I'm not seeing CY23 present in Query Data. For Explore, the year slider at the top shows CY23, but no data is present when you select it. This dataset adds CY23 but also updates previous CYs. I updated the .yaml in changelog-data. Please let me know if there's anything I can do to help!

@cthomasONRR
Copy link
Collaborator Author

@greensomes Also, it looks like "Geothermal - Direct Use, Millions of Gallons (cgal)" within the raw data did not make it to the PR

@cthomasONRR
Copy link
Collaborator Author

CY23 production data looks good!

…d archive site from robots and added pattern library page to be ignored from indexing
@cthomasONRR
Copy link
Collaborator Author

cthomasONRR commented May 6, 2024

Production Monthly

  • Make sure the downloaded data matches the raw data. Raw data saved here (Insert Teams link to raw file)

Homepage - Yearly Breakdown

  • Select a year and verify the amounts and comparisons are correct for the conditions below. Repeat with the most recent year.
    • Period - Fiscal Year
    • Period - Calendar Year
    • Commodity - Oil (bbl)
    • Commodity - Gas (mcf)
    • Commodity - Coal (tons)

Homepage - Monthly Breakdown

  • Select a month and verify the amounts and comparisons are correct for the conditions below. Repeat with the most recent month. Be sure to verify negative numbers are correct if applicable
    • Period - Most recent 12 months
    • Period - Fiscal Year
    • Period - Calendar Year
    • Commodity - Oil (bbl)
    • Commodity - Gas (mcf)
    • Commodity - Coal (tons)

Homepage - Source File

  • Check source file links are correct.

Query Data - In the 'Period' category, filter to 'Monthly' and check the following:

  • One Land Type filter
  • One to three Products
  • Downloads matches filtered data

Download Page

  • Dates and file size are correct for csv and excel

Monthly Snap Shot

  • Check graphs match homepage

@cthomasONRR
Copy link
Collaborator Author

cthomasONRR commented May 6, 2024

Revenue Monthly

  • Make sure the downloaded data matches the raw data. Raw data saved here (Insert Teams link to raw file)

Homepage - Yearly Breakdown

  • Select a year and verify the amounts and comparisons are correct for the conditions below. Repeat with the most recent year.
    • Period - Fiscal Year
    • Period - Calendar Year
    • Breakout - Source
    • Breakout - Revenue Type
    • Breakout - Commodity

Homepage - Monthly Breakdown

  • Select a month and verify the amounts and comparisons are correct for the conditions below. Repeat with the most recent month. Be sure to verify negative numbers are correct if applicable
    • Period - Most recent 12 months
    • Period - Fiscal Year
    • Period - Calendar Year
    • Breakout - Source
    • Breakout - Revenue Type
    • Breakout Commodity

Homepage - Source File

  • Check source file links are correct.

Query Data - In the 'Period' category, filter to 'Monthly' and check the following:

  • One Land Type filter
  • One Revenue Type filter
  • One State
  • One Offshore Region
  • One to three Commodities
  • Clear All and change grouping
  • Downloads matches filtered data

Download Page

  • Dates and file size are correct for csv and excel

Monthly Snap Shot

  • Check graphs match homepage

@cthomasONRR
Copy link
Collaborator Author

@greensomes I added April monthly revenue data... the April data is present in the PR but the March data disappeared:

image

The file is still in the database though:
image

@cthomasONRR
Copy link
Collaborator Author

@lpgoldstein The No Fear footer link is ready for your review. Thanks!

@cthomasONRR
Copy link
Collaborator Author

@greensomes I now see March monthly revenue in Homepage & Query data, but it is not present in the download files https://nrrd-preview.app.cloud.gov/sites/May-24-Data-Uploads/downloads/revenue/

@cthomasONRR
Copy link
Collaborator Author

Monthly revenue and production data look good!

@lpgoldstein
Copy link
Collaborator

lpgoldstein commented May 15, 2024

Disbursements Monthly April 2024 @lpgoldstein

  • Make sure the downloaded data matches the raw data. Raw data
  • Note: Make sure both datasets have the same sum. If there are line items that have the same fund type, revenue type, and location, they will be 'rolled up' together so the line item count may differ between the raw data and downloaded data.
  • Check Treasury Fund column is deleted
  • Check Hidalgo Caounty is changed to Hidalgo County under county column
  • Check "BLM - Permit Processing and Improvement" is changed to to "Lease Processing and Improvement" (BLM) under fund type column

Homepage - Yearly Breakdown

  • Select a year and verify the amounts and comparisons are correct for the conditions below. Repeat with the most recent year.

  • Breakout - Source

  • Breakout - Recipient

Homepage - Monthly Breakdown

  • Select a month and verify the amounts and comparisons are correct for the conditions below. Repeat with the most recent month. Be sure to verify negative numbers are correct if applicable
  • Period - Most recent 12 months
  • Period - Fiscal Year
  • Period - Calendar Year
  • Breakout - Source
  • Breakout - Recipient

Query Data - In the 'Period' category, filter to 'Monthly' and check the following:

  • One Recipient
  • One Source
  • One State
  • One to three Commodities if applicable
  • Clear All and change grouping
  • Downloads matches filtered data

Download Page

  • Dates and file size are correct for csv and excel

Monthly Snap Shot

  • Check graphs match homepage

@lpgoldstein
Copy link
Collaborator

@AlexandracmONRR disbursements looks good as well. I think we can merge this to dev. Do you want me to do that?

@AlexandracmONRR AlexandracmONRR merged commit 1ee685c into dev May 15, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Maintenance Regular updates and other maintenance.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants