Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NCES public schools data 2020-21 upload #45941

Merged
merged 5 commits into from Apr 23, 2022
Merged

NCES public schools data 2020-21 upload #45941

merged 5 commits into from Apr 23, 2022

Conversation

clareconstantine
Copy link

@clareconstantine clareconstantine commented Apr 22, 2022

This PR adds code to import 2020-2021 NCES data. The files containing the data are on S3. The dry_run field is set to true so that I can run these manually the first time and make sure they succeed. I'll follow up with a separate PR setting that field to false so this year's data will be seeded automatically in the future.

Links

Testing story

Deployment strategy

Follow-up work

I'll follow up with a PR setting the dry_run field to false so that this year's data will be automatically seeded in the future, and there will also be a PR to upload the private school data.

Privacy

Security

Caching

PR Checklist:

  • Tests provide adequate coverage
  • Privacy and Security impacts have been assessed
  • Code is well-commented
  • New features are translatable or updates will not break translations
  • Relevant documentation has been added or updated
  • User impact is well-understood and desirable
  • Pull Request is labeled appropriately
  • Follow-up work items (including potential tech debt) are tracked and linked

@clareconstantine clareconstantine requested review from tim-dot-org and a team and removed request for a team April 22, 2022 17:53
Copy link
Contributor

@tim-dot-org tim-dot-org left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me!

'Supplemental Virtual' => 'No',
'Virtual with face to face options' => 'Yes',
'–' => nil,
'†' => nil
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we need these characters in the hashes?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They're in the raw data as their own values, do you have an example file, clare?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes! Here are the files in drive which explain the symbols. (I removed the extra rows at the top and bottom before uploading them to S3)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants