New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CEPCO - Add old data before loading to BigQuery #45

Open

FraserTooth opened this issue Mar 19, 2021 · 0 comments

Owner

FraserTooth commented Mar 19, 2021

At present we run the calculations based on the available data on the website.
However, CEPCO only gives us the past 3 years, all in one file https://www.energia.co.jp/nw/service/retailer/data/area/

We need to:

Adjust scraping system for CEPCO, so that after scraping is done, we add on older data from Google Storage to the data frame before upload.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment