Skip to content

Parse pdf reports covering renewable energy statistics published by the Czech Ministry of Trade and Industry to csv

License

Notifications You must be signed in to change notification settings

jandolezal/mpo-oze

Repository files navigation

Renewables in YYYY

The Czech Ministry of Industry and Trade (Ministerstvo průmyslu a obchodu, MPO) each year publishes a statistical report Renewable Energy Resources in YYYY in the form of a PDF file which contains statistics about renewable energy production in the country.

This package provides two commands for scraping links to these PDF reports and parsing tables in ther reports (for selected year).

One script scrapes links to these PDF reports from the website and saves them to CSV.

Another script parses selected pdf report using Camelot:

  • reads data tables,
  • removes spaces between numbers and
  • saves tables as CSV files in the directory for the relevant year. It also saves one Excel file for the year (one worksheet per table).

Instalation

python3 -m venv venv

pip install mpo-oze

Usage

# Scrape links to csv file
mpo links

# Parse 2020 report
mpo pdf -y 2020

# Show 2019 report in a browser
mpo show -y 2019

# Parse only tables from page 5
mpo pdf -y 2020 -p 5
usage: mpo [-h] [-y YEAR] [-p PAGES] {links,pdf,show}

parse czech renewable energy pdf reports

positional arguments:
  {links,pdf,show}      scrape links to reports, parse report or show report
                        in a browser

optional arguments:
  -h, --help            show this help message and exit
  -y YEAR, --year YEAR  select report year of interest (default: 2020)
  -p PAGES, --pages PAGES
                        select pages, e.g. 1,3-5,7-end (default: 2-end)

About

Parse pdf reports covering renewable energy statistics published by the Czech Ministry of Trade and Industry to csv

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages