Skip to content

rafabelokurows/github-actions-r

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Github Actions and automating data collection using R

Goals

  1. Learn how to use Git Hub Actions - at least in a very basic sense - to start automating boring data collection tasks that I do in projects at work or for fun.
  2. Start collecting data that could prove useful in the future for various reasons.

Therefore, I've created three diferent R scripts to scrape and process data from different sources with varying degrees of difficulty and for different uses.

Roadmap

  • Check fueleconomy.gov's API definition to see if there are other useful endpoints to call
  • Start diving into the Google Traffic data to determine patterns
  • Plot a map of store locations in relation to population density

Data collection pipelines

Scraping US fuel prices

Origin: fuelconomy.gov
Frequence: Daily

Scraping US gas prices

Scraping Google traffic data

Origin: Google Maps API
Frequence: Three times per day

Obtaining traffic data