Skip to content
This repository has been archived by the owner on Feb 21, 2024. It is now read-only.
/ ubereats-scrapy Public archive

This repository contains the source code for a basic exercise of scraping, gecoding and visualization of restuarant data from the Ubereats website in Colombia.

Notifications You must be signed in to change notification settings

fabiancpl/ubereats-scrapy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Ubereats scrapy

OPEN VIZ

This repository contains the source code for a basic exercise of scraping, gecoding and visualization of restuarant data from the Ubereats website in Colombia. The folder description is as follows:

  • ubereatsscrapy: A python scrapy project for extracting the restaurant data from Ubereats and downloading in JSON format. The excercise can be reproduced by running scrapy crawl restaurants -o ../data/restaurants.json
  • geocoding: Using the Google Maps API, restaurant addresses are geocoded. A simple data cleaning and profiling is also performed. The libraries used are pandas, geopandas, pandas-profiling and googlemaps.
  • data: Restaurant data stored for three different steps (JSON raw from Ubereats, JSON clean and GeoJSON clean for restaurants geocoded)
  • visualization: A simple Javascript project for visualizing the result. This visualization is deployed here. The libraries used are D3, Vega-Lite and Mapbox GL.

I was able to extract information for 1,181 restaurants in 9 colombian cities. This excercise can be extended by extracting similar information from the Domicilios website, another popular website for food delivery.

About

This repository contains the source code for a basic exercise of scraping, gecoding and visualization of restuarant data from the Ubereats website in Colombia.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages