Skip to content
Switch branches/tags

Latest commit


Git stats


Failed to load latest commit information.
Latest commit message
Commit time


FoodScraps is a webscraping tool designed at the CanDEV Data Challenge (2018) for the Canadian Food Inspection Agency (CFIA). Foodscraps is a solution for the CFIA to explore publicly accessible data about agriculture and agri-food businesses within Canada or exporting to Canada. The scraped data is used to develop a scoring system to know which companies to flag for inspection for a potential uncompliance of CFIA regulations. The developed strategy uses Python (Selenium Webdriver) for webscraping the data and coming up with a score for each company. The scores are then displayed on an interactive webpage using the Google Maps API and Firebase Realtime Database. The red location markers on the map indicate a higher chance of being flagged for inspection, as opposed to the blue location markers, which indicate a lower chance.


Table Of Contents

Getting Started

clone the repository

git clone

change to the project directory

cd FoodScraps

Webscraping Instructions

Navigate to the scripts directory

cd scripts

If Python is not installed on your machine, install it before proceeding

If it is installed, ensure the Python version being used is 3.7.0 or higher

python --version

Then install all dependencies for webscraping and Firebase using pip

pip install selenium
pip install chromedriver
pip install google
pip install pyrebase

Create a free Firebase account and create an empty realtime database with read and write permissions

Navigate to scripts and add your Firebase database information in a file called Use the following format

api_key = "",
auth_domain = "",
database_URL =  "",
project_id = "",
storage_bucket = ""

The scripts are ready to be run in the background!


Website Instructions

From the main project directory, navigate to the website directory

cd website

Navigate to index.html and add your Google Maps API Key

<script async defer src=""></script>

In the same directory, create a config.js file and add your firebase credentials in the following format

var config = {
    apiKey: "",
    authDomain: "",
    databaseURL: "",
    projectId: "",
    storageBucket: "",
    messagingSenderId: ""


The website can now be run from within the website directory

start index.html

Contact Us

For more information, send us an email at


CanDEV Canadian Food Inspection Agency (CFIA) Web Scraping Challenge




No releases published


No packages published

Contributors 4