Skip to content

end-to-end emergency data scrapy project with geographical data visualizetion.

Notifications You must be signed in to change notification settings

damakes/scrapy-emergency-data-finland

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

scrapy-emergency-data-finland

Scrapy spider project for emergency & incident data collection of Finland.

Visit the interactive map: Scrapy Emergency Data Finland 🖱️

Project Features

  1. Scraping: crawl and scrape emergency and incident data from website.
    1. Tracking & blocking prevention: Integrated with ScrapeOps API for user-agent & headers creation.
  2. Cleaning: Scrapy Items and Item Pipelines to clean and structure the data.
  3. Storage: Save the cleaned data into CSV files for further analysis.
  4. Visualization: Geographical distribution of incidents using Folium maps.