Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 

#Target Store Location Scraper - Socrata Open Data

This C# Console App scrapes Target.com's website for store locations and pushes it up to Socrata for open data sharing.

This runs as a scheduled WebJob on Azure once a month. See the results at Open Data.

##Usage Modify the App.config with your own Socrata API key, username, password, and Dataset Resource Id

##Dependencies

##Misc The State URLs on Target's site are hardcoded as they aren't quite scrapable. They weirdly load in data via AJAX. It was just easier this way.

They load in the store locations via JSON payload in a hidden div that's rendered server side. That gets parsed out and mapped to the Store object. Weird, right?

##License This doesn't do much. Do what you want with it. Attribute me, don't attribute me, I don't really care. Use it an example to see how to push data to Socrata Open Data.

About

Scrapes Target's website for store location data and uploads to Socrata open data.

Resources

Releases

No releases published

Packages

No packages published

Languages