Worker that loads and retrieves data from slow endpoints.
C# JavaScript F# Other
Latest commit cad9de5 Aug 31, 2015 @robertmuehsig robertmuehsig vs2015 setting
Permalink
Failed to load latest commit information.
.nuget
build
src vs2015 setting Aug 31, 2015
tests sloader tests and ui enhanced Aug 31, 2015
.gitignore vs2015 setting Aug 31, 2015
LICENSE Initial commit Dec 21, 2014
NuGet.config nuget all the things Mar 19, 2015
README.md TwitterUserCrawler added Jul 14, 2015
Sloader.sln init Aug 25, 2015
appveyor.yml vs2015 setting Aug 31, 2015
build.cmd nuget update Aug 6, 2015

README.md

Sloader

Worker that loads and retrieves data from slow endpoints.

The "master" branch is running (for demo purpose, you can deploy it whereever you want) here:

Sloader Dashboard

Sloader Result

Sloader.sln Build Status: Build status

Build.cmd Build Status: Build status

General Idea

Sloader should help to load data from very different apis and store the results somewhere (e.g. as JSON in Azure Blob Storage(

Component: SloaderRunner

With a given config the 'SloaderRunner' should start the various Crawler and store the results.

Component: Crawler

Each 'source' has it's own crawler. Currently shipped:

  • FeedCrawler (incl. Comments-Count & Facebook & Twitter Shares)
  • TwitterTimelineCrawler
  • TwitterUserCrawler