-
Notifications
You must be signed in to change notification settings - Fork 7
Closed
Labels
Description
With the introduction of the advanced scraper in #59, we may not need the original '5 minute scraper'. This issue has been brought up in #60 as we try and consolidate to a streamlined data model.
The new data from the advanced scraper could be served up with the api, and give us a consistent format for accessing the data. Right now, the two different data formats make the methods for accessing data from new and old data a pain to manage.
For this research to be done, we need to see if My Portal records incremental seat changes in the advanced dataset. If we can monitor those changes overtime, then we can verify that the advanced scraper can be used as a replacement for the old '5 minute scraper'