Skip to content
This repository has been archived by the owner on Dec 14, 2023. It is now read-only.

add feed scraping to media source page #238

Closed
6 tasks
rahulbot opened this issue Feb 7, 2017 · 1 comment
Closed
6 tasks

add feed scraping to media source page #238

rahulbot opened this issue Feb 7, 2017 · 1 comment

Comments

@rahulbot
Copy link
Contributor

rahulbot commented Feb 7, 2017

We need to add feed scraping support to the media source detail page. This includes:

  • a new SourceFeedInfoContainer DataCard that lives under the "Metadata" card on the media source detail page (pass it the media object from the store as a param)
  • moving the "Content from over 100 RSS feeds" info from the intro summary paragraph on that page down to this new "SourceFeedInfoContainer"
  • moving the "see all feeds" link from the intro summary paragraph to a standard "explore" action arrow icon on the data card
  • adding a call to the new user_mc.feedsScrapeStatus method to the existing api_media_source_details call in source.py (ie. info['feed_scrape_status'] = user_mc.feedsScrapeStatus(media_id) or something)
  • displaying the feed_scrape_status on the new data card (visible to only the PERMISSION_MEDIA_EDIT role)
  • a "scrape feeds" button on the data card (visible to only the PERMISSION_MEDIA_EDIT role) that calls a new server endpoint that calls user_mc.feedsScrape(media_id) method. this should be disabled if the latest scrape status has a state of queued or running (ie. don't let the user run two scrapes at once). it should refresh the data card after the call succeeds so they see the new status

I'm picturing a data card that looks like this:


Feed Info (->)

We are scraping content for this source from over 100 RSS Feeds.

Last Scraped: July 10, 2016
Last Scraping Status: Completed

SCRAPE THIS SOURCE FOR FEEDS


What am I forgetting?

@rahulbot rahulbot modified the milestones: v1.3.0 - mid Feb, v1.4.0 - March Feb 7, 2017
@rahulbot rahulbot assigned cindyloo and rahulbot and unassigned cindyloo Feb 12, 2017
@rahulbot rahulbot modified the milestones: v1.3.0 - mid Feb, v1.4.0 - March Feb 17, 2017
@rahulbot
Copy link
Contributor Author

I rethought this a bit to simplify and put in a quick fix to the v1.3.0 release

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants