Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.
Sign upHow do feed readers store their data? #109
Comments
This comment has been minimized.
This comment has been minimized.
jefftriplett
commented
Jan 31, 2019
|
NewsBlur is pretty popular (open source Django app) and uses both Postgres and MongoDB. I linked the project in case the code is helpful. Here is main Feed model: https://github.com/samuelclay/NewsBlur/blob/master/apps/rss_feeds/models.py#L54 |
This comment has been minimized.
This comment has been minimized.
brentsimmons
commented
Jan 31, 2019
|
NetNewsWire uses SQL for articles and read/unread/starred status. It stores feed/folder structure in an OPML file on disk, and it stores feed metadata in an object database. |
This comment has been minimized.
This comment has been minimized.
brentsimmons
commented
Jan 31, 2019
|
Here’s NetNewsWire’s SQL schema: https://github.com/brentsimmons/NetNewsWire/blob/master/Frameworks/ArticlesDatabase/CreateStatements.sql |
This comment has been minimized.
This comment has been minimized.
|
Here's the schema for the feed reader I'm working on.. https://github.com/scripting/Scripting-News/blob/master/misc/feedDatabaseTables.md Very interesting to compare structures. |
Repository owner
deleted a comment from
evanwolf
Feb 1, 2019
This comment has been minimized.
This comment has been minimized.
mblaney
commented
Feb 1, 2019
|
I run a reader at https://unicyclic.com which uses MySQL. |
This comment has been minimized.
This comment has been minimized.
ezraball
commented
Feb 5, 2019
|
I'm not sold on NoSQL in general, but I've played with CouchDB a bit and its multi-source replication is very slick. If I were building a feed reader where a requirement was to sync multiple devices (for read/unread state) I'd consider it. |
scripting commentedJan 31, 2019
•
edited
I've been working on a MySQL version of a RSS feed reader server app. Unlike River5, which stores all data in JSON files, this reader stores all data in a database, and accesses the data via queries.
In the last year, starting with Bingeworthy and then Feedbase, I've learned enough SQL, and have expert help when I need it. Not sure when or if I will release it. I wanted to understand the issues.
I find SQL is an awkward tool for accessing this kind of data. Which got me to wondering how other feed reader apps store their data. I'm supposed to be such an expert on this stuff, and I admit I don't know what they're doing. I wonder if some of them are using object databases.