Dynamic refresh rate

[Athou]

Find a way to refresh feeds faster for online (active?) users or something

[joshmatz]

Do you mean polling or importing new feed items into the DB?

---

If you mean polling, then I would think that ideally you wouldn't have to poll and you could do something with web sockets in real time. I'm not familiar with Java or TomEE so I'm not sure how possible it is but I found this article that seems like it could be helpful: http://rmannibucau.wordpress.com/2012/05/15/tomee-or-how-to-use-websocket-with-cdi/

After further investigation I found a web socket framework (again, not sure if it's relevant :\ ): https://github.com/Atmosphere/atmosphere

---

If you mean importing new items... I took a look through the code and it looks to me like this runs every 15 seconds:

foreach feed that hasn't been updated in the past minute
    check header
    if header is new get new items
    mark as updated
endforeach

Is that correct? If it isn't, just ignore this. I'm not entirely sure it's necessary to continuously loop through every feed every minute. I'm thinking it might be more useful to use a formula to help reduce the need to loop through every feed. Something like the standard deviation of time between the 10 most recent entries and just setting a next_update on the Feed.

I dunno. But I'd imagine there's quite a few feed subscriptions out there that would be for feeds that just aren't necessary to check for updates every minute.

[Athou]

I was more thinking about background refresh of feeds. At the moment the feed selection algorithm is rather stupid as you found out and there's room for improvement. Using time distribution is an interesting idea indeed.

[oracle2b]

Can you have make the feeds have their own refresh time apart from global refresh? It's functionality i got use to in Opera RSS. e.g every 15min / 30min / 1hour / 2 hours / 3/ hour etc

[Athou]

I'll look into pubsubhubbub now.

[julien51]

Any news on the PubSubHubbub front?

[Athou]

PubSubHubbub is supported by CommaFeed.