New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Index generation for clojurians-log app? #82
Comments
Thanks for reminding me to look into this. My suspicion is it's actually CloudFlare that's caching things too aggressively. Because of past performance issues we've cached as much as possible at multiple levels (nginx, cloudflare), but these days we're fairly healthy so that's probably not necessary any more. You can bypass cloudflare by going to clojurians-log-internal.clojureverse.org , that way you're connecting directly to the VPS. |
And bingo, going to: https://clojurians-log-internal.clojureverse.org/shadow-cljs I can see the logs for days after the 1st March. Thanks for the quick response. What needs to be tweaked here to get CloudFlare to not be so aggressive? |
Good question... looking at CloudFlare I don't see any relevant settings, which may mean that it's really up to the app to set appropriate expiration times in headers. Checking with curl, these are the headers I get back, which don't contain any expiration time. We do have them on the pages for individual dates it seems, so maybe we just need to set them on the index pages as well.
Would you have time to and be interested to look into that? CloudFlare settings, nothing to see here: |
I would be interested in looking into this, but not today. So if you don't mind delegating it to me... :) |
Not at all! |
I purged the CloudFlare cache so the problem is over for now :) |
Looking at the index of
shadow-cljs
logs, the latest log I see right now is for 1st March.https://clojurians-log.clojureverse.org/shadow-cljs
But looking at some other index, say for
announcements
, I can see the log from yesterday, 8th March.Just to be clear, once you go into the page for 1st March:
https://clojurians-log.clojureverse.org/shadow-cljs/2020-03-01
and click on the "next" arrow, to go to the next date, you'll to the logs of any day where the logs exist.
It's just the indexing that is a bit off.
Looked at the indexing:
https://github.com/clojureverse/clojurians-log-app/blob/1eeab540241ad0743d24d461fca40d51016cb782/src/clojurians_log/components/indexer.clj
Which from my understanding should generate this index every 6000000 milliseconds.
So something must not be working as expected (or at least, the way I understand it), which prevents the indexes from being generated.
I did try to access the
shadow-cljs
index page in different browsers and they all show the same issue, as described above.The text was updated successfully, but these errors were encountered: