Bug: Community list for lemmy.world returns for all page numbers

[tgxn]

Describe the bug

this should obviously return []...
https://lemmy.world/api/v3/community/list?limit=50&page=1220000&type_=Local&show_nsfw=true

[tgxn]

This causing issues as the scan never finishes 🤧

all pages after a valid one, seem to return the first pages results?

https://lemmy.ml/api/v3/community/list?limit=50&page=1000034234&type_=Local&show_nsfw=true
returns as expected

[tgxn]

Weird issue, I've reached out to lemmy.world admin, and for now scans of lemmy.world are disabled.

[tgxn]

They are still having these issues :| I did a bit more digging, and CF is responding with DYNAMIC - so this should mean that the response is coming directly from their backend, which would indicate a possible misconfiguration on their backend proxy/load balancing infrastructure. :/

I am thinking I could run a "special" hacky scan for Lemmy.world to retrieve only the first 100 pages from their instance, as that is all that seems to be returned successfully...

It means we'll get random communities, but at least it's something 🤷‍♂️

[freamon]

I wondered if you'd have to resort to something hacky. Did you not get a sense from the LW admin that they're willing/able to fix the issue?

There's a lot of junk communities on LW, but the LemmyVerse seems half-empty without it, so I hope something is able to be done (even if it means you hacking it).

[Mereo]

There's a lot of junk communities on LW, but the LemmyVerse seems half-empty without it, so I hope something is able to be done (even if it means you hacking it).

Indeed. I'm currently finding lemmyverse less useful because lemmy.world communities are not listed.

[SigurdVie]

@tgxn Hey! I've sendt you a e-mail on how we might solve this issue. I am an admin from Lemmy.World (MrCenny). Sorry for it taking so long 😊

[tgxn]

we're back in action for now :D I'll close this once the lemmy world communities get published.

[tgxn]

We're back!