get_discussions_by_created skips some posts

[roadscape]

In the qm-lessons tag a user authored a series of 4 posts, however one of them doesn't show:
https://steemit.com/created/qm-lessons

The tags appear to be identical between the 2nd and 3rd parts, so it's not clear why one would show and not the other.

Part 2 {"tags":["science","physics","qm-lessons","education","steemSTEM"],...

Part 3 {"tags":["science","physics","qm-lessons","education","steemSTEM"],...

---

Confirmed this issue with direct API call:

> puts @rpc.get_discussions_by_created({limit:20,tag:"qm-lessons"}).map{|p| p['title']}
Quantum mechanics lessons on Steemit - 4 - fundamental physics at the beginning of the 20th century
Quantum mechanics lessons on Steemit - 3 - relevant systems of particles covered by quantum mechanics
Quantum mechanics lessons on Steemit - 1 - context and foundations

[roadscape]

Still an issue:

[pfunks]

I think I am experiencing the same issue.

https://steemit.com/created/tctacotour

Missing:
https://steemit.com/food/@pfunk/twin-cities-taco-tour-taco-tuesday-at-mi-ama
https://steemit.com/food/@pfunk/twin-cities-taco-tour-pineda-tacos-on-lake-street
https://steemit.com/food/@pfunk/twin-cities-taco-tour-taco-cat
https://steemit.com/food/@pfunk/twin-cities-taco-tour-after-dark-andale-taqueria

Sadly this is greatly reducing the use of the custom tag, I intended to link someone local to my set of taco shop reviews (real world utility!) and noticed that half of them were missing, so I told him to look at my whole blog (with many unrelated posts) instead.

[pfunks]

Still experiencing the issue. Will this bug be addressed in the next release?

[roadscape]

Another symptom of the same bug?

steemit/condenser#1474

[mgritter]

I ran into a related issue, but not for recent discussions. I was using the start_author and start_permlink query parameters to walk back through the list of discussions, 100 at a time. For recent discussions this looked reasonable, but at some point this started skipping a lot of articles. For example, the query listed only about 84 discussions in all of May 2018!

Worse, when I identify specific articles from this time period and try using start_author and start_permlink to retrieve discussions, it silently ignores those parameters and starts giving me newly created articles, for example this query:

    query = {
        'start_author' : 'sxms',
        'start_permlink' : 'the-million-dollar-eos-bet',
        'limit' : 100,
        'truncate_body' : 1
    }
     
    s.get_discussions_by_created( query )

As a workaround, I'm retrieving author and permlink from get_block() instead (for a particular time range) and will try looking up the discussions one by one use that information.

I wouldn't mind if get_discussions_by_created doesn't support going back arbitrary far, as long as it clearly signaled an error instead of just behaving strangely. Failure to find the requested auth/permlink should definitely be an error.

[mvandeberg]

Closing, won't fix.

[propertunist]

@mvandeberg Any chance of re-opening this? It continues to quite significantly downgrade the effectiveness of the blockchain as a means of storing and retrieving information. It literally results in an effective loss of data for end users who expect to be able to find what they have deliberately tagged with custom tags.

[netuoso]

Or at least leave some more details in case a community dev wanted to tackle it without wasting time. It seems you are aware of the issue and possibly its cause thats why you closed it will not fix.

[roadscape]

FYI: This call on api.steemit.com is now powered by https://github.com/steemit/hivemind which is not affected by this bug.

[propertunist]

@roadscape excellent, thanks