Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clips API missing many clips even for small time ranges #48

Open
willlllllio opened this issue Jan 31, 2020 · 3 comments
Open

Clips API missing many clips even for small time ranges #48

willlllllio opened this issue Jan 31, 2020 · 3 comments
Labels
product: api API endpoints in the "helix" namespace ticketed Has been given an internal tracking ticket

Comments

@willlllllio
Copy link

Brief description

Time range based Clips API requests will often be missing many clips

How to reproduce

curl -H "$authheader" 'https://api.twitch.tv/helix/clips?broadcaster_id=69906737&started_at=2020-01-15T18:40:00Z&ended_at=2020-01-15T18:50:00Z&first=100'

Returns around 16 clips total, no pagination token "pagination":{}:

(only posting created_at and id for clarity)

2020-01-15T18:40:22Z        AgitatedHotGazelleNotLikeThis
2020-01-15T18:41:39Z        SaltyLitigiousBisonRlyTho
2020-01-15T18:42:23Z        EncouragingConcernedCookieCharlietheUnicorn
2020-01-15T18:43:21Z        PunchyGlutenFreeWoodcockFutureMan
2020-01-15T18:43:45Z        RockyResourcefulWormSaltBae
2020-01-15T18:44:11Z        CrunchyIgnorantCoyoteBibleThump
2020-01-15T18:44:50Z        OnerousViscousLarkChocolateRain
2020-01-15T18:45:40Z        CuriousSmilingWheelNerfBlueBlaster
2020-01-15T18:46:17Z        HandsomeSillyBunnyPJSugar
2020-01-15T18:46:31Z        PoorCovertLeopardYouDontSay
2020-01-15T18:46:54Z        NastyCloudyReubenLeeroyJenkins
2020-01-15T18:47:15Z        PiercingSmallPonyDeIlluminati
2020-01-15T18:47:37Z        EnchantingAverageHyenaSMOrc
2020-01-15T18:48:13Z        HilariousInexpensiveBadgerOSkomodo
2020-01-15T18:48:36Z        KawaiiFurryWalletPlanking
2020-01-15T18:48:51Z        SweetClearBillWholeWheat

Only about half of the existing clips in the time range are returned. Which ones appears to be somewhat random and can change over time but it never returns all of them.

Expected behavior

Return all existing clips in that 10 minute time range:

2020-01-15T18:40:22Z        AgitatedHotGazelleNotLikeThis
2020-01-15T18:40:58Z        ObliviousArbitraryPastaDatSheffy
2020-01-15T18:41:39Z        SaltyLitigiousBisonRlyTho
2020-01-15T18:42:23Z        EncouragingConcernedCookieCharlietheUnicorn
2020-01-15T18:42:30Z        UnusualStupidOryxPeteZaroll
2020-01-15T18:43:21Z        PunchyGlutenFreeWoodcockFutureMan
2020-01-15T18:43:31Z        UninterestedShinyCobblerPastaThat
2020-01-15T18:43:45Z        RockyResourcefulWormSaltBae
2020-01-15T18:44:11Z        CrunchyIgnorantCoyoteBibleThump
2020-01-15T18:44:34Z        StrangeObliviousMonitorPicoMause
2020-01-15T18:44:50Z        OnerousViscousLarkChocolateRain
2020-01-15T18:45:40Z        CuriousSmilingWheelNerfBlueBlaster
2020-01-15T18:46:15Z        MoldyGiftedShrewVoteNay
2020-01-15T18:46:17Z        HandsomeSillyBunnyPJSugar
2020-01-15T18:46:25Z        AffluentDeafCheesecakeCopyThis
2020-01-15T18:46:31Z        PoorCovertLeopardYouDontSay
2020-01-15T18:46:36Z        FrozenPlacidClintBrokeBack
2020-01-15T18:46:39Z        OnerousRenownedSkunkImGlitch
2020-01-15T18:46:44Z        ExcitedBrainyLapwingMikeHogu
2020-01-15T18:46:53Z        TenderEnticingNeanderthalPraiseIt
2020-01-15T18:46:54Z        NastyCloudyReubenLeeroyJenkins
2020-01-15T18:46:55Z        AuspiciousLaconicSangFreakinStinkin
2020-01-15T18:47:15Z        PiercingSmallPonyDeIlluminati
2020-01-15T18:47:26Z        PeacefulStylishLionWholeWheat
2020-01-15T18:47:37Z        EnchantingAverageHyenaSMOrc
2020-01-15T18:48:13Z        HilariousInexpensiveBadgerOSkomodo
2020-01-15T18:48:36Z        KawaiiFurryWalletPlanking
2020-01-15T18:48:51Z        SweetClearBillWholeWheat

Clips found via previous requests and from chat.

Screenshots

Additional context or questions
I'm aware that this API will not return all clips for large time ranges with a huge number of clips in them but (seems it's limited to 1k?) but even a small 10 minute time range only returning 16 of the 28 clips in it is very surprising.

@willlllllio willlllllio added the product: api API endpoints in the "helix" namespace label Jan 31, 2020
@mauerbac
Copy link

Thanks for linking @BarryCarlyon . Will close this one :)

@mauerbac mauerbac added the ticketed Has been given an internal tracking ticket label Mar 23, 2020
@dmatech1
Copy link

dmatech1 commented Nov 2, 2020

Is there any way this ticket could be re-opened? The related tickets are all closed and seem to relate to the 1000-clip limit or the 10-minute resolution of the started_at and ended_at parameters.

https://api.twitch.tv/helix/clips?broadcaster_id=179065334&first=100&started_at=2018-07-13T21%3A45%3A00Z&ended_at=2018-07-25T07%3A30%3A00Z returns 39 records, but clip PhilanthropicModernHorseradishLitty on 2018-07-19 isn't returned despite it being in between 2018-07-13 and 2018-07-25. It's returned in a query on a longer date range, though.

@Xemdo
Copy link

Xemdo commented Apr 4, 2024

Reported as still occurring. Will re-investigate

@Xemdo Xemdo reopened this Apr 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
product: api API endpoints in the "helix" namespace ticketed Has been given an internal tracking ticket
Projects
None yet
Development

No branches or pull requests

4 participants