Crash during searching #3106

Suncatcher · 2020-02-17T07:59:40Z

Steps to reproduce:

Put search term in Cyrillic "настоящее время" (maybe not only this), and hit enter.

It doesn't happen always, just sometimes, I cannot figure any rule. I observe this bug throughout the last three app versions, I believe.

P.S. The screenshot is from the version 0.18.2 but I experienced it in 0.18.3 as well.

cool-student · 2020-02-17T08:39:32Z

this happened to me as well recently but as stated above it doesn't happen every time. for me it happened when I was scrolling down, possibly something didn't load quickly enough ?

Exception

User Action: searched
Request: eminem
Content Language: GB
Service: YouTube
Version: v0.18.3
OS: Linux Android 10 - 29

Crash log

java.lang.NullPointerException: Attempt to invoke virtual method 'org.jsoup.select.Elements org.jsoup.nodes.Element.children()' on a null object reference
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.collectItems(YoutubeSearchExtractor.java:114)
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.getPage(YoutubeSearchExtractor.java:92)
	at org.schabi.newpipe.extractor.search.SearchInfo.getMoreItems(SearchInfo.java:62)
	at org.schabi.newpipe.util.ExtractorHelper.lambda$getMoreSearchItems$1(ExtractorHelper.java:90)
	at org.schabi.newpipe.util.-$$Lambda$ExtractorHelper$DBE2dF7XqVvkl-TcN5nthmVnvzQ.call(Unknown Source:10)
	at io.reactivex.internal.operators.single.SingleFromCallable.subscribeActual(SingleFromCallable.java:44)
	at io.reactivex.Single.subscribe(Single.java:3438)
	at io.reactivex.internal.operators.single.SingleSubscribeOn$SubscribeOnObserver.run(SingleSubscribeOn.java:89)
	at io.reactivex.Scheduler$DisposeTask.run(Scheduler.java:578)
	at io.reactivex.internal.schedulers.ScheduledRunnable.run(ScheduledRunnable.java:66)
	at io.reactivex.internal.schedulers.ScheduledRunnable.call(ScheduledRunnable.java:57)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:301)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	at java.lang.Thread.run(Thread.java:919)

Stypox · 2020-02-19T16:51:40Z

Could you get more information about the webpage with the apk provided in #1816? @cool-student @Suncatcher

Suncatcher · 2020-02-20T09:22:22Z

@Stypox this app-debug.apk is from the 5th of October. Is it still actual? Won't it introduce more bugs?

Stypox · 2020-02-20T12:36:39Z

Mmmh maybe it crashes. I will try to provide a new apk when I have time. Please note that the apk's purpose is just that of crashing with more info, not actually fixing anything

cool-student · 2020-02-20T13:40:03Z

unfortunately this only happened to me once and I'm having a hard time reproducing it :/

B0pol · 2020-02-22T18:30:08Z

Reproduced it. It didn't amke the app crash though, I had no results and error at the bottom

Exception

User Action: searched
Request: pewdiepie break
Content Language: FR
GMT Time: 2020-02-22 18:28
Package: org.schabi.newpipe.debug
Version: 0.18.3
Service: YouTube
Operating System: Linux Android 8.1.0 - 27

Crash log

java.lang.NullPointerException: Attempt to invoke virtual method 'org.jsoup.select.Elements org.jsoup.nodes.Element.children()' on a null object reference
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.collectItems(YoutubeSearchExtractor.java:114)
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.getInitialPage(YoutubeSearchExtractor.java:79)
	at org.schabi.newpipe.extractor.utils.ExtractorHelper.getItemsPageOrLogError(ExtractorHelper.java:20)
	at org.schabi.newpipe.extractor.search.SearchInfo.getInfo(SearchInfo.java:50)
	at org.schabi.newpipe.extractor.search.SearchInfo.getInfo(SearchInfo.java:30)
	at org.schabi.newpipe.util.ExtractorHelper.lambda$searchFor$0(ExtractorHelper.java:77)
	at org.schabi.newpipe.util.-$$Lambda$ExtractorHelper$BBduYDeZ_vXMQYaemaggmTPtqvA.call(Unknown Source:8)
	at io.reactivex.internal.operators.single.SingleFromCallable.subscribeActual(SingleFromCallable.java:44)
	at io.reactivex.Single.subscribe(Single.java:3438)
	at io.reactivex.internal.operators.single.SingleSubscribeOn$SubscribeOnObserver.run(SingleSubscribeOn.java:89)
	at io.reactivex.Scheduler$DisposeTask.run(Scheduler.java:578)
	at io.reactivex.internal.schedulers.ScheduledRunnable.run(ScheduledRunnable.java:66)
	at io.reactivex.internal.schedulers.ScheduledRunnable.call(ScheduledRunnable.java:57)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:301)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1162)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:636)
	at java.lang.Thread.run(Thread.java:764)

mehedihasanziku · 2020-02-23T13:14:12Z

Yes, true, it's happened with data network connection & when low internet connectivity. Though i can't reproduce that issue, i will open issue with log or update here when i will face it again.

Suncatcher · 2020-02-25T14:11:03Z

The same happens on 0.18.4. The problem persists

Exception

User Action: searched
Request: настоящее время
Content Language: GB
Service: YouTube
Version: 0.18.4
OS: Linux xiaomi/onc/onc:9/PKQ1.181021.001/V11.0.2.0.PFLMIXM:user/release-keys 9 - 28

Crash log

java.lang.NullPointerException: Attempt to invoke virtual method 'org.jsoup.select.Elements org.jsoup.nodes.Element.children()' on a null object reference
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.collectItems(YoutubeSearchExtractor.java:114)
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.getInitialPage(YoutubeSearchExtractor.java:79)
	at org.schabi.newpipe.extractor.utils.ExtractorHelper.getItemsPageOrLogError(ExtractorHelper.java:19)
	at org.schabi.newpipe.extractor.search.SearchInfo.getInfo(SearchInfo.java:50)
	at org.schabi.newpipe.extractor.search.SearchInfo.getInfo(SearchInfo.java:30)
	at org.schabi.newpipe.util.ExtractorHelper.lambda$searchFor$0(ExtractorHelper.java:77)
	at org.schabi.newpipe.util.-$$Lambda$ExtractorHelper$BBduYDeZ_vXMQYaemaggmTPtqvA.call(Unknown Source:8)
	at io.reactivex.internal.operators.single.SingleFromCallable.subscribeActual(SingleFromCallable.java:44)
	at io.reactivex.Single.subscribe(Single.java:3438)
	at io.reactivex.internal.operators.single.SingleSubscribeOn$SubscribeOnObserver.run(SingleSubscribeOn.java:89)
	at io.reactivex.Scheduler$DisposeTask.run(Scheduler.java:578)
	at io.reactivex.internal.schedulers.ScheduledRunnable.run(ScheduledRunnable.java:66)
	at io.reactivex.internal.schedulers.ScheduledRunnable.call(ScheduledRunnable.java:57)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:301)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	at java.lang.Thread.run(Thread.java:764)

wb9688 · 2020-02-25T14:20:41Z

@Suncatcher: Does this issue also happen with https://send.firefox.com/download/5b21cf1361768659/#NUmIIvWTZ1Lwr2D3CK6L7w? That's a build of NewPipe that parses YouTube's new website and it shouldn't happen there. That build isn't ready yet, so there are other issues with it, but if this issue doesn't happen there, this issue could be closed.

Suncatcher · 2020-02-28T05:23:02Z

@wb9688 Installation fails on Android 9

B0pol · 2020-02-28T06:04:30Z

Well just update to v0.18.5, it uses the new website

Suncatcher · 2020-02-28T10:47:14Z

Still had no update notification prompt.
BTW, isn't it correct that my version show Content Lang: GB, even when I search content on Russian and my phone is on English (US) language, not GB?
Phone language shouldn't influence content, no?

B0pol · 2020-02-28T11:55:44Z

From v0.18.4 blog post

@B0pol third contribution immensely improves the app for non-English speaker: The country NewPipe sets you in is now set to the one of your system language - No more UK videos in the Trending section if you are actually a proud Russian. This only applies to new installations, don’t worry if you enjoy your English feed, друг.

For content language: we put the phone language for the same reason.
It should use your language instead of English, but it doesn't work currently, that's why you can see sometimes English titles or descriptions even though they aren't English videos (because it's translated).

Suncatcher · 2020-03-12T19:11:26Z

but it doesn't work currently

and when will it work?

Suncatcher · 2020-03-12T19:19:21Z

On 0.18.6 version it still exists

Suncatcher · 2020-03-12T19:20:35Z

Surprisingly today NewPipe opened live show, though usually it crashes even on videos added 40 minutes ago.

Suncatcher · 2020-04-18T06:49:10Z

I have this bug again on latest version

Exception

User Action: requested stream
Request: https://www.youtube.com/watch?v=1LvO7s4BjF8
Content Language: GB
Service: YouTube
Version: 0.19.2
OS: Linux Android 9 - 28

Crash log

java.lang.NullPointerException: Attempt to invoke virtual method 'com.grack.nanojson.JsonObject com.grack.nanojson.JsonObject.getObject(java.lang.String)' on a null object reference
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeStreamExtractor.getErrorMessage(YoutubeStreamExtractor.java:580)
	at org.schabi.newpipe.extractor.stream.StreamInfo.getInfo(StreamInfo.java:80)
	at org.schabi.newpipe.extractor.stream.StreamInfo.getInfo(StreamInfo.java:61)
	at org.schabi.newpipe.util.ExtractorHelper.lambda$getStreamInfo$3(ExtractorHelper.java:120)
	at org.schabi.newpipe.util.-$$Lambda$ExtractorHelper$5fJcha6Sq5APJBLdG6osaJby-mc.call(Unknown Source:4)
	at io.reactivex.internal.operators.single.SingleFromCallable.subscribeActual(SingleFromCallable.java:44)
	at io.reactivex.Single.subscribe(Single.java:3438)
	at io.reactivex.internal.operators.single.SingleDoOnSuccess.subscribeActual(SingleDoOnSuccess.java:35)
	at io.reactivex.Single.subscribe(Single.java:3438)
	at io.reactivex.internal.operators.maybe.MaybeFromSingle.subscribeActual(MaybeFromSingle.java:41)
	at io.reactivex.Maybe.subscribe(Maybe.java:4154)
	at io.reactivex.internal.operators.maybe.MaybeConcatArray$ConcatMaybeObserver.drain(MaybeConcatArray.java:153)
	at io.reactivex.internal.operators.maybe.MaybeConcatArray$ConcatMaybeObserver.request(MaybeConcatArray.java:78)
	at io.reactivex.internal.operators.flowable.FlowableElementAtMaybe$ElementAtSubscriber.onSubscribe(FlowableElementAtMaybe.java:66)
	at io.reactivex.internal.operators.maybe.MaybeConcatArray.subscribeActual(MaybeConcatArray.java:42)
	at io.reactivex.Flowable.subscribe(Flowable.java:14479)
	at io.reactivex.internal.operators.flowable.FlowableElementAtMaybe.subscribeActual(FlowableElementAtMaybe.java:36)
	at io.reactivex.Maybe.subscribe(Maybe.java:4154)
	at io.reactivex.internal.operators.maybe.MaybeToSingle.subscribeActual(MaybeToSingle.java:46)
	at io.reactivex.Single.subscribe(Single.java:3438)
	at io.reactivex.internal.operators.single.SingleSubscribeOn$SubscribeOnObserver.run(SingleSubscribeOn.java:89)
	at io.reactivex.Scheduler$DisposeTask.run(Scheduler.java:578)
	at io.reactivex.internal.schedulers.ScheduledRunnable.run(ScheduledRunnable.java:66)
	at io.reactivex.internal.schedulers.ScheduledRunnable.call(ScheduledRunnable.java:57)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:301)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	at java.lang.Thread.run(Thread.java:764)

Stypox · 2020-04-20T07:07:53Z

~~Please use the Incredible Error Report to Markdown Converter before sending bug repots~~
Edit: I edited your comment by manually fixing the json.
By the way, you don't have to provide a screenshot of the bug report activity, is just contains less information than the bug report ;-)

B0pol · 2020-05-17T07:39:39Z

No it's not the same issue. As you can see in the crash log the error was NullPointerException, and in the last crash log you've sent, it's StreamExctractException
This bug is known: #3576

Suncatcher · 2020-05-18T14:33:27Z

Sorry for confusing, posted in correspondent thread

opusforlife2 · 2020-08-15T08:28:05Z

@Suncatcher Still there as of 0.19.8?

Suncatcher · 2020-08-17T08:49:40Z

Haven't seen it for a while

opusforlife2 · 2020-08-17T08:53:56Z

Alright, thanks. Comment if you see it again.

Suncatcher · 2020-10-19T18:06:05Z

It happens again

Exception

User Action: searched
Request: нихуя не понял но очень интересно умер
Content Language: en
Service: YouTube
Version: 0.20.0
OS: Linux Android 9 - 28

Crash log

org.schabi.newpipe.extractor.exceptions.ParsingException: Could not get ytInitialData
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.getInitialData(YoutubeParsingHelper.java:203)
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.extractClientVersionAndKey(YoutubeParsingHelper.java:222)
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.getKey(YoutubeParsingHelper.java:298)
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.getNewNextPageFrom(YoutubeSearchExtractor.java:233)
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.getInitialPage(YoutubeSearchExtractor.java:127)
	at org.schabi.newpipe.extractor.utils.ExtractorHelper.getItemsPageOrLogError(ExtractorHelper.java:19)
	at org.schabi.newpipe.extractor.search.SearchInfo.getInfo(SearchInfo.java:55)
	at org.schabi.newpipe.extractor.search.SearchInfo.getInfo(SearchInfo.java:30)
	at org.schabi.newpipe.util.ExtractorHelper.lambda$searchFor$0(ExtractorHelper.java:81)
	at org.schabi.newpipe.util.-$$Lambda$ExtractorHelper$BBduYDeZ_vXMQYaemaggmTPtqvA.call(Unknown Source:8)
	at io.reactivex.internal.operators.single.SingleFromCallable.subscribeActual(SingleFromCallable.java:44)
	at io.reactivex.Single.subscribe(Single.java:3666)
	at io.reactivex.internal.operators.single.SingleSubscribeOn$SubscribeOnObserver.run(SingleSubscribeOn.java:89)
	at io.reactivex.Scheduler$DisposeTask.run(Scheduler.java:578)
	at io.reactivex.internal.schedulers.ScheduledRunnable.run(ScheduledRunnable.java:66)
	at io.reactivex.internal.schedulers.ScheduledRunnable.call(ScheduledRunnable.java:57)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:301)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	at java.lang.Thread.run(Thread.java:764)
Caused by: org.schabi.newpipe.extractor.utils.Parser$RegexException: failed to find pattern "window\["ytInitialData"\]\s*=\s*(\{.*?\});
	at org.schabi.newpipe.extractor.utils.Parser.matchGroup(Parser.java:72)
	at org.schabi.newpipe.extractor.utils.Parser.matchGroup(Parser.java:61)
	at org.schabi.newpipe.extractor.utils.Parser.matchGroup1(Parser.java:52)
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.getInitialData(YoutubeParsingHelper.java:200)
	... 20 more

opusforlife2 · 2020-10-19T18:16:29Z

@Suncatcher Fixed in 0.20.1.

Stypox added bug Issue is related to a bug requires extractor change This issue requires a change to the extractor youtube Service, https://www.youtube.com/ labels Feb 19, 2020

opusforlife2 closed this as completed Aug 17, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Crash during searching #3106

Crash during searching #3106

Suncatcher commented Feb 17, 2020 •

edited

cool-student commented Feb 17, 2020

Stypox commented Feb 19, 2020 •

edited

Suncatcher commented Feb 20, 2020

Stypox commented Feb 20, 2020

cool-student commented Feb 20, 2020

B0pol commented Feb 22, 2020

mehedihasanziku commented Feb 23, 2020

Suncatcher commented Feb 25, 2020

wb9688 commented Feb 25, 2020 •

edited

Suncatcher commented Feb 28, 2020

B0pol commented Feb 28, 2020

Suncatcher commented Feb 28, 2020

B0pol commented Feb 28, 2020 •

edited

Suncatcher commented Mar 12, 2020

Suncatcher commented Mar 12, 2020

Suncatcher commented Mar 12, 2020

Suncatcher commented Apr 18, 2020 •

edited by Stypox

Stypox commented Apr 20, 2020 •

edited

B0pol commented May 17, 2020

Suncatcher commented May 18, 2020

opusforlife2 commented Aug 15, 2020

Suncatcher commented Aug 17, 2020

opusforlife2 commented Aug 17, 2020

Suncatcher commented Oct 19, 2020

opusforlife2 commented Oct 19, 2020

Crash during searching #3106

Crash during searching #3106

Comments

Suncatcher commented Feb 17, 2020 • edited

cool-student commented Feb 17, 2020

Exception

Stypox commented Feb 19, 2020 • edited

Suncatcher commented Feb 20, 2020

Stypox commented Feb 20, 2020

cool-student commented Feb 20, 2020

B0pol commented Feb 22, 2020

Exception

mehedihasanziku commented Feb 23, 2020

Suncatcher commented Feb 25, 2020

Exception

wb9688 commented Feb 25, 2020 • edited

Suncatcher commented Feb 28, 2020

B0pol commented Feb 28, 2020

Suncatcher commented Feb 28, 2020

B0pol commented Feb 28, 2020 • edited

Suncatcher commented Mar 12, 2020

Suncatcher commented Mar 12, 2020

Suncatcher commented Mar 12, 2020

Suncatcher commented Apr 18, 2020 • edited by Stypox

Exception

Stypox commented Apr 20, 2020 • edited

B0pol commented May 17, 2020

Suncatcher commented May 18, 2020

opusforlife2 commented Aug 15, 2020

Suncatcher commented Aug 17, 2020

opusforlife2 commented Aug 17, 2020

Suncatcher commented Oct 19, 2020

Exception

opusforlife2 commented Oct 19, 2020

Suncatcher commented Feb 17, 2020 •

edited

Stypox commented Feb 19, 2020 •

edited

wb9688 commented Feb 25, 2020 •

edited

B0pol commented Feb 28, 2020 •

edited

Suncatcher commented Apr 18, 2020 •

edited by Stypox

Stypox commented Apr 20, 2020 •

edited