Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FlareSolverr 3.0.0 released #650

Closed
ngosang opened this issue Jan 5, 2023 · 21 comments
Closed

FlareSolverr 3.0.0 released #650

ngosang opened this issue Jan 5, 2023 · 21 comments
Labels
help wanted Extra attention is needed
Milestone

Comments

@ngosang
Copy link
Member

ngosang commented Jan 5, 2023

I just released:

With those versions you will be able to bypass Cloudflare (all challenges without CAPTCHA). Tested with YGG and many other sites.

There are some breaking changes in FlareSolverr v3. If you are a developer check out the release notes. If you are installing FlareSolverr from source code, review the readme.

Missing features could be implemented in the future by me or by other contributors. PRs will be accepted.

Thanks @ilike2burnthing @garfield69 for the hard work.
Thanks @AeonLucid for give me some ideas.

@reyqn
Copy link

reyqn commented Jan 5, 2023

Hi, thanks for keeping armv7 support. Just confirming this is working well for me on rpi4 (with yggtorrent)

@Deathnetworks
Copy link

Working perfectly here, seems faster at solving than previously too. Down from 16+ sec to around 4-5 sec

@HLFH
Copy link

HLFH commented Jan 5, 2023

@ngosang Thanks a lot!

I released flaresolverr-git on the Arch Linux AUR with this v3 version.

To release a version (v3.0.0) that is not a git version, it would be great to add the file pyproject.toml in this project?
See PEP 517. You can also use pip-compile to keep the old crap of *.txt files but in a better way.

Can you publish flaresolverr on Pypi? You can do it with hatch.

I was wondering why undetected_chromedriver is not listed as a dep and is managed internally?

@cwegener
Copy link

cwegener commented Jan 5, 2023

To release a version (v3.0.0) that is not a git version, it would be great to add the file pyproject.toml in this project? See PEP 517. You can also use pip-compile to keep the old crap of *.txt files but in a better way.

I did a bit of refactoring just now on a local copy to achieve this:

  1. rename src to flaresolverr in order to namespace the package appropriately
  2. Move package.json from root folder into flaresolverr so that it can be read by the utils.get_flaresolverr_version() method
  3. Rewrite necessary import statements to use the full package name as per step 1

After that I was able to create a simple pyproject.toml file an successfully install and run the new 3.0.0 version

@cwegener
Copy link

cwegener commented Jan 5, 2023

PR with the above refactor has been created at #651

@davidreverett
Copy link

davidreverett commented Jan 5, 2023

FYI Via Prowlarr Still not working for BT4G, Badasstorrents, Cloudtorrents, idope.se, All of these work fine through the newest version of Jackett.

Seems as though this may be a Prowlarr issue since flaresolverr logs show it thinks it worked. Prowlarr states BT4G and other trackers are blocked by Cloudflare Protection.

2023-01-05 02:33:07 INFO FlareSolverr 3.0.0
2023-01-05 02:33:07 INFO Testing web browser installation...
2023-01-05 02:33:23 INFO FlareSolverr User-Agent: Mozilla/5.0 (X11; Linux armv7l) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36
2023-01-05 02:33:23 INFO Test successful
2023-01-05 02:33:23 INFO Serving on http://0.0.0.0:8191
2023-01-05 02:33:53 INFO 192.168.0.104 GET http://192.168.0.187:8191/ 200 OK
2023-01-05 02:34:49 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://bt4g.org/search/2023', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}}
2023-01-05 02:34:49 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2.
2023-01-05 02:35:02 INFO Challenge detected. Title found: Just a moment...
2023-01-05 02:35:26 INFO Challenge solved!
2023-01-05 02:35:34 INFO Response in 45.71 s

2023-01-05 02:35:34 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK
2023-01-05 02:38:06 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://badasstorrents.nocensor.lol/torrents/date/desc', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}}
2023-01-05 02:38:06 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2.
2023-01-05 02:38:16 INFO Challenge detected. Title found: Just a moment...
2023-01-05 02:38:28 INFO Challenge solved!
2023-01-05 02:38:28 INFO Response in 22.853 s

2023-01-05 02:38:28 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK
2023-01-05 02:41:35 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://ext.to/latest/?order=age&sort=desc', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}}
2023-01-05 02:41:35 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2.
2023-01-05 02:41:52 INFO Challenge not detected!
2023-01-05 02:41:52 INFO Response in 17.387 s
2023-01-05 02:41:52 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK
2023-01-05 02:41:54 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://ext.to/latest/?order=age&sort=desc', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}}
2023-01-05 02:41:54 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2.
2023-01-05 02:42:19 INFO Challenge not detected!
2023-01-05 02:42:19 INFO Response in 24.492 s
2023-01-05 02:42:19 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK
2023-01-05 02:42:21 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://ext.to/latest/2/?order=age&sort=desc', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}}
2023-01-05 02:42:21 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2.
2023-01-05 02:42:36 INFO Challenge detected. Title found: Just a moment...
2023-01-05 02:42:37 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://idope.se/browse.html', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}}
2023-01-05 02:42:37 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2.
2023-01-05 02:42:50 INFO Challenge solved!
2023-01-05 02:42:52 INFO Response in 30.414 s

2023-01-05 02:42:52 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK
2023-01-05 02:42:52 INFO Challenge detected. Title found: Just a moment...
2023-01-05 02:43:01 INFO Challenge solved!

2023-01-05 02:43:02 INFO Response in 24.679 s
2023-01-05 02:43:02 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK

@ngosang ngosang added this to the 3.0.0 milestone Jan 5, 2023
@Raul824
Copy link

Raul824 commented Jan 5, 2023

It is resolving the challenge in flaresolverr logs 2nd time for hd-space but in jackett it throws error.
"Cookies provided are invalid"

Flaresolverr logs:

2023-01-05 15:15:29 INFO Incoming request => POST /v1 body: {'maxTimeout': 55000, 'cmd': 'request.get', 'url': 'https://hd-space.org/index.php?page=login'}
2023-01-05 15:15:36 INFO Challenge not detected!
2023-01-05 15:15:36 INFO Response in 6.885 s
2023-01-05 15:15:36 INFO 172.17.0.1 POST http://localhost:8191/v1 200 OK
2023-01-05 15:15:42 INFO Incoming request => POST /v1 body: {'maxTimeout': 55000, 'cmd': 'request.get', 'url': 'https://hd-space.org/index.php?page=login'}
2023-01-05 15:15:44 INFO Challenge detected. Title found: Just a moment...
2023-01-05 15:15:49 INFO Challenge solved!
2023-01-05 15:15:49 INFO Response in 6.927 s
2023-01-05 15:15:49 INFO 172.17.0.1 POST http://localhost:8191/v1 200 OK

Jackett logs:

01-06 01:15:36 Error FlareSolverrSharp.Exceptions.FlareSolverrException: The cookies provided by FlareSolverr are not valid
at FlareSolverrSharp.ClearanceHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Jackett.Common.Utils.Clients.HttpWebClient2.Run(WebRequest webRequest) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/HttpWebClient2.cs:line 179
at Jackett.Common.Utils.Clients.WebClient.GetResultAsync(WebRequest request) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/WebClient.cs:line 186
at Jackett.Common.Indexers.BaseWebIndexer.RequestWithCookiesAsync(String url, String cookieOverride, RequestType method, String referer, IEnumerable1 data, Dictionary2 headers, String rawbody, Nullable1 emulateBrowser) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/BaseIndexer.cs:line 522 at Jackett.Common.Indexers.HDSpace.ApplyConfiguration(JToken configJson) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/HDSpace.cs:line 91 at Jackett.Server.Controllers.IndexerApiController.UpdateConfig(ConfigItem[] config) in /home/vsts/work/1/s/src/Jackett.Server/Controllers/IndexerApiController.cs:line 97 at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
at Jackett.Server.Middleware.CustomExceptionHandler.Invoke(HttpContext httpContext) in /home/vsts/work/1/s/src/Jackett.Server/Middleware/CustomExceptionHandler.cs:line 26 FlareSolverrSharp.Exceptions.FlareSolverrException: The cookies provided by FlareSolverr are not valid
at FlareSolverrSharp.ClearanceHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Jackett.Common.Utils.Clients.HttpWebClient2.Run(WebRequest webRequest) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/HttpWebClient2.cs:line 179
at Jackett.Common.Utils.Clients.WebClient.GetResultAsync(WebRequest request) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/WebClient.cs:line 186
at Jackett.Common.Indexers.BaseWebIndexer.RequestWithCookiesAsync(String url, String cookieOverride, RequestType method, String referer, IEnumerable1 data, Dictionary2 headers, String rawbody, Nullable1 emulateBrowser) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/BaseIndexer.cs:line 522 at Jackett.Common.Indexers.HDSpace.ApplyConfiguration(JToken configJson) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/HDSpace.cs:line 91 at Jackett.Server.Controllers.IndexerApiController.UpdateConfig(ConfigItem[] config) in /home/vsts/work/1/s/src/Jackett.Server/Controllers/IndexerApiController.cs:line 97 at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
at Jackett.Server.Middleware.CustomExceptionHandler.Invoke(HttpContext httpContext) in /home/vsts/work/1/s/src/Jackett.Server/Middleware/CustomExceptionHandler.cs:line 26
01-06 01:15:49 Error FlareSolverrSharp.Exceptions.FlareSolverrException: The cookies provided by FlareSolverr are not valid
at FlareSolverrSharp.ClearanceHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Jackett.Common.Utils.Clients.HttpWebClient2.Run(WebRequest webRequest) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/HttpWebClient2.cs:line 179
at Jackett.Common.Utils.Clients.WebClient.GetResultAsync(WebRequest request) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/WebClient.cs:line 186
at Jackett.Common.Indexers.BaseWebIndexer.RequestWithCookiesAsync(String url, String cookieOverride, RequestType method, String referer, IEnumerable1 data, Dictionary2 headers, String rawbody, Nullable1 emulateBrowser) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/BaseIndexer.cs:line 522 at Jackett.Common.Indexers.HDSpace.ApplyConfiguration(JToken configJson) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/HDSpace.cs:line 91 at Jackett.Server.Controllers.IndexerApiController.UpdateConfig(ConfigItem[] config) in /home/vsts/work/1/s/src/Jackett.Server/Controllers/IndexerApiController.cs:line 97 at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
at Jackett.Server.Middleware.CustomExceptionHandler.Invoke(HttpContext httpContext) in /home/vsts/work/1/s/src/Jackett.Server/Middleware/CustomExceptionHandler.cs:line 26 FlareSolverrSharp.Exceptions.FlareSolverrException: The cookies provided by FlareSolverr are not valid
at FlareSolverrSharp.ClearanceHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Jackett.Common.Utils.Clients.HttpWebClient2.Run(WebRequest webRequest) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/HttpWebClient2.cs:line 179
at Jackett.Common.Utils.Clients.WebClient.GetResultAsync(WebRequest request) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/WebClient.cs:line 186
at Jackett.Common.Indexers.BaseWebIndexer.RequestWithCookiesAsync(String url, String cookieOverride, RequestType method, String referer, IEnumerable1 data, Dictionary2 headers, String rawbody, Nullable1 emulateBrowser) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/BaseIndexer.cs:line 522 at Jackett.Common.Indexers.HDSpace.ApplyConfiguration(JToken configJson) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/HDSpace.cs:line 91 at Jackett.Server.Controllers.IndexerApiController.UpdateConfig(ConfigItem[] config) in /home/vsts/work/1/s/src/Jackett.Server/Controllers/IndexerApiController.cs:line 97 at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
at Jackett.Server.Middleware.CustomExceptionHandler.Invoke(HttpContext httpContext) in /home/vsts/work/1/s/src/Jackett.Server/Middleware/CustomExceptionHandler.cs:line 26

15cm added a commit to 15cm/qiandao-templates that referenced this issue Jan 6, 2023
Changelog:
- Add domain to cookies which is required since FlareSolverr 3.0.0
- Add failed asserts to check again response of FlareSolverr response

Before the User cookies support mentioned in
FlareSolverr/FlareSolverr#650 is implemented in the
official repo, the har only works with this docker image:
15cm/flaresolverr:3.0.0 or forward. The docker image is built from
https://github.com/15cm/FlareSolverr .
15cm added a commit to 15cm/qiandao-templates that referenced this issue Jan 6, 2023
Changelog:
- Add domain to cookies which is required since FlareSolverr 3.0.0
- Add failed asserts to check again response of FlareSolverr response

Before the User cookies support mentioned in
FlareSolverr/FlareSolverr#650 is implemented in the
official repo, the har only works with this docker image:
15cm/flaresolverr:3.0.0 or forward. The docker image is built from
https://github.com/15cm/FlareSolverr .
15cm added a commit to 15cm/qiandao-templates that referenced this issue Jan 6, 2023
Changelog:
- Add domain to cookies which is required since FlareSolverr 3.0.0
- Add failed asserts to check again the response of FlareSolverr

Before the User cookies support mentioned in
FlareSolverr/FlareSolverr#650 is implemented in the
official repo, the har only works with this docker image:
`15cm/flaresolverr:3.0.0` or onward. The docker image is built from
https://github.com/15cm/FlareSolverr .

Fix qd-today#225
15cm added a commit to 15cm/qiandao-templates that referenced this issue Jan 6, 2023
Changelog:
- Add domain to cookies which is required since FlareSolverr 3.0.0
- Add failed asserts to check again the response of FlareSolverr

Before the User cookies support mentioned in
FlareSolverr/FlareSolverr#650 is implemented in the
official repo, the har only works with this docker image:
`15cm/flaresolverr:3.0.0` or onward. The docker image is built from
https://github.com/15cm/FlareSolverr .

Fix qd-today#225
15cm added a commit to 15cm/qiandao-templates that referenced this issue Jan 6, 2023
Changelog:
- Add domain to cookies which is required since FlareSolverr 3.0.0
- Add failed asserts to check again the response of FlareSolverr

Before the User cookies support mentioned in
FlareSolverr/FlareSolverr#650 is implemented in the
official repo, the har only works with this docker image:
`15cm/flaresolverr:3.0.0` or onward. The docker image is built from
https://github.com/15cm/FlareSolverr .

Fix qd-today#225
@Zeks
Copy link

Zeks commented Jan 8, 2023

It solves fanfiction.net now... occasionaly. At times it gives:

2023-01-08 00:58:20 INFO     FlareSolverr 3.0.1
2023-01-08 00:58:20 INFO     Testing web browser installation...
2023-01-08 00:58:21 INFO     FlareSolverr User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36
2023-01-08 00:58:21 INFO     Test successful
2023-01-08 00:58:21 INFO     Serving on http://0.0.0.0:17860
2023-01-08 00:58:53 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://www.fanfiction.net/u/13790658', 'maxTimeout': 60000}
2023-01-08 00:58:55 INFO     Challenge detected. Title found: Just a moment...
2023-01-08 00:59:54 ERROR    Error: Error solving the challenge. Timeout after 60.0 seconds.
2023-01-08 00:59:54 INFO     Response in 60.674 s
2023-01-08 00:59:54 INFO     127.0.0.1 POST http://127.0.0.1:17860/v1 500 Internal Server Error
2023-01-08 01:00:26 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://www.fanfiction.net/u/13790658', 'maxTimeout': 60000}
2023-01-08 01:00:27 INFO     Challenge detected. Title found: Just a moment...
2023-01-08 01:00:31 INFO     Challenge solved!
2023-01-08 01:00:31 INFO     Response in 4.968 s
2023-01-08 01:00:31 INFO     127.0.0.1 POST http://127.0.0.1:17860/v1 200 OK

@Zeks
Copy link

Zeks commented Jan 8, 2023

Also, it seems like the flaresovler output now displays japanese symbols as \uXXXX, any way it can be changed?

@Zeks
Copy link

Zeks commented Jan 8, 2023

But anyway: big big thanks for this version. My project is alive again now :) It's a completely "free time free service" thing so I wouldn't have been able to continue without people providing the parsing access, I am very grateful for your work

a76yyyy pushed a commit to qd-today/templates that referenced this issue Jan 8, 2023
* Update m-team FlareSolverr har

Changelog:
- Add domain to cookies which is required since FlareSolverr 3.0.0
- Add failed asserts to check again the response of FlareSolverr

Before the User cookies support mentioned in
FlareSolverr/FlareSolverr#650 is implemented in the
official repo, the har only works with this docker image:
`15cm/flaresolverr:3.0.0` or onward. The docker image is built from
https://github.com/15cm/FlareSolverr .

Fix #225

* Add everything before </title> of FlareSolverr response to har __log__

The FlareSolverr response status is before the response body that contains
"</title>". If the user name can be found in the title, it means the login
succeeded. The __log__ looks like this:
 {"status": "ok", "message": "Challenge not detected!", "solution": {"url": "https://kp.m-team.cc/userdetails.php?id=<userid>", "status": 200, "captcha_type": null, "cookies": [{"domain": "kp.m-team.cc", "httpOnly": false, "name": "tp", "path": "/", "secure": false, "value": "<tp_cookie>"}], "userAgent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36", "headers": {}, "response": "<html xmlns=\"http://www.w3.org/1999/xhtml\"><head>\n<meta http-equiv=\"Content-Type\" content=\"text/html; charset=utf-8\">\n<meta name=\"generator\" content=\"NexusPHP\">\n<title>M-Team - TP :: \u7528\u6236\u8a73\u60c5 - <username> - Powered by NexusPHP</title>
@HLFH
Copy link

HLFH commented Jan 10, 2023

Prowlarr + yggtorrent does not seem to work with the latest FlareSolverr.
But Jackett + yggtorrent does seem to work with the latest FlareSolverr.

@Thomas-Philippot
Copy link

Thomas-Philippot commented Feb 1, 2023

@HLFH how did you manage to make it work ?
tried latest Jackett +FlareSolverr but I keep getting "Error solving the challeng." on Yggtorrent

This is what I get on v3.0.2

2023-02-01 17:55:27 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'http://www.google.com/', 'maxTimeout': 60000}
2023-02-01 17:55:31 INFO     Challenge not detected!
2023-02-01 17:55:32 INFO     Response in 4.907 s
2023-02-01 17:55:32 INFO     172.17.0.1 POST http://localhost:8191/v1 200 OK
2023-02-01 17:57:35 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://www6.yggtorrent.lol', 'maxTimeout': 60000}
2023-02-01 17:57:39 INFO     Challenge detected. Title found: Just a moment...
2023-02-01 17:58:37 ERROR    Error: Error solving the challenge. Timeout after 60.0 seconds.
2023-02-01 17:58:37 INFO     Response in 61.71 s

@Zegorax
Copy link

Zegorax commented Feb 1, 2023

I have the same thing as @Thomas-Philippot.

flaresolverr_1  | 2023-02-01 21:26:43 INFO     ReqId 139630326314752 Incoming request => POST /v1 body: {'maxTimeout': 60000, 'cmd': 'request.get', 'url': 'https://www6.yggtorrent.lol/engine/search?category=all&name=&description=&file=&uploader=&sub_category=&do=search&order=desc&sort=publish_date', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}}
flaresolverr_1  | 2023-02-01 21:26:43 WARNING  ReqId 139630326314752 Request parameter 'userAgent' was removed in FlareSolverr v2.
flaresolverr_1  | 2023-02-01 21:26:43 DEBUG    ReqId 139630326314752 Launching web browser...
flaresolverr_1  | 2023-02-01 21:26:43 DEBUG    ReqId 139630326314752 Started executable: `/app/chromedriver` in a child process with pid: 402
flaresolverr_1  | 2023-02-01 21:26:44 DEBUG    ReqId 139630292743936 Navigating to... https://www6.yggtorrent.lol/engine/search?category=all&name=&description=&file=&uploader=&sub_category=&do=search&order=desc&sort=publish_date
flaresolverr_1  | 2023-02-01 21:26:44 INFO     ReqId 139630292743936 Challenge detected. Title found: Just a moment...
flaresolverr_1  | 2023-02-01 21:26:44 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:26:58 DEBUG    ReqId 139630292743936 Timeout waiting for selector
flaresolverr_1  | 2023-02-01 21:26:58 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:27:08 DEBUG    ReqId 139630292743936 Timeout waiting for selector
flaresolverr_1  | 2023-02-01 21:27:08 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:27:18 DEBUG    ReqId 139630292743936 Timeout waiting for selector
flaresolverr_1  | 2023-02-01 21:27:18 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:27:32 DEBUG    ReqId 139630292743936 Timeout waiting for selector
flaresolverr_1  | 2023-02-01 21:27:32 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:27:42 DEBUG    ReqId 139630292743936 Timeout waiting for selector
flaresolverr_1  | 2023-02-01 21:27:42 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:27:51 ERROR    ReqId 139630326314752 Error: Error solving the challenge. Timeout after 60.0 seconds.

@Thomas-Philippot
Copy link

@Zegorax are you using a VPS or something ? I get the error on a debian VPS.

Works like a charm on my local network using a raspberry pi

@Zegorax
Copy link

Zegorax commented Feb 2, 2023

It's running on Hetzner's network, I'm quite sur that it is the problem. In the past I simply connected to YggTorrent using a remote desktop also running there and it would solve the problem. But now, since a few days, it's not working anymore.

@cdjufer
Copy link

cdjufer commented Feb 4, 2023

Hello
For me impossible to make flaresolverr work on YGGTorrent.
The challenge fails
Do you have a solution for this?

@ilike2burnthing
Copy link
Contributor

If you're using Jackett/Prowlarr and FlareSolverr on the same device and the same IP (i.e. no VPN or proxy), with IPv6 disabled, and other indexers which require FlareSolverr are working (TorrentQQ is a quick test), then the issue lies with YGG.

There are plenty of old issues regarding YGG, and they almost all come down to the same thing: their implementation of Cloudflare IAUM protection as a result of them being DDoS'd. There's nothing we can do about that.

@lborruto
Copy link

lborruto commented Feb 7, 2023

It's running on Hetzner's network, I'm quite sur that it is the problem. In the past I simply connected to YggTorrent using a remote desktop also running there and it would solve the problem. But now, since a few days, it's not working anymore.

Can't make it works too on Hetzner, tried on a local server and it's finally working! (Also, Flaresolverr is broken on RaspberryPi 3)

@samip5
Copy link

samip5 commented Feb 23, 2023

Idope seems broken, with Jackett v0.20.3269.

023-02-23 13:52:12 INFO     ReqId 139952315868992 FlareSolverr 3.0.2
2023-02-23 13:52:12 DEBUG    ReqId 139952315868992 Debug log enabled
2023-02-23 13:52:12 INFO     ReqId 139952315868992 Testing web browser installation...
2023-02-23 13:52:12 INFO     ReqId 139952315868992 Chrome / Chromium path: /usr/bin/chromium
find: ‘/app/.config/chromium/Crash Reports/pending/’: No such file or directory
2023-02-23 13:52:12 INFO     ReqId 139952315868992 Chrome / Chromium major version: 108
2023-02-23 13:52:12 DEBUG    ReqId 139952315868992 Launching web browser...
2023-02-23 13:52:12 DEBUG    ReqId 139952315868992 Started executable: `/app/chromedriver` in a child process with pid: 31
2023-02-23 13:52:13 INFO     ReqId 139952315868992 FlareSolverr User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36
2023-02-23 13:52:13 INFO     ReqId 139952315868992 Test successful
2023-02-23 13:52:13 INFO     ReqId 139952315868992 Serving on http://0.0.0.0:8191
2023-02-23 13:52:21 INFO     ReqId 139952284428032 Incoming request => POST /v1 body: {'maxTimeout': 55000, 'cmd': 'request.get', 'url': 'https://idope.se/browse.html'}
2023-02-23 13:52:21 DEBUG    ReqId 139952284428032 Launching web browser...
2023-02-23 13:52:21 DEBUG    ReqId 139952284428032 Started executable: `/app/chromedriver` in a child process with pid: 194
2023-02-23 13:52:22 DEBUG    ReqId 139952046208768 Navigating to... https://idope.se/browse.html
2023-02-23 13:52:22 INFO     ReqId 139952046208768 Challenge detected. Title found: Just a moment...
2023-02-23 13:52:22 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:52:32 DEBUG    ReqId 139952046208768 Timeout waiting for selector
2023-02-23 13:52:32 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:52:42 DEBUG    ReqId 139952046208768 Timeout waiting for selector
2023-02-23 13:52:42 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:52:52 DEBUG    ReqId 139952046208768 Timeout waiting for selector
2023-02-23 13:52:52 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:53:02 DEBUG    ReqId 139952046208768 Timeout waiting for selector
2023-02-23 13:53:02 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:53:12 DEBUG    ReqId 139952046208768 Timeout waiting for selector
2023-02-23 13:53:12 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:53:17 ERROR    ReqId 139952284428032 Error: Error solving the challenge. Timeout after 55.0 seconds.
2023-02-23 13:53:17 DEBUG    ReqId 139952284428032 Response => POST /v1 body: {'status': 'error', 'message': 'Error: Error solving the challenge. Timeout after 55.0 seconds.', 'startTimestamp': 1677160341421, 'endTimestamp': 1677160397213, 'version': '3.0.2'}
2023-02-23 13:53:17 INFO     ReqId 139952284428032 Response in 55.792 s
2023-02-23 13:53:17 INFO     ReqId 139952284428032 172.17.0.7 POST http://flaresolverr:8191/v1 500 Internal Server Error

@ngosang ngosang unpinned this issue Mar 7, 2023
@jiaochanghaoserverss
Copy link

The request always has the following problem

{
"status": "error",
"message": "Error: Error solving the challenge. Timeout after 60.0 seconds.",
"startTimestamp": 1678687474446,
"endTimestamp": 1678687535384,
"version": "3.0.4"
}

@ngosang ngosang modified the milestones: 3.0.0, 3.2.0 May 21, 2023
@ngosang
Copy link
Member Author

ngosang commented May 23, 2023

Proxy and Cookies support implemented in https://github.com/FlareSolverr/FlareSolverr/releases/tag/v3.2.0

@ngosang ngosang closed this as completed May 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests