Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[REQ] New Public Indexer erai-raws #4116

Closed
xxsxx47 opened this issue Nov 3, 2018 · 25 comments · Fixed by #11484 or #12083
Closed

[REQ] New Public Indexer erai-raws #4116

xxsxx47 opened this issue Nov 3, 2018 · 25 comments · Fixed by #11484 or #12083

Comments

@xxsxx47
Copy link

xxsxx47 commented Nov 3, 2018 •
edited by garfield69

Tracker Name : erai-raws
Type : Anime
Public Semi-private tracker
Indexer URL : https://erai-raws.info/
Indexer language : English , Spanish, Portuguese , French , Arabic , Russia

Thank You Very Much .
@xxsxx47 xxsxx47 changed the title [REQ] [REQ] New Public Indexer erai-raws [REQ] New Public Indexer erai-raws Nov 3, 2018
@garfield69 garfield69 added the New Public Tracker Request a Tracker that does not require a login label Nov 3, 2018
@garfield69 garfield69 added this to Todo in New .YML indexers Jan 26, 2019
@garfield69
Copy link
Contributor

can't be processed with candigann, will need c# coding, similar to horriblesubs

@garfield69 garfield69 added the PR Welcome! We would welcome a volunteer to prepare a PR to solve this problem! label Dec 8, 2019
@hukasu
Copy link

hukasu commented Jan 1, 2020

can't parse this rss link? https://ru.erai-raws.info/rss-all/

@garfield69 garfield69 added the Returns one-title-many-torrents Results comprise Single Titles with the Details page containing related multiple torrents label Apr 6, 2020
This was referenced Nov 30, 2020
Closed
Closed
Closed
@ngosang ngosang removed this from To do in New .YML indexers Dec 21, 2020
@ngosang ngosang added this to To do in New C# indexers Dec 21, 2020
@ilike2burnthing ilike2burnthing added this to Rewrite in C# in Jackett Indexers Jan 18, 2021
@ilike2burnthing ilike2burnthing moved this from Rewrite in C# to New Trackers in Jackett Indexers Jan 18, 2021
@garfield69 garfield69 removed this from New Public Trackers in Jackett Indexers Feb 28, 2021
@6cUbi57z
Copy link
Contributor

With Anidex being quite unstable recently I decided to have a look at this as I've used a number of the Erai releases before.

The problem is that Erai-Raws isn't really an indexer but is a release site. As such, it has no search, no stats such as files, size, seeders, leechers and the implementation has to work based on the RSS feed (to work reliably) which has limited results. Also the releases don't follow the usual naming conventions on indexers so are not easily detected by Sonarr.

That being said, I have managed to put together an implementation at https://github.com/6cUbi57z/Jackett/tree/feature/erai-raws which seems to work fairly well but this is rather different to most other indexers (exc. ShowRSS). Like ShowRSS, it is grabbing all items from the RSS feed and then performing a basic filter within Jackett. I also added an option which will try to extract the season and episode numbers from the title and move them to the end in the format S00E00 so that they are detected by Sonarr. It probably needs another option to exclude the quality tag from the search as searching for episode 10 is also matching 1080p.

...but I'm unsure if it's a good idea to put this in given it's so different. I'll leave it to an owner/collaborator to decide (@garfield69 , @ngosang , @ilike2burnthing ?). If you're happy for it to go in working from the RSS, I'll clean up a bit and open a merge request.

Open to other suggestions if there are better ways to implement it.

6cUbi57z pushed a commit to 6cUbi57z/Jackett that referenced this issue Apr 5, 2021
Add Erai-Raws tracker
df12fd2 
Resolves Jackett#4116
@6cUbi57z 6cUbi57z mentioned this issue Apr 5, 2021
Merged
ilike2burnthing added a commit that referenced this issue Apr 18, 2021
@6cUbi57z @ilike2burnthing
erairaws: add new public tracker. resolves #4116 (#11484)
42b6aae 
Also change release size for ShowRSS to 512MB.

Co-authored-by: 6cUbi57z <git@g-de.co.uk>
Co-authored-by: ilike2burnthing <59480337+ilike2burnthing@users.noreply.github.com>
@garfield69
Copy link
Contributor

v0.17.907

@ilike2burnthing ilike2burnthing moved this from To do to Done in New C# indexers May 18, 2021
@garfield69 garfield69 removed New Public Tracker Request a Tracker that does not require a login Returns one-title-many-torrents Results comprise Single Titles with the Details page containing related multiple torrents labels Jul 26, 2021
@garfield69 garfield69 removed this from Done in New C# indexers Jul 26, 2021
@garfield69
Copy link
Contributor

keywordless search causing https://www.erai-raws.info/ to return
Exception (erai-raws): An error occurred while parsing EntityName. Line 11, position 269576.
---> System.Xml.XmlException: An error occurred while parsing EntityName. Line 11, position 269576.

examining the enhanced log reveals that https://www.erai-raws.info/rss-all-magnet is returning
Page not Found

@garfield69 garfield69 reopened this Jul 26, 2021
@6cUbi57z
Copy link
Contributor

Looks like they've got a new site and a new more feature rich rss feed to go with it: https://beta.erai-raws.info/feed/?type=magnet

@garfield69 garfield69 mentioned this issue Jul 27, 2021
Closed
@ilike2burnthing ilike2burnthing removed the Down / Waiting for removal Site is 522/500/403/302. To be Monitored. If still offline after 30d then Indexer will be removed. label Mar 5, 2022
@garfield69 garfield69 mentioned this issue Apr 2, 2022
Closed
3 tasks
@ilike2burnthing
Copy link
Contributor

Looks like you don't need to be logged in to view the feed, rather it just requires a UID as part of the URL:

https://www.erai-raws.info/feed/?type=magnet - 403 Forbidden, even if signed in

https://www.erai-raws.info/feed/?type=magnet&xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx - working, even if not signed in

You get said UID from the feed URL on https://www.erai-raws.info/rss-page/

@ilike2burnthing ilike2burnthing moved this from Down / Waiting for removal to To do in Jackett Indexers Apr 2, 2022
ngosang added a commit to ngosang/Jackett that referenced this issue Apr 17, 2022
@ngosang
erai-raws: make it semi-private and add rss key. closes Jackett#4116
2ca097b
@ilike2burnthing ilike2burnthing moved this from To do to Done in Jackett Indexers Apr 17, 2022
@garfield69
Copy link
Contributor

v0.20.912

@garfield69 garfield69 removed this from Done in Jackett Indexers May 8, 2022
@garfield69 garfield69 added Down / Waiting for removal Site is 522/500/403/302. To be Monitored. If still offline after 30d then Indexer will be removed. and removed PR Welcome! We would welcome a volunteer to prepare a PR to solve this problem! Needs C# labels Oct 5, 2022
@garfield69
Copy link
Contributor

https://www.erai-raws.info/wp-login.php/ returns

There has been a critical error on this website.

[Learn more about troubleshooting WordPress.](https://wordpress.org/support/article/faq-troubleshooting/)

@garfield69 garfield69 added this to Down / Waiting for removal in Jackett Indexers Oct 5, 2022
@garfield69 garfield69 removed the Down / Waiting for removal Site is 522/500/403/302. To be Monitored. If still offline after 30d then Indexer will be removed. label Oct 5, 2022
@garfield69 garfield69 removed this from Down / Waiting for removal in Jackett Indexers Oct 5, 2022
@garfield69
Copy link
Contributor

online

@garfield69
Copy link
Contributor

garfield69 commented Oct 18, 2022 •
edited

erairaws currently failing the Jackett TEST because someone has loaded a magnet URI into the infohash field of a torrent which generated an XML processing failure.
error:

Jackett.Common.IndexerException: Exception (erai-raws): An error occurred while parsing EntityName. Line 27, position 78.  ---> 
System.Xml.XmlException: An error occurred while parsing EntityName. Line 27, position 78.    at 
System.Xml.XmlTextReaderImpl.Throw(Exception e)    at System.Xml.XmlTextReaderImpl.Throw(String res, String arg)    at 
System.Xml.XmlTextReaderImpl.ParseEntityName()    at System.Xml.XmlTextReaderImpl.ParseEntityReference()    at 
System.Xml.XmlTextReaderImpl.Read()    at System.Xml.XmlLoader.LoadNode(Boolean skipOverWhitespace)    at 
System.Xml.XmlLoader.LoadDocSequence(XmlDocument parentDoc)    at System.Xml.XmlLoader.Load(XmlDocument doc, 
XmlReader reader, Boolean preserveWhitespace)    at System.Xml.XmlDocument.Load(XmlReader reader)    at 
System.Xml.XmlDocument.LoadXml(String xml)    at Jackett.Common.Indexers.EraiRaws.GetItemsFromFeed() in 
C:\Users\Garfield69\Documents\GitHub\Jackett\src\Jackett.Common\Indexers\EraiRaws.cs:line 125    at 
Jackett.Common.Indexers.EraiRaws.PerformQuery(TorznabQuery query) in 
C:\Users\Garfield69\Documents\GitHub\Jackett\src\Jackett.Common\Indexers\EraiRaws.cs:line 106    at 
Jackett.Common.Indexers.BaseIndexer.ResultsForQuery(TorznabQuery query, Boolean isMetaIndexer) in 
C:\Users\Garfield69\Documents\GitHub\Jackett\src\Jackett.Common\Indexers\BaseIndexer.cs:line 310    --- End of inner 
exception stack trace ---    at Jackett.Common.Indexers.BaseIndexer.ResultsForQuery(TorznabQuery query, Boolean 
isMetaIndexer) in C:\Users\Garfield69\Documents\GitHub\Jackett\src\Jackett.Common\Indexers\BaseIndexer.cs:line 322    at 
Jackett.Common.Indexers.BaseWebIndexer.ResultsForQuery(TorznabQuery query, Boolean isMetaIndexer) in 
C:\Users\Garfield69\Documents\GitHub\Jackett\src\Jackett.Common\Indexers\BaseIndexer.cs:line 692    at 
Jackett.Common.Services.IndexerManagerService.TestIndexer(String name) in 
C:\Users\Garfield69\Documents\GitHub\Jackett\src\Jackett.Common\Services\IndexerManagerService.cs:line 309    at 
Jackett.Server.Controllers.IndexerApiController.Test() in 
C:\Users\Garfield69\Documents\GitHub\Jackett\src\Jackett.Server\Controllers\IndexerApiController.cs:line 132    at 
Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(IActionResultTypeMapper 
mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)    at 
Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.
<InvokeActionMethodAsync>g__Awaited\|12_0(ControllerActionInvoker invoker, ValueTask`1 actionResultValueTask)    at 
Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.
<InvokeNextActionFilterAsync>g__Awaited\|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object 
state, Boolean isCompleted)    at 
Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)    at 
Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& 
isCompleted)    at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.
<InvokeInnerFilterAsync>g__Awaited\|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, 
Boolean isCompleted)    at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.
<InvokeFilterPipelineAsync>g__Awaited\|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, 
Boolean isCompleted)    at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.
<InvokeAsync>g__Logged\|17_1(ResourceInvoker invoker)    at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.
<InvokeAsync>g__Logged\|17_1(ResourceInvoker invoker)    at Microsoft.AspNetCore.Routing.EndpointMiddleware.
<Invoke>g__AwaitRequestTask\|6_0(Endpoint endpoint, Task requestTask, ILogger logger)    at 
Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)    at 
Jackett.Server.Middleware.CustomExceptionHandler.Invoke(HttpContext httpContext) in 
C:\Users\Garfield69\Documents\GitHub\Jackett\src\Jackett.Server\Middleware\CustomExceptionHandler.cs:line 26

xml (of the first two items)

<?xml version="1.0" encoding="UTF-8"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:erai="https://www.erai-raws.info/rss-page/" >

<channel>
	<title>Erai-raws Torrent RSS</title>
	<description>RSS Feed for Torrent Clients</description>
	<link>https://www.erai-raws.info</link>
	<language>en-US</language>
	<atom:link href="https://www.erai-raws.info/feed/?type=magnet&#038;0879fd62733b8db8535eb1be24e23f6d" rel="self" type="application/rss+xml" />
	
	

<image>
	<url>https://www.erai-raws.info/wp-content/uploads/2021/07/cropped-ER-icon1-1-32x32.png</url>
	<title>Erai-raws</title>
	<link>https://www.erai-raws.info</link>
	<width>32</width>
	<height>32</height>
</image> 

	<item>
	<title>[Magnet] Shingeki no Kyojin: The Final Season Part 2 - 08 [1080p][us][br][mx][es][sa][fr][de][it][ru][Airing]</title>
	<link>magnet:?xt=urn:btih:f0f05ee499dd26ed661d19472a5760d8c22b837e&amp;dn=%5BErai-raws%5D%20Shingeki%20no%20Kyojin%20-%20The%20Final%20Season%20Part%202%20-%2008%20%5B1080p%5D%5BMultiple%20Subtitle%5D%5B4A39875B%5D.mkv&amp;tr=http%3A%2F%2Fnyaa.tracker.wf%3A7777%2Fannounce&amp;tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&amp;tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&amp;tr=udp%3A%2F%2Fexodus.desync.com%3A6969%2Fannounce&amp;tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce</link>
	<pubDate>Mon, 17 Oct 2022 23:04:42 +0000</pubDate>
	<erai:resolution>1080p</erai:resolution>
	<erai:linktype>Magnet</erai:linktype>
	<erai:size>1.36 GiB</erai:size>
	<erai:infohash>magnet:?xt=urn:btih:5ec3878c88a12325074b8dcf0606bf302350c2ae&dn=%5BErai-raws%5D%20Shingeki%20no%20Kyojin%20-%20The%20Final%20Season%20Part%202%20-%2008%20%5B480p%5D%5BMultiple%20Subtitle%5D%5B0FABB3C1%5D.mkv&tr=http%3A%2F%2Fnyaa.tracker.wf%3A7777%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Fexodus.desync.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce</erai:infohash>
	<erai:subtitles>[us][br][mx][es][sa][fr][de][it][ru]</erai:subtitles><erai:category>[Airing]</erai:category>	<description>
		<![CDATA[<a href="https://www.erai-raws.info/episodes/shingeki-no-kyojin-the-final-season-part-2-08/">[Erai-raws] Shingeki no Kyojin - The Final Season Part 2 - 08 [1080p][Multiple Subtitle][4A39875B].mkv</a> | Subtitles: [us][br][mx][es][sa][fr][de][it][ru]  | Size: 1.36 GiB | InfoHash: magnet:?xt=urn:btih:5ec3878c88a12325074b8dcf0606bf302350c2ae&dn=%5BErai-raws%5D%20Shingeki%20no%20Kyojin%20-%20The%20Final%20Season%20Part%202%20-%2008%20%5B480p%5D%5BMultiple%20Subtitle%5D%5B0FABB3C1%5D.mkv&tr=http%3A%2F%2Fnyaa.tracker.wf%3A7777%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Fexodus.desync.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce | Categories: [Airing] ]]>
	</description>
</item>
								<item>
	<title>[Magnet] Shingeki no Kyojin: The Final Season Part 2 - 08 [720p][us][br][mx][es][sa][fr][de][it][ru][Airing]</title>
	<link>magnet:?xt=urn:btih:823dc95f205216e765123488088f1f84d447a410&amp;dn=%5BErai-raws%5D%20Shingeki%20no%20Kyojin%20-%20The%20Final%20Season%20Part%202%20-%2008%20%5B720p%5D%5BMultiple%20Subtitle%5D%5B5D15DB92%5D.mkv&amp;tr=http%3A%2F%2Fnyaa.tracker.wf%3A7777%2Fannounce&amp;tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&amp;tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&amp;tr=udp%3A%2F%2Fexodus.desync.com%3A6969%2Fannounce&amp;tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce</link>
	<pubDate>Mon, 17 Oct 2022 23:04:42 +0000</pubDate>
	<erai:resolution>720p</erai:resolution>
	<erai:linktype>Magnet</erai:linktype>
	<erai:size>711.97 MiB</erai:size>
	<erai:infohash>823DC95F205216E765123488088F1F84D447A410</erai:infohash>
	<erai:subtitles>[us][br][mx][es][sa][fr][de][it][ru]</erai:subtitles><erai:category>[Airing]</erai:category>	<description>
		<![CDATA[<a href="https://www.erai-raws.info/episodes/shingeki-no-kyojin-the-final-season-part-2-08/">[Erai-raws] Shingeki no Kyojin - The Final Season Part 2 - 08 [720p][Multiple Subtitle][5D15DB92].mkv</a> | Subtitles: [us][br][mx][es][sa][fr][de][it][ru]  | Size: 711.97 MiB | InfoHash: 823DC95F205216E765123488088F1F84D447A410 | Categories: [Airing] ]]>
	</description>
</item>

I don't think there is anything that can be done about this other than wait for the item to age past the first 100 items.

@ilike2burnthing
Copy link
Contributor

https://www.erai-raws.info/ - Error 504 - Gateway Timeout

@ilike2burnthing ilike2burnthing added the Down / Waiting for removal Site is 522/500/403/302. To be Monitored. If still offline after 30d then Indexer will be removed. label Nov 5, 2022
@ilike2burnthing ilike2burnthing added this to Down / Waiting for removal in Jackett Indexers Nov 5, 2022
@ilike2burnthing
Copy link
Contributor

back up

@ilike2burnthing ilike2burnthing removed this from Down / Waiting for removal in Jackett Indexers Nov 8, 2022
@ilike2burnthing ilike2burnthing removed the Down / Waiting for removal Site is 522/500/403/302. To be Monitored. If still offline after 30d then Indexer will be removed. label Nov 8, 2022
@garfield69
Copy link
Contributor

Note: the web site home page states: Announcement: The rss token has been updated.
Users will need to follow the config instructions to fetch the new RSSKey

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[New Tracker] Erai-Raws 6cUbi57z/Jackett
Fix Erai-Raws indexer 6cUbi57z/Jackett
5 participants
@6cUbi57z @garfield69 @hukasu @xxsxx47 @ilike2burnthing