Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Site support request e926.net/e621.net #26753

Open
Feathered-Serpent opened this issue Sep 30, 2020 · 2 comments
Open

Site support request e926.net/e621.net #26753

Feathered-Serpent opened this issue Sep 30, 2020 · 2 comments

Comments

@Feathered-Serpent
Copy link

@Feathered-Serpent Feathered-Serpent commented Sep 30, 2020

Checklist

  • I'm reporting a new site support request
  • I've verified that I'm running youtube-dl version 2020.09.20
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that none of provided URLs violate any copyrights
  • I've searched the bugtracker for similar site support requests including closed ones

Example URLs

Description

e926 and e621 share the same format and IDs. e926 only contains sfw works, while e621 contains swf and nswf works (so all of the examples also will work with e621.net as domain)

I tried my best to find the (I think) useful information from a source code of the website.

Without having a cookie, a warning message appears at first asking for making sure one is over 18. But the source code for showing the artwork is already existing at this moment.

Example for the last Example URL:
Title
<meta name="og:title" content="kygen drawn by fattydragonite - e926">

ID (in case Title is not given maybe?)
<meta name="post-id" content="2362130">

Description (copied the whole div for this example; sorry for long line)

<div class="expandable-content styled-dtext original-artist-commentary">
<p>From source:</p><blockquote><h2>Break Time (ANIMATED SHORT FILM) - by <a class="dtext-link dtext-external-link" href="https://www.furaffinity.net/user/fattydragonite/">FattyDragonite</a></h2><p>WATCH HERE! <br><a class="dtext-link" href="https://www.youtube.com/watch?v=zUDA3_bxtF8">https://www.youtube.com/watch?v=zUDA3_bxtF8</a> </p><p>A kickboxing kangaroo facing tall hurdles learns that hard grueling work isn't the only ingredient in great accomplishments. </p><p>This short is heavily inspired by a project  a good friend, <a class="dtext-link dtext-external-link" href="https://www.furaffinity.net/user/kygen">Kygen</a> , made, called Chamber Roo, which featured a noire-esque world of intelligent kickboxing kangaroos, and since his birthday happened recently I felt it was the perfect time to pay homage. <br>Check it out here: <a class="dtext-link" href="https://www.furaffinity.net/view/30830484/">https://www.furaffinity.net/view/30830484/</a> </p><p>Overall the short took about one and a half months to complete, I hope you enjoy.</p></blockquote>
</div>

Upload date (for file date?)
<meta itemprop="uploadDate" content="2020-08-08T10:59:56-04:00">

Video (the src= would be the relevant part I guess)
<video id="image" class="fit-window" data-original-width="2560" data-original-height="1440" loop="loop" controls="controls" poster="https://static1.e926.net/data/sample/d6/74/d674b2fd4e6bb684e6dc6b145c30509b.jpg" src="https://static1.e926.net/data/d6/74/d674b2fd4e6bb684e6dc6b145c30509b.webm"></video>

@txmutt
Copy link

@txmutt txmutt commented Oct 1, 2020

For anyone who wants to implement this, e621 and e926 are based on the Danbooru image board codebase, so they can return raw JSON data if .json is appended to the end of any URL. For example:

https://e621.net/posts/2428116.json

will return JSON data for post #2428116. The direct link to the post's full-size media file hosted on their CDN can be found at this key: ['post']['file']['url'].

It's also worth mentioning that accessing any part of e621 or e926 requires sending a valid User-Agent to the server in the request headers. urllib3's and requests' are blocked, so you must supply your own.

EDIT: I've written an extractor for both sites and opened a PR. Stay tuned.

@Feathered-Serpent
Copy link
Author

@Feathered-Serpent Feathered-Serpent commented Oct 1, 2020

I didn't even knew about the json possibility. Great to point that out! So my information about the html source code probably should be ignored.

According to https://e621.net/help/supported_filetypes the only video file type would be WEBM.
But ffmpeg can convert APNG and GIF to e.g. a MKV file with ease. So it might be a supported thing as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.