opensubtitles-scraper

result

torrent RSS feed: opensubtitles.org.dump.torrent.rss

usage

download the torrents from section result
download subtitles_all.txt.gz from https://dl.opensubtitles.org/addons/export/
run subtitles_all.txt.gz-parse.py to build subtitles_all.db
- python3 subtitles_all.txt.gz-parse.py subtitles_all.db subz_metadata subtitles_all.txt.gz subtitles_all.txt.gz-parse-errors.txt subtitles_all.txt.gz-parse-debug.txt
fix the values for db_path in local-subtitle-providers.json

run get-subs.py to get subtitles for a movie:

~/src/opensubtitles-scraper/get-subs.py Scary.Movie.2000.mp4

video_path Scary.Movie.2000.mp4
video_filename Scary.Movie.2000.mp4
video_parsed MatchesDict([('title', 'Scary Movie'), ('year', 2000), ('container', 'mp4'), ('mimetype', 'video/mp4'), ('type', 'movie')])
output 'Scary.Movie.2000.en.00018286.sub' from 'Scary_eng.txt' (us-ascii)
output 'Scary.Movie.2000.en.00018615.sub' from 'Scary Movie.txt' (us-ascii)
output 'Scary.Movie.2000.en.00106539.sub' from 'Scary Movie - ENG.txt' (us-ascii)
output 'Scary.Movie.2000.en.00117707.sub' from 'scream_english.sub' (iso-8859-1)
output 'Scary.Movie.2000.en.00203573.sub' from 'Scary Movie - ENG.txt' (us-ascii)
output 'Scary.Movie.2000.en.00204203.sub' from 'Scary Movie_engl.sub' (iso-8859-1)
output 'Scary.Movie.2000.en.03112243.srt' from 'Scary Movie 1 (2000).en.bug-fixed.srt' (Windows-1252)
output 'Scary.Movie.2000.en.03142326.srt' from 'kns-sm.srt' (Windows-1252)
output 'Scary.Movie.2000.en.03279944.srt' from 'Scary Movie 1 iNT DvD RiP- WaCkOs.srt' (Windows-1252)
output 'Scary.Movie.2000.en.03318665.srt' from 'rvlt-scarymovie.srt' (us-ascii)
output 'Scary.Movie.2000.en.03552139.srt' from 'Scary Movie.srt' (us-ascii)
output 'Scary.Movie.2000.en.03686957.sub' from 'Scary.Movie.(2000).DVDRIP.Divx.DOMiNION.sub' (iso-8859-1)
output 'Scary.Movie.2000.en.04867080.srt' from 'Scary.Movie.2000.BrRip.720p.x264.YIFY-eng.srt' (Windows-1252)
output 'Scary.Movie.2000.en.05115082.srt' from 'Scary Movie 1.[2000].UNRATED.DVDRIP.XVID.[Eng]-DUQA®.srt' (Windows-1252)
...

subtitles server

to run your own subtitles server, see docs/lighttpd.conf to expose get-subs.py as a CGI script on an HTTP server

based on

5719123 subtitles from opensubtitles.org by -marked-4life
- opensubtitles.org.Actually.Open.Edition.2022.07.25.torrent
cloudflare bypassing with commercial scraping services
bittorrent

offline version of opensubtitles

useful for subtitle-fetchers like

scraping

opensubtitles.org is protected by cloudflare, so im using a scraping proxy (zenrows.com). with max_concurrency = 10 in fetch-subs.py, one request takes about 0.2 seconds.

videos:

Name		Name	Last commit message	Last commit date
Latest commit History 324 Commits
.github.ignore/workflows		.github.ignore/workflows
docs		docs
lib/thirdparty		lib/thirdparty
nix		nix
opensubtitles_dump_client		opensubtitles_dump_client
release		release
torrent-client		torrent-client
.gitignore		.gitignore
.gitmodules		.gitmodules
AiohttpMozillaCookieJar.py		AiohttpMozillaCookieJar.py
bench-fast.sh		bench-fast.sh
bench.sh		bench.sh
benchmark-compression.sh		benchmark-compression.sh
crc16.py		crc16.py
extract.py		extract.py
fetch-subs-add-zipfiles.sh		fetch-subs-add-zipfiles.sh
fetch-subs-chromium.sh		fetch-subs-chromium.sh
fetch-subs-fix-filenames.py		fetch-subs-fix-filenames.py
fetch-subs-progress.sh		fetch-subs-progress.sh
fetch-subs-runner.py		fetch-subs-runner.py
fetch-subs-zenrows.sh		fetch-subs-zenrows.sh
fetch-subs.py		fetch-subs.py
find_ads.py		find_ads.py
get-subs.py		get-subs.py
get-subs.sh.milahuuuc365.onion.sh		get-subs.sh.milahuuuc365.onion.sh
info.txt		info.txt
iso639-2.tsv		iso639-2.tsv
last-sub-add-date.txt		last-sub-add-date.txt
last-sub-add-date.txt.sh		last-sub-add-date.txt.sh
license.txt		license.txt
local-subtitle-providers.json		local-subtitle-providers.json
make-zip-with-duplicate-files.py		make-zip-with-duplicate-files.py
new-subs-404-dcma-files.py		new-subs-404-dcma-files.py
new-subs-archive-benchmark-sqlite.py		new-subs-archive-benchmark-sqlite.py
new-subs-archive-benchmark.py		new-subs-archive-benchmark.py
new-subs-archive.py		new-subs-archive.py
new-subs-clean-html.sh		new-subs-clean-html.sh
new-subs-hardlink-num.py		new-subs-hardlink-num.py
new-subs-migrate.py		new-subs-migrate.py
new-subs-missing-files.py		new-subs-missing-files.py
new-subs-pull.py		new-subs-pull.py
new-subs-push.py		new-subs-push.py
new-subs-rename-broken-zips.sh		new-subs-rename-broken-zips.sh
new-subs-rename-notfound-zips.sh		new-subs-rename-notfound-zips.sh
new-subs-rename-remove-num-part.py		new-subs-rename-remove-num-part.py
opensubs-db-split-by-lang-all-langs.py		opensubs-db-split-by-lang-all-langs.py
opensubs-db-split-by-lang.py		opensubs-db-split-by-lang.py
opensubs-metadata-dump-json.py		opensubs-metadata-dump-json.py
opensubs.db-count.sh		opensubs.db-count.sh
opensubs.db-last-num.sh		opensubs.db-last-num.sh
opensubtitles-ads.txt		opensubtitles-ads.txt
opensubtitles-ads.txt.sh		opensubtitles-ads.txt.sh
opensubtitles_adblocker.py		opensubtitles_adblocker.py
opensubtitles_adblocker_add.py		opensubtitles_adblocker_add.py
readme.md		readme.md
repack-clean.sh		repack-clean.sh
repack-size.sh		repack-size.sh
repack-speed.sh		repack-speed.sh
repack.py		repack.py
repack.sh		repack.sh
requirements.txt		requirements.txt
run.py		run.py
shards2release.py		shards2release.py
shell.nix		shell.nix
subs-added-stats.sh		subs-added-stats.sh
subtitles_all.txt.gz-parse.py		subtitles_all.txt.gz-parse.py
unpacked-zips-unpack.sh		unpacked-zips-unpack.sh
unzip.sh		unzip.sh
user_agents.json		user_agents.json

License

milahu/opensubtitles-scraper

Folders and files

Latest commit

History

Repository files navigation

opensubtitles-scraper