nsfwapp / NSFW_Scraper Public

Notifications You must be signed in to change notification settings
Fork 2
Star 8

Scraper to get Meta-data of all available scenes and movies and storing it to Postgresql every few days.

8 stars 2 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 60 Commits
.github/workflows		.github/workflows
.scrapy/httpcache/21sextury		.scrapy/httpcache/21sextury
nsfw_scraper		nsfw_scraper
.env.example		.env.example
.gitignore		.gitignore
README.md		README.md
chromedriver.exe		chromedriver.exe
scrapy.cfg		scrapy.cfg
supported_sites.md		supported_sites.md

Repository files navigation

NSFW_Scraper

Scraper to get Meta-data of all available scenes and movies and storing it to Postgresql every few days.

TODO

add this studios

Goals

First complete all todo's

For guys who use mongodb

use mongodb_pipeline branch here

Join Discord: NSFW_DEV

About

Scraper to get Meta-data of all available scenes and movies and storing it to Postgresql every few days.

metadata postgresql python3 scrapy mongodb-atlas nsfw-data

Custom properties

Report repository

Releases

No releases published

Packages

No packages published

Languages