Skip to content

zhafed/lightnovel-crawler

 
 

Repository files navigation

Lightnovel Crawler

download win download linux Discord
PyPI version Python version Downloads License Build and Publish

An app to download novels from online sources and generate e-books.

Discord: https://discord.gg/wMECG2Q

Telegram: https://t.me/epub_smelter_bot

Table of contents

Installation

This application uses Calibre to convert ebooks.
Install it from https://calibre-ebook.com/download
Without it, you will only get output in epub, text, and web formats.

Standalone Bundle (Windows, Linux)

Windows: lncrawl.exe ~ 25MB

In Windows 8, 10 or later versions, it might say that lncrawl.exe is not safe to dowload or execute. You should bypass/ignore this security check to execute this program.

Linux: lncrawl ~ 30MB

It is recommended to install via pip if you are on Linux

To get older versions visit the Releases page

PIP (Windows, Mac, and Linux)

📦 A python package named lightnovel-crawler is available at pypi.

Make sure you have installed Python v3.6 or higher and have pip enabled. Visit these links to install python with pip in Windows, Linux and MacOS. Feel free to ask on the Discord server if you are stuck.

To install this app or to update installed one via pip, just run:

$ pip install -U lightnovel-crawler

In some cases you have to use python3 -m pip or pip3 or python -m pip. And you do not need --user option, if you are running from root.

Next, open your terminal and enter:

$ lncrawl

To view extra logs, use: lncrawl -lll

Docker

Docker is a convenient way to run it anywhere.

  • First clone the project.
$ git clone https://github.com/dipu-bd/lightnovel-crawler
  • Build docker:
$ cd lightnovel-crawler
$ docker build -t lncrawl -f ./scripts/Dockerfile .
  • Run commands using docker:
$ mkdir ~/Lightnovels
$ docker run -v ~/Lightnovels:/app/Lightnovels -it lncrawl

You can setup alias to the above command in your terminal's profile to run using single a single-word command.

Termux (Android)

Please read before proceeding:

  • It is not guaranteed that the app will run smoothly in all devices.
  • It may take a long time to install depending on your mobile processor.
  • It is recommended to use the bots on either Discord or Telegram if you are on mobile.

📱 Using Termux, you can run this app in your android phones too. Follow this instructions:

  • Install Termux from playstore.
  • Open the app and run these commands one by one:
    • pkg upgrade
    • pkg install python libxml2 libxslt libjpeg-turbo
    • pip install -U pip wheel setuptools
    • pip install lightnovel-crawler
    • termux-setup-storage
    • cd ~/storage/downloads
    • lncrawl
  • You can navigate up using Vol UP + W and down using Vol UP + S.

When there is a new update available, you can install it just by running pip install -U lightnovel-crawler. You will not have to run all the above commands again.

PyDroid

You can also use PyDroid in Android phones. Check this discussion for a custom script to run the app: dipu-bd#1137

Chatbots

Discord

Join our server: https://discord.gg/7A5Hktx

Or, visit this link to install discord bot to your own server: https://discordapp.com/oauth2/authorize?client_id=537526751170002946&permissions=51264&scope=bot

Telegram

Visit this link to get started with the telegram bot: https://t.me/epub_smelter_bot

Send !help to open the bot help message.

Heroku Deployment

Simply fill out the environment variables and you get a running instance.

Deploy

Running from source

  • First clone the repository:
$ git clone https://github.com/dipu-bd/lightnovel-crawler
  • Open command prompt inside of the project folder and install requirements:
$ pip install -r requirements.txt
  • Run the program (use python v3.6 or higher):
$ python lncrawl

Running the Bots

There are two chatbots available at this moment: Telegram and Discord. To run your own bot server, follow these instructions:

  • Clone this repository
$ git clone https://github.com/dipu-bd/lightnovel-crawler
$ pip3 install -r requirements.txt
  • Copy .env.example file to .env file. Edit this file and give your API credentials here.

  • To run the discord bot:

$ python3 lncrawl --bot discord --shard-id 0 --shard-count 1
  • To run the telegram bot
$ python3 lncrawl --bot telegram

There is a start.sh script to run a bot in ubuntu servers. It will basically execute the python3 lncrawl and send the task to run in background. I use it to run my discord bot in the server.

General Usage

Available options

$ lncrawl -h
================================================================================
╭╮╱╱╱╱╱╱╭╮╱╭╮╱╱╱╱╱╱╱╱╱╱╱╱╭╮╱╭━━━╮╱╱╱╱╱╱╱╱╱╭╮
┃┃╱╱╱╱╱╱┃┃╭╯╰╮╱╱╱╱╱╱╱╱╱╱╱┃┃╱┃╭━╮┃╱╱╱╱╱╱╱╱╱┃┃
┃┃╱╱╭┳━━┫╰┻╮╭╋━╮╭━━┳╮╭┳━━┫┃╱┃┃╱╰╋━┳━━┳╮╭╮╭┫┃╭━━┳━╮
┃┃╱╭╋┫╭╮┃╭╮┃┃┃╭╮┫╭╮┃╰╯┃┃━┫┃╱┃┃╱╭┫╭┫╭╮┃╰╯╰╯┃┃┃┃━┫╭╯
┃╰━╯┃┃╰╯┃┃┃┃╰┫┃┃┃╰╯┣╮╭┫┃━┫╰╮┃╰━╯┃┃┃╭╮┣╮╭╮╭┫╰┫┃━┫┃
╰━━━┻┻━╮┣╯╰┻━┻╯╰┻━━╯╰╯╰━━┻━╯╰━━━┻╯╰╯╰╯╰╯╰╯╰━┻━━┻╯
╱╱╱╱╱╭━╯┃ v2.31.0
╱╱╱╱╱╰━━╯ 🔗 https://github.com/dipu-bd/lightnovel-crawler
--------------------------------------------------------------------------------
usage: lncrawl [options...]
       lightnovel-crawler [options...]

optional arguments:
  -h, --help            show this help message and exit

  -v, --version         show program's version number and exit
  -l                    Set log levels. (-l = warn, -ll = info, -lll = debug).
  --list-sources        Display a list of available sources.
  --crawler [FILES ...]
                        Load additional crawler files.
  -s URL, --source URL  Profile page url of the novel.
  -q STR, --query STR   Novel query followed by list of source sites.
  -x [REGEX], --sources [REGEX]
                        Filter out the sources to search for novels.
  --login USER PASSWD   User name/email address and password for login.
  --format E [E ...]    Define which formats to output. Default: all.
  --add-source-url      Add source url at the end of each chapter.
  --single              Put everything in a single book.
  --multi               Build separate books by volumes.
  -o PATH, --output PATH
                        Path where the downloads to be stored.
  --filename NAME       Set the output file name
  --filename-only       Skip appending chapter range with file name
  -f, --force           Force replace any existing folder.
  -i, --ignore          Ignore any existing folder (do not replace).
  --all                 Download all chapters.
  --first [COUNT]       Download first few chapters (default: 10).
  --last [COUNT]        Download last few chapters (default: 10).
  --page START STOP.    The start and final chapter urls.
  --range FROM TO.      The start and final chapter indexes.
  --volumes [N ...]     The list of volume numbers to download.
  --chapters [URL ...]  A list of specific chapter urls.
  --bot {console,telegram,discord,test}
                        Select a bot. Default: console.
  --shard-id [SHARD_ID]
                        Discord bot shard id (default: 0)
  --shard-count [SHARD_COUNT]
                        Discord bot shard counts (default: 1)
  --suppress            Suppress all input prompts and use defaults.
  --close-directly      Do not prompt to close at the end for windows
                        platforms.
  --resume [NAME/URL]   Resume download of a novel containing in
                        /home/runner/work/lightnovel-crawler/lightnovel-
                        crawler/Lightnovels
  ENV                   [chatbots only] Pass query string at the end of all
                        options. It will be use instead of .env file. Sample:
                        "BOT=discord&DISCORD_TOKEN=***&LOG_LEVEL=DEBUG"

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
~~

Example Usage

Open your console and type lncrawl --version first to check if you have installed it properly. Here are some example usage of the app:

  • To start an interactive session: lncrawl

  • To download using an url: lncrawl -s https://boxnovel.com/novel/reincarnation-of-the-strongest-sword-god/

  • To search novels: lncrawl -q "Strongest Sword God"

  • To search novels from selected sources: lncrawl -q "Strongest Sword God" --sources

  • To download all chapters: lncrawl --all

  • To download first 25 chapters: lncrawl --first 25

  • To download all between two chapters: lncrawl --range 10 30

  • To download all between two chapter links: lncrawl -s https://novelfull.com/release-that-witch.html --chapters https://novelfull.com/release-that-witch/chapter-6-training-part-i.html https://novelfull.com/release-that-witch/chapter-8-months-of-the-demons-part-1.html

  • To download a specific volumes: lncrawl --volumes 2 3

  • To define output path: lncrawl -o "D:\Lightnovels\reincarnation-of-the-strongest-sword-god"

  • To delete the output folder if exists: lncrawl -f

  • To ignore the output folder if exists: lncrawl -i

  • To resume download where is has been left previously: lncrawl -i

  • To specify output formats: lncrawl --format epub pdf mobi

  • To display list of supported sources: lncrawl --list-sources

  • If you provide an option in the argument, it will skip it in the interactive session. If you want to disable all interactive prompts, pass --suppress at the end.

  • You can stack up options like this: lncrawl -s https://boxnovel.com/novel/reincarnation-of-the-strongest-sword-god/ -o "D:\Lightnovels\reincarnation-of-the-strongest-sword-god" --last 50 -i --format pdf --suppress

Development

You are very welcome to contribute in this project. You can:

  • create new issues pointing out the bugs.
  • solve existing issues.
  • add your own sources.
  • add new output formats.
  • create new bots.

Adding new source

  • Create new crawler using the sources/_template.py as template. Read the comments on the file for instructions.
  • You can find plenty examples in the sources folder.
  • Put your source file inside the language folder. The en folder has too many files, therefore it is grouped using the first letter of the domain name.

Adding new Bot

Supported sources

Request new one by creating a new issue.

We are supporting 208 sources and 238 crawlers.

ar Arabic

Source URL Version Contributors
🔍 https://arnovel.me/ 20 dipu-bd SirGryphin
https://rewayat.club/ 6 dipu-bd

en English

Source URL Version Contributors
🔍 http://boxnovel.org/ 27 dipu-bd yudilee
🔍 http://novelfull.com/ 44 dipu-bd SirGryphin yudilee kuwoyuki Galunid
http://ranobes.net/ 7 dipu-bd
http://readonlinenovels.com/ 63 dipu-bd SirGryphin yudilee amritoo
🤖 http://wnmtl.org/ 16 dipu-bd SirGryphin
http://www.fujitranslation.com/ 61 dipu-bd SirGryphin yudilee AncientCatz
🤖 http://www.wnmtl.org/ 16 dipu-bd SirGryphin
http://zenithnovels.com/ 15 dipu-bd
🤖🔍 https://1stkissnovel.love/ 69 dipu-bd SirGryphin yudilee kuwoyuki mchubby
https://88tangeatdrinkread.wordpress.com/ 71 dipu-bd SirGryphin yudilee AncientCatz
🔍 https://allnovel.org/ 39 dipu-bd SirGryphin yudilee kuwoyuki Galunid
🔍 https://allnovelfull.com/ 1 dipu-bd
https://amnesiactl.com/ 12 dipu-bd SirGryphin
🔍 https://asadatranslations.com/ 65 dipu-bd SirGryphin yudilee kuwoyuki
🤖 https://automtl.wordpress.com/ 65 dipu-bd SirGryphin yudilee AncientCatz
🔍🔑 https://babelnovel.com/ 27 dipu-bd yudilee kuwoyuki Galunid
https://bakapervert.wordpress.com/ 72 dipu-bd SirGryphin yudilee AncientCatz
🔍 https://bestlightnovel.com/ 19 dipu-bd SirGryphin yudilee kuwoyuki
🔍 https://booknet.com/ 3 dipu-bd
🔍 https://boxnovel.com/ 63 dipu-bd SirGryphin yudilee kuwoyuki
🔍 https://boxnovel.org/ 27 dipu-bd yudilee
https://chrysanthemumgarden.com/ 6 dipu-bd
🔍🖼️ https://coffeemanga.com/ 12 dipu-bd SirGryphin
🤖🔍 https://comrademao.com/ 10 dipu-bd SirGryphin
https://creativenovels.com/ 26 dipu-bd yudilee kuwoyuki tidux
https://crescentmoon.blog/ 57 dipu-bd yudilee
🔍 https://daonovel.com/ 14 dipu-bd SirGryphin
https://demontranslations.com/ 65 dipu-bd SirGryphin yudilee AncientCatz
https://dmtranslationscn.com/ 61 dipu-bd SirGryphin yudilee AncientCatz
🤖 https://dobelyuwai.wordpress.com/ 70 dipu-bd SirGryphin yudilee AncientCatz
🔍 https://dragontea.ink/ 15 dipu-bd SirGryphin mesmerlord
🔍 https://dummynovels.com/ 2 dipu-bd
https://exiledrebelsscanlations.com/ 66 dipu-bd SirGryphin yudilee AncientCatz
🔍 https://f-w-o.com/ 68 dipu-bd SirGryphin yudilee kuwoyuki
https://fanstranslations.com/ 5 dipu-bd SirGryphin
https://fujitranslation.com/ 61 dipu-bd SirGryphin yudilee AncientCatz
https://hostednovel.com/ 2 dipu-bd
https://hui3r.wordpress.com/ 61 dipu-bd SirGryphin yudilee
https://inadequatetranslations.wordpress.com/ 70 dipu-bd SirGryphin yudilee AncientCatz
https://infinitenoveltranslations.net/ 65 dipu-bd SirGryphin yudilee AncientCatz
https://isotls.com/ 56 dipu-bd SirGryphin yudilee
🤖 https://jpmtl.com/ 60 dipu-bd yudilee
https://justatranslatortranslations.com/ 65 dipu-bd SirGryphin yudilee AncientCatz
🔍 https://latestnovel.net/ 73 dipu-bd SirGryphin yudilee watzeedzad BorgSquared frybin
https://lazybirdtranslations.wordpress.com/ 64 dipu-bd SirGryphin yudilee AncientCatz
https://lemontreetranslations.wordpress.com/ 69 dipu-bd SirGryphin yudilee AncientCatz
https://lightnovel.world/ 60 dipu-bd SirGryphin yudilee
🔍 https://lightnovelbastion.com/ 6 dipu-bd
🔍 https://lightnovelheaven.com/ 63 dipu-bd SirGryphin yudilee kuwoyuki
🔍 https://lightnovelreader.org/ 4 dipu-bd
🔍 https://lightnovels.me/ 1 dipu-bd
🔍 https://lightnovelsonl.com/ 17 dipu-bd SirGryphin yudilee kuwoyuki
https://lightnovelstranslations.com/ 7 dipu-bd SirGryphin marcandjulien
🔍 https://listnovel.com/ 9 dipu-bd SirGryphin
🤖🔑 https://lnmtl.com/ 93 dipu-bd yudilee kuwoyuki
https://lunarletters.com/ 14 dipu-bd SirGryphin
🔍 https://m.readlightnovel.cc/ 10 dipu-bd SirGryphin yudilee
🔍 https://m.webnovel.com/ 76 dipu-bd yudilee
🔍 https://m.wuxiaworld.co/ 66 dipu-bd SirGryphin yudilee Galunid
🔍🖼️ https://mangachill.love/ 10 dipu-bd SirGryphin
https://mangatoon.mobi/ 6 dipu-bd yudilee
🔍🖼️ https://manhwachill.com/ 10 dipu-bd SirGryphin
https://miraslation.net/ 62 dipu-bd SirGryphin yudilee AncientCatz
🤖🔍 https://mtlreader.com/ 2 dipu-bd
🔍 https://myboxnovel.com/ 63 dipu-bd SirGryphin yudilee kuwoyuki
🔍 https://mysticalmerries.com/ 66 dipu-bd SirGryphin yudilee kuwoyuki
🔍 https://novel27.com/ 66 dipu-bd SirGryphin yudilee kuwoyuki
🔍 https://novelcake.com/ 12 dipu-bd SirGryphin
🔍 https://novelfull.com/ 44 dipu-bd SirGryphin yudilee kuwoyuki Galunid
🔍 https://novelfullplus.com/ 7 dipu-bd
🔍 https://novelgate.net/ 12 dipu-bd SirGryphin
🔍 https://novelhi.com/ 3 dipu-bd
🤖 https://novelmao.com/ 2 dipu-bd
🖼️ https://novelmic.com/ 18 dipu-bd SirGryphin
🔍 https://novelonlinefree.com/ 19 dipu-bd SirGryphin yudilee kuwoyuki
🔍 https://novelonlinefull.com/ 16 dipu-bd yudilee kuwoyuki
🔍 https://novels.pl/ 4 dipu-bd
🔍 https://novelsite.net/ 11 dipu-bd SirGryphin
https://novelsonline.net/ 71 dipu-bd SirGryphin yudilee
🤖🔍 https://noveltranslate.com/ 6 dipu-bd SirGryphin
🔍 https://noveltrench.com/ 65 dipu-bd SirGryphin yudilee kuwoyuki
https://ranobes.net/ 7 dipu-bd
https://read.asianovel.com/ 11 dipu-bd mesmerlord
https://readlightnovel.me/ 71 dipu-bd yudilee
🔍 https://readlightnovels.net/ 26 dipu-bd yudilee
🖼️ https://readmanganato.com/ 57 dipu-bd SirGryphin yudilee
🔍 https://readnovelfull.com/ 68 dipu-bd SirGryphin yudilee kuwoyuki Galunid
🔍 https://readwebnovels.net/ 66 dipu-bd SirGryphin yudilee kuwoyuki
https://reincarnationpalace.com/ 62 dipu-bd SirGryphin yudilee AncientCatz
https://rpgnoob.wordpress.com/ 70 dipu-bd SirGryphin yudilee AncientCatz
https://rpgnovels.com/ 70 dipu-bd SirGryphin yudilee AncientCatz
https://shalvationtranslations.wordpress.com/ 66 dipu-bd SirGryphin yudilee AncientCatz
🔍 https://skynovel.org/ 12 dipu-bd SirGryphin
https://sleepytranslations.com/ 13 dipu-bd SirGryphin
https://smnovels.com/ 59 dipu-bd SirGryphin yudilee
https://steambunlightnovel.com/ 13 dipu-bd SirGryphin
🔍 https://supernovel.net/ 64 dipu-bd SirGryphin yudilee kuwoyuki
🔍 https://tipnovel.com/ 65 dipu-bd SirGryphin yudilee kuwoyuki
🔍 https://toc.qidianunderground.org/ 6 dipu-bd BorgSquared
https://tomotranslations.com/ 9 dipu-bd
https://totallytranslations.com/ 4 dipu-bd
https://travistranslations.com/ 3 dipu-bd SirGryphin
https://veratales.com/ 69 dipu-bd SirGryphin yudilee AncientCatz
🔍 https://vipnovel.com/ 66 dipu-bd SirGryphin yudilee kuwoyuki
https://vistranslations.wordpress.com/ 70 dipu-bd SirGryphin yudilee AncientCatz
https://webnovelonline.com/ 11 dipu-bd kuwoyuki
🔍 https://webnovelonline.net/ 67 dipu-bd SirGryphin yudilee kuwoyuki
🤖 https://wnmtl.org/ 16 dipu-bd SirGryphin
🔍 https://wondernovels.com/ 11 dipu-bd SirGryphin
🔍 https://woopread.com/ 7 dipu-bd SirGryphin skyme5
🔍 https://wordexcerpt.com/ 11 dipu-bd SirGryphin yudilee
https://wujizun.com/ 73 dipu-bd SirGryphin yudilee AncientCatz
🤖🔍 https://wuxia.city/ 2 dipu-bd Joacchim
🔍 https://wuxiaworld.name/ 23 dipu-bd SirGryphin yudilee kuwoyuki
https://wuxiaworld.online/ 27 dipu-bd SirGryphin yudilee
https://wuxiaworldsite.co/ 5 dipu-bd
🔍 https://www.allnovel.org/ 39 dipu-bd SirGryphin yudilee kuwoyuki Galunid
https://www.asianhobbyist.com/ 10 dipu-bd
https://www.box-novel.com/ 14 dipu-bd SirGryphin
https://www.divinedaolibrary.com/ 2 dipu-bd
🔍 https://www.f-w-o.com/ 68 dipu-bd SirGryphin yudilee kuwoyuki
🔍 https://www.fanfiction.net/ 14 dipu-bd
🔍 https://www.fictionpress.com/ 15 dipu-bd watzeedzad
https://www.flying-lines.com/ 10 dipu-bd
https://www.foxteller.com/ 6 dipu-bd
https://www.freelightnovel.com/ 10 dipu-bd SirGryphin
https://www.fuyuneko.org/ 64 dipu-bd SirGryphin yudilee AncientCatz
🤖 https://www.koreanmtl.online/ 8 dipu-bd
🔍 https://www.lightnovelpub.com/ 15 dipu-bd SirGryphin Galunid
🔍 https://www.lightnovelreader.org/ 4 dipu-bd
🔍 https://www.lightnovelworld.com/ 15 dipu-bd SirGryphin Galunid
🔍 https://www.ltnovel.com/ 5 dipu-bd SirGryphin watzeedzad
🤖🔍 https://www.machine-translation.org/ 10 dipu-bd yudilee kuwoyuki
https://www.miraslation.net/ 62 dipu-bd SirGryphin yudilee AncientCatz
🤖🔍 https://www.mtlreader.com/ 2 dipu-bd
🔍 https://www.neosekaitranslations.com/ 72 dipu-bd SirGryphin yudilee watzeedzad frybin
🔍 https://www.novelall.com/ 59 dipu-bd yudilee
🖼️ https://www.novelcool.com/ 29 dipu-bd SirGryphin yudilee mesmerlord
🤖 https://www.novelhall.com/ 57 dipu-bd yudilee
🔍 https://www.novelhunters.com/ 63 dipu-bd SirGryphin yudilee
🤖🔍 https://www.novelmt.com/ 4 dipu-bd watzeedzad
🔍 https://www.novelmtl.com/ 4 dipu-bd watzeedzad
🔍 https://www.novelmultiverse.com/ 16 dipu-bd SirGryphin
🔍 https://www.novelpassion.com/ 7 dipu-bd SirGryphin
🔍 https://www.novels.pl/ 4 dipu-bd
🔍 https://www.novelupdates.cc/ 11 dipu-bd SirGryphin yudilee
https://www.oppatranslations.com/ 63 dipu-bd SirGryphin yudilee AncientCatz
https://www.ornovel.com/ 60 dipu-bd SirGryphin yudilee
🔍 https://www.readlightnovel.cc/ 10 dipu-bd SirGryphin yudilee
https://www.readlightnovel.me/ 71 dipu-bd yudilee
🤖🔍 https://www.readwn.com/ 6 dipu-bd SirGryphin
🔍 https://www.royalroad.com/ 66 dipu-bd yudilee Epicpkmn11 aspin
🔍 https://www.scribblehub.com/ 23 dipu-bd yudilee Epicpkmn11
https://www.tapread.com/ 56 dipu-bd yudilee
https://www.virlyce.com/ 64 dipu-bd SirGryphin yudilee AncientCatz
🔍 https://www.volarenovels.com/ 60 dipu-bd yudilee kuwoyuki
🔍 https://www.webnovel.com/ 76 dipu-bd yudilee
🤖 https://www.wnmtl.org/ 16 dipu-bd SirGryphin
https://www.wuxialeague.com/ 5 dipu-bd
🔑 https://www.wuxiaworld.com/ 71 dipu-bd yudilee kuwoyuki
https://www.xiainovel.com/ 55 dipu-bd SirGryphin yudilee
🔍 https://zinnovel.com/ 11 dipu-bd SirGryphin

es Spanish, Castilian

Source URL Version Contributors
https://cclawtranslations.home.blog/ 69 dipu-bd SirGryphin yudilee AncientCatz
https://domentranslations.wordpress.com/ 69 dipu-bd SirGryphin yudilee AncientCatz

fr French

Source URL Version Contributors
🔍 https://chireads.com/ 4 dipu-bd
🤖🔍 https://lnmtlfr.com/ 4 dipu-bd

id Indonesian

Source URL Version Contributors
http://zhi-end.blogspot.co.id/ 61 dipu-bd SirGryphin yudilee AncientCatz
http://zhi-end.blogspot.com/ 61 dipu-bd SirGryphin yudilee AncientCatz
https://darktranslation.com/ 66 dipu-bd SirGryphin yudilee AncientCatz
https://grensia.blogspot.com/ 3 dipu-bd
https://indowebnovel.id/ 58 dipu-bd yudilee AncientCatz
https://meionovel.id/ 60 dipu-bd SirGryphin yudilee
🔍 https://morenovel.net/ 7 dipu-bd SirGryphin
https://novelgo.id/ 13 dipu-bd yudilee AncientCatz
https://novelringan.com/ 57 dipu-bd SirGryphin yudilee
🔍 https://noveltoon.mobi/ 3 dipu-bd
🔍 https://wbnovel.com/ 60 dipu-bd SirGryphin yudilee
https://webnovelindonesia.com/ 4 dipu-bd
https://www.idqidian.us/ 43 dipu-bd yudilee
🔍 https://www.webnovelover.com/ 64 dipu-bd SirGryphin yudilee
https://www.worldnovel.online/ 80 dipu-bd yudilee
https://yukinovel.id/ 54 dipu-bd yudilee

multi Multilingual

Source URL Version Contributors
🤖🔍 http://es.mtlnovel.com/ 21 dipu-bd yudilee kuwoyuki Galunid
🤖🔍 http://fr.mtlnovel.com/ 21 dipu-bd yudilee kuwoyuki Galunid
🤖🔍 http://id.mtlnovel.com/ 21 dipu-bd yudilee kuwoyuki Galunid
🤖🔍 http://www.mtlnovel.com/ 21 dipu-bd yudilee kuwoyuki Galunid
🔍 https://18.foxaholic.com/ 76 dipu-bd SirGryphin yudilee watzeedzad frybin mesmerlord
🤖🔍 https://es.mtlnovel.com/ 21 dipu-bd yudilee kuwoyuki Galunid
🔍 https://foxaholic.com/ 76 dipu-bd SirGryphin yudilee watzeedzad frybin mesmerlord
🤖🔍 https://fr.mtlnovel.com/ 21 dipu-bd yudilee kuwoyuki Galunid
🔍 https://global.foxaholic.com/ 76 dipu-bd SirGryphin yudilee watzeedzad frybin mesmerlord
🤖🔍 https://id.mtlnovel.com/ 21 dipu-bd yudilee kuwoyuki Galunid
https://my.w.tt/ 64 dipu-bd yudilee
🔍 https://www.foxaholic.com/ 76 dipu-bd SirGryphin yudilee watzeedzad frybin mesmerlord
🤖🔍 https://www.mtlnovel.com/ 21 dipu-bd yudilee kuwoyuki Galunid
https://www.wattpad.com/ 64 dipu-bd yudilee

ru Russian

Source URL Version Contributors
🔍 https://litnet.com/ 3 dipu-bd

vi Vietnamese

Source URL Version Contributors
🤖🔍 https://docln.net/ 5 dipu-bd
🤖🔍 https://ln.hako.re/ 5 dipu-bd
🤖🔍 https://truyenfull.vn/ 3 dipu-bd
🤖🔍 https://truyentr.info/ 3 dipu-bd

zh Chinese

Source URL Version Contributors
https://book.qidian.com/ 12 dipu-bd
🔍 https://tw.m.ixdzs.com/ 3 dipu-bd junqili259
https://www.aixdzs.com/ 15 dipu-bd
https://www.daocaorenshuwu.com/ 56 dipu-bd SirGryphin yudilee
https://www.soxs.cc/ 5 dipu-bd junqili259

Rejected sources

Source URL Rejection Cause
http://boxnovel.cloud/ No longer provides lightnovels
http://fastnovel.net/ Access denied
http://fullnovel.live/ This site can not be reached
http://gravitytales.com/ Domain is expired
http://hs2ppe.co.uk/ No longer provides lightnovels
http://novels.cloud/ This domain has expired
http://tiknovel.com/ No longer provides lightnovels
http://wspadancewichita.com/ Site closed and moved to https://readnovelfull.com/
http://wuxiaworld.cloud/ The domain has expired
http://www.hanyunovels.site/ Site is down
http://www.indonovels.net/ The domain has expired
http://www.machinenoveltranslation.com/ No longer provides lightnovels
http://www.tiknovel.com/ No longer provides lightnovels
https://4scanlation.com/ Domain expired
https://888novel.com/ Gets IP banned for using crawler
https://9kqw.com/ This domain has expired
https://anonanemone.wordpress.com/ No longer available
https://anythingnovel.com/ The domain is for sale
https://arangscans.com/ This site can not be reached
https://bestoflightnovels.com/ This site can not be reached
https://boxnovel.online/ This site can not be reached
https://clicknovel.net/ The domain has expired
https://dsrealmtranslations.com/ Domain expired
https://fsapk.com/ No longer provides lightnovels
https://indomtl.com/ Not crawler friendly
https://indonovels.blogspot.co.id/ The domain has expired
https://instadoses.com/ This site can not be reached
https://kiss-novel.com/ Site is down
https://light-novel.online/ The domain has expired
https://lightnovel.tv/ This site can not be reached
https://lightnovelkiss.com/ This site can not be reached
https://lightnovelshub.com/ No longer provides lightnovels
https://m.1ksy.com/ Web server is down
https://m.chinesefantasynovels.com/ Connection timed out
https://m.mywuxiaworld.com/ Web server is returning an unknown error
https://m.romanticlovebooks.com/ Web server is down
https://moonstonetranslation.com/ This site can not be reached
https://mtled-novels.com/ Domain is expired
https://myoniyonitranslations.com/ This site can not be reached
https://newsite.kolnovel.com/ Site is down
https://novelcrush.com/ Site is down
https://novelextra.com/ Invalid SSL certificate
https://novelplanet.com/ Site is closed
https://novelraw.blogspot.com/ Site closed down
https://novelsrock.com/ Web server is down
https://omgnovels.com/ Site is down
https://overabook.com/ Site is down
https://pery.info/ Site is down
https://ranobelib.me/ Access denied
https://readnovelz.net/ Redirects to webnovelonline.net
https://tiknovel.com/ No longer provides lightnovels
https://tunovelaligera.com/ Broken. Chapters does not load
https://viewnovel.net/ Site is down
https://webnovel.online/ The site has no content
https://wordexcerpt.org/ This site can not be reached
https://writerupdates.com/ Site is down
https://wuxiaworld.io/ Cloudflare Error 522, can not connect to host
https://wuxiaworld.live/ The domain has expired
https://wuxiaworld.site/ Access denied
https://www.1ksy.com/ Web server is down
https://www.anonanemone.wordpress.com/ No longer available
https://www.centinni.com/ Site is down
https://www.mywuxiaworld.com/ Web server is returning an unknown error
https://www.novelspread.com/ Site is down
https://www.noveluniverse.com/ Site is down
https://www.novelv.com/ Site is down
https://www.rebirth.online/ Redrects to https://foxteller.com/
https://www.romanticlovebooks.com/ Web server is down
https://www.shinsori.com/ This site can not be reached
https://www.tiknovel.com/ No longer provides lightnovels
https://www.translateindo.com/ Site is down
https://www.wuxiaworld.co/ This site can not be reached
https://www.x81zw.com/ This site can not be reached
https://www.xsbiquge.com/ Site is down

Supported output formats

  • JSON
  • EPUB
  • TEXT
  • WEB
  • DOCX
  • MOBI
  • PDF
  • RTF
  • TXT
  • AZW3
  • FB2
  • LIT
  • LRF
  • OEB
  • PDB
  • PML
  • RB
  • SNB
  • TCR
  • HTML

About

Generate and download e-books from online sources.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 93.9%
  • HTML 5.3%
  • Shell 0.4%
  • CSS 0.2%
  • Batchfile 0.1%
  • Dockerfile 0.1%