NimbusFramework
| nr | Name | Description | In Background | Updateble | URL |
|---|---|---|---|---|---|
| 1 | Mongo DB | Document based db | YES | NO | https://www.mongodb.com/ |
| Core Options | Done |
|---|---|
| Create Core CommandLine Interface | NO |
| Create Banners | NO |
| Structure Commands | NO |
| Component Control by ThreadControlSystem | NO |
| Session registration by Database | NO |
| Argparse | YES |
| ArgComplete | NO |
| CommandLine Colors | NO |
| CommandLine Sounds | NO |
| CommandLine Tables | NO |
| Todo | Done |
|---|---|
| Create Virtual Env. | YES |
| Auto Deploy Vir. Env. | NO |
| Auto Start Vir. Env. | YES |
| Wrapper for Vir. Env. | NO |
| User login for Vir. Env. Activation | NO |
| Encrypt / Decrypt Vir. Env. | NO |
| Remote Session | NO |
| iPython Notebooks | NO |
| Core Important Options | Done |
|---|---|
| Threading | NO |
| Services | NO |
| Modules | YES |
| Plugins | YES |
| Body/Framework | YES |
| Documentation System Pythonic | NO |
| TODO | Done |
|---|---|
| Crawl Basics | YES |
| Looking Human | YES |
| Randomize User-Agents | YES |
| Handling Sessions | YES |
| Crawler Handling HTTP Error codes | YES |
| Storing Data to JSON | NO |
| Storing Data to XML | NO |
| Data normalization | NO |
| Send Email SMTP | YES |
| Submit Forms | NO |
| Handling Logins | NO |
| Handling Redirects | NO |
| Recognize Redirect | YES |
| Selenium | NO |
| Natural Language Toolkit | NO |
| Find Javascript | NO |
| Captcha Engine | NO |
| Unittest | NO |
| Remote execution | NO |
| Handling Cookies | YES |
| Reading Headers | YES |
| Avoid Honeypots | NO |
| Twitter crawl | NO |
| Sentiment Analyse | NO |
| Wget Downloads | NO |
| Use Custom CrawlerScript | NO |
| Handling Robot.txt | NO |
| Url Completion | YES |
| Handling encoding | NO |
| Recognize encoding | YES |
| Url Internal and External recognition | YES |
| Handling XPATH | NO |
| Crawler OOP | YES |
| Handling Cert. | NO |
| Path-Traversal | YES |
https://github.com/Goku0858756/NimbusFramework/tree/master/Database