💎 CerebroParser

Installation guide for CerebroParser.

Supported file extensions: TXT, CSV

Installing CerebroParser

git clone https://github.com/ElveeBolt/CerebroParser.git
cd CerebroParser

Linux / Ubuntu

python3 -m venv venv
source venv\bin\activate
pip install -r requirements.txt

Windows

python -m venv venv
venv\Scripts\activate
pip install -r requirements.txt

Configurate

First you must rename settings_conf.py to settings.py and check settings in this files

# Mongo settings
HOST = 'mongodb://127.0.0.1'
PORT = 27017

# File Database
FILE_PATH = 'database/database.csv' # path to your database file
FILE_ENCODING = 'utf-8' # encoding your data
HEADER = True # if your file have header use True.
DELIMITER = ';' # delimiter your data in rows
DATA_INDEXES = [0, 1, 2, 3, 4] # indices of columns your file

# Database settings
DATABASE = 'Database' # database name
COLLECTION = 'collection_' # collection names
COLLECTION_SIZE = 5000000 # collection size
INSERT_COUNT = 10000 # we use 'Insert many'. You can config size items in package

Ready to use

python main.py