New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New file loader #3

Open

kbgro wants to merge 6 commits into kito129:main from kbgro:new_file_loader

Contributor

kbgro commented Nov 29, 2021

this branch contains feature such as

loading all files from all source folders
compression of bz2 files using multiprocessing

kbgro added 6 commits

November 23, 2021 10:49


          add git ignore

9560db9


          add settings module


          add loader module - load all raw files

99b9483


          extract bz2 to json using multiprocessing

c3e16f1


          rewrite main to support new loaded file

9ce93c5


          minimal project requirements

fb60c92

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment