Skip to content

lineality/split_csv_python_script

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

31 Commits
 
 
 
 
 
 
 
 

Repository files navigation

split_csv_python_script

Split Large .csv Into Smaller Parts

PLUS: Recombine Split Parts

This is a Python script to make split .csv files into split files (2, 4, 8, 16, etc.) that collectively contain or retain all of the data. & This is a Python script that can Recombine parts that have been split. (To recombine, enter 'combine' instead of a split number as a parameter.)

For example, if one file is too big, and you want to make four smaller files that contain all the data.

This requires pandas to be installed (e.g. in pipenv shell).

If you want the file split into 4 files, set the split number to 2.

This will automatically split all files in the directory the specified number of times.

For example: Running this script two times, each time set to: 2 (resulting files) is the same as running this script one time, set to 4 (resulting files).

The original file is retained, but renamed with

_original

added to the end. E.g.

MY_FILE.csv_original

This tool can be run as a python script or in a python notebook.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages