Skip to content

amerywu/ikodaCsvLibsvmCreator

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ikodaCsvLibsvmCreator

ikodaCsvLibsvmCreator collects data into a simple dataframe.

It saves the output to file in CSV or LIBSVM format. It can also divide the data into a CSV and a LIBSVM component.

In addition, ikodaCsvLibsvmCreator streams the data to a Spark cluster.

ikodaCsvLibsvmCreator :

  1. Collects data dynamically. New columns create on the fly.
  2. Maintains a UID for each column.
  3. Maintains a category or label for each row.
  4. Maintains human readable text column and label names for sparse (LIBSVM) data
  5. Runs thread safe instances for the synchronous collection of distinct datasets.
  6. Saves data as a CSV or LIBSVM (either appending or overwriting).
  7. Divides the data for saving into LIBSVM and CSV components.
  8. Opens Data in CSV or LIBSVM format.
  9. Merges CSV files.
  10. Merges LIBSVM files.
  11. Streams data to a Spark cluster
  12. Emails the data in CSV format

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published