Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
mindhash committed Nov 29, 2018
1 parent a5c24c3 commit 6bcbc45
Showing 1 changed file with 42 additions and 41 deletions.
83 changes: 42 additions & 41 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# hyperflow

hyperflow is a Machine learning platform for growing teams. The platform adds reusuability and scalability to your machine learning stack. It does by componentizing model development and executing training tasks inside containers.

You can use the current version of hflow just keeping track of model-experiment cycle or also utilize containerized (docker) training and automated version control when deployed with kubernetes.
Expand All @@ -9,45 +9,46 @@ The project is in alpha stage but if you are keen to try out do write us at beek

# Key Features:

Reduced experimentation time: Componentization and parallel training on cloud to optimise time to experiment. Don't spend weeks to experiment when you can finish in days.
Ease-of-use: Launch tasks (e.g training, data processing) with a single command
Version control: Code, data and model versioning for reproducibility
Track experiments: Keep track of experiment results with versions. Whether you are tuning hyperparameters, or trying out variants of a model, with hyperflow you don't need to queue up training jobs on your personal system.
Deploy on premise or on private cloud
Team Collaboration: Clone repos to share work with team members, share datasets, resources and Infrastructure
Documentation: Write documentation around repo, model or dataset usage
Framework Support: Tensorflow, Keras, pytorch out of box. You can add your own as a docker image
GPU Support


# Initiate repo
>> hflow init my_repo
Repo my_repo initiated

# upload dataset (optional)
>> cd /home/data
>> hflow init my_dataset
>> hflow push
# submit training task
>> cd my_repo
>> hflow run "python my_training_program.py" --data my_dataset
Flow Id: erwed43i5jin5423423d

# monitor status
>> hflow status
Flow Id: erwed43i5jin5423423d
Status: RUNNING

# view execution log
>> hflow log
# download saved model (optional)
>> hflow pull saved_models
Model files downloaded to ./saved_models

# download results or output files (optional)
>> hflow pull results
Results downloaded in ./results
* Reduced experimentation time: Componentization and parallel training on cloud to optimise time to experiment. Don't spend weeks to experiment when you can finish in days.
* Ease-of-use: Launch tasks (e.g training, data processing) with a single command
* Version control: Code, data and model versioning for reproducibility
* Track experiments: Keep track of experiment results with versions. Whether you are tuning hyperparameters, or trying out variants of a model, with hyperflow you don't need to queue up training jobs on your personal system.
* Deploy on premise or on private cloud
* Team Collaboration: Clone repos to share work with team members, share datasets, resources and Infrastructure
* Documentation: Write documentation around repo, model or dataset usage
* Framework Support: Tensorflow, Keras, pytorch out of box. You can add your own as a docker image
* GPU Support

A typical workflow with hf will look like:

##### Initiate repo
$ hflow init my_repo <br />
> Repo my_repo initiated
##### upload dataset (optional)
$ cd /home/data <br />
> hflow init my_dataset <br />
> hflow push <br />
##### submit training task
$ cd my_repo <br />
$ hflow run "python my_training_program.py" --data my_dataset <br />
> Flow Id: erwed43i5jin5423423d <br />
##### monitor status
$ hflow status <br />
> Flow Id: erwed43i5jin5423423d <br />
> Status: RUNNING <br />
##### view execution log
$ hflow log <br />

##### download saved model (optional)
$ hflow pull saved_models <br />
> Model files downloaded to ./saved_models
##### download results or output files (optional)
$ hflow pull results <br />
> Results downloaded in ./results <br />

0 comments on commit 6bcbc45

Please sign in to comment.