Skip to content

dmcinerney/pytt

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Pytt

NOTE: This package is actively under construction! It does not have propper tests yet!

pytt is a package designed for training and testing (tt) pytorch models, offering a generalized, structured, and extensible way to batch data, load batches (using a pytorch dataloader as a backend with multithreading support), train model, checkpoint training, and test model. It provides multi-gpu and delayed updates support, and any model trained with this is completely reproduceable because random states are a part of the checkpointing.

Installation

pip install -e git+git://github.com/dmcinerney/pytt.git#egg=pytt

Customization Examples

Some examples of options for customization:

  • pytt.batching.abstract_batcher.AbstractIndicesIterator can be overridden and used to create an object that can be passed into the pytt.batching.standard_batcher.Batcher.batch_iterator method
  • pytt.batching.abstract_batcher.AbstractInstance can be overridden and used in place of pytt.batching.standard_batcher.StandardInstance by overriding the pytt.batching.standard_batcher.StandardBatcher.process_datapoint method
  • The pytt.training.trainer.Trainer can be extended by overriding the process_batch and step functions to use many different types of training proceedures.

About

Pytorch Training and Testing, a module containing advanced and organized batching, training, and testing with multi-gpu and delayed update support

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages