Permalink
Fetching contributors…
Cannot retrieve contributors at this time
45 lines (30 sloc) 689 Bytes

gluonnlp.data.batchify

Batchify functions can be used to transform a dataset into mini-batches that can be processed efficiently.

.. currentmodule:: gluonnlp.data.batchify

Batch Loaders

.. autosummary::
    :nosignatures:

    Stack
    Pad
    Tuple


Language Modeling

.. autosummary::
    :nosignatures:

    CorpusBatchify
    CorpusBPTTBatchify
    StreamBPTTBatchify

Embedding Training

.. autosummary::
    :nosignatures:

    EmbeddingCenterContextBatchify

API Reference

.. automodule:: gluonnlp.data.batchify
   :members:
   :imported-members:
   :special-members: __call__, __iter__