Skip to content

Consider .generate() allowing tokenized inputs if preprocessor=None #913

@mattdangerw

Description

@mattdangerw

We want .generate() to feel similar to .fit(), .predict(), and .evaluate() on a model.

We should consider allowing .generate() to token id input directly (for example, with custom packing of special tokens), if preprocessor=None. In this case the output should also be token id sequences, and not strings.

This would match with .fit(), .predict(), and .evaluate() behavior on a task model when preprocessor=None.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions