Skip to content

Dimension mismatch in Residual VQ #233

@murnanedaniel

Description

@murnanedaniel

If codebook_dim is not equal to the input embedding dimension, we get:

RuntimeError: Sizes of tensors must match except in dimension 2. Expected size 128 but got size 8 for tensor number 1 in the list.

.../residual_vq.py", line 472, in forward
    all_residuals = cat((all_residuals, rearrange(residual, '... d -> ... 1 d')), dim = -2)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions