[BUG] ResidualVQ always initializes MLPs

[hummat]

MLPs in ResidualVQ are always initialized, even if implicit_neural_codebook=False.

vector-quantize-pytorch/vector_quantize_pytorch/residual_vq.py

Line 153 in 54d29e8

self.mlps = ModuleList([MLP(dim = codebook_dim, l2norm_output = first(self.layers).use_cosine_sim, **mlp_kwargs) for _ in range(num_quantizers - 1)])

[lucidrains]

@hummat oops, yes indeed

thank you Matthias!