Multi-label classification

[Baran-phys]

How can one use this for multi-label classification?

[lucidrains]

@Hosein47 yea of course! it's just a separate loss function, and independent of the model

for multi-label, you'll go with a binary cross entropy loss instead

[Baran-phys]

Hmm, tnx. Which transformer method do you deem the best for multi-label classification? I mean Sinkhorn or routing or any other?

[lucidrains]

@Hosein47 They will all work for multi-label, since the difference is just in the loss function, not the architecture