As a first step we can try a fixed tuning, using the existing weights, plus a classifier that we train with our labels. The approach suggested is to use a MLP for classification where the Bert4eth model is used for the embedding.