Skip to content

Bugs in model_utils.py #1

@thangld201

Description

@thangld201

Hi @zedian I see that in model_utils.py (L285-287), the Sinkhorn loss is commented out. Isn't this the loss used in training in the paper ?

        # alignment_loss = self.earth_mover_loss(                                                                                                                                
        #     self.get_weight(attention_mask), hidden_mat, self.get_weight(original_mask.reshape(attention_mask.shape)), original_embedding                                                                                       
        # )

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions