Join GitHub today
GitHub is home to over 36 million developers working together to host and review code, manage projects, and build software together.Sign up
Add hierarchical BERT model #25
This is a hierarchical model on top of BERT. This would directly be applicable to relevance transfer, since I am assuming that the primary reason for poor results is the truncation of documents to 512 tokens.
My commit history isn't clean so feel free to squash the changes.