A toy implementation of "DUMA: Reading Comprehension with Transposition Thinking", unofficial. Not sure if this code is completely correct, and I've only tested the base version of ALBERT.
https://arxiv.org/abs/2001.09415
https://github.com/google-research/albert
https://github.com/huggingface/transformers