Beta Binomial, Cumulative Attention, and other changes

[rafaelvalle]

No description provided.

[serg06]

Two issues:

1: requirements.txt needs to be updated because scipy==1.0.0 doesn't support Beta Binomial:

(flowtron) C:\repo\flowtron-clean>python train.py -c config.json
Traceback (most recent call last):
  File "train.py", line 27, in <module>
    from data import Data, DataCollate
  File "C:\repo\flowtron-clean\data.py", line 26, in <module>
    from scipy.stats import betabinom
ImportError: cannot import name 'betabinom'

2: How do we install radam? My code is failing here and I can't figure out what to pip install or conda install:

(flowtron) C:\repo\flowtron-clean>python train.py -c config.json
Traceback (most recent call last):
  File "train.py", line 29, in <module>
    from radam import RAdam
ModuleNotFoundError: No module named 'radam'

---

Edit: Looking at your commits, looks like this is solved now. Thanks!