[WIP] Adding Attention Base Net

[bruAristimunha]

Hey @martinwimpff!

I am starting a new round of braindecode's models with your models.

[bruAristimunha]

@agramfort FYI

[codecov]

Codecov Report

Merging #572 (09adfb4) into master (97eba44) will increase coverage by 0.67%.
The diff coverage is 98.72%.

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #572      +/-   ##
==========================================
+ Coverage   86.47%   87.14%   +0.67%     
==========================================
  Files          63       65       +2     
  Lines        5419     5733     +314     
==========================================
+ Hits         4686     4996     +310     
- Misses        733      737       +4     

[bruAristimunha]

Can you help with some tests @martinwimpff?

[martinwimpff]

Can you help with some tests @martinwimpff?

Sure, what kind of tests are you looking for?

I saw that the doumentation for the attention modules is still missing. Are you already working on that @bruAristimunha or should I add them?

[bruAristimunha]

Please go ahead

[bruAristimunha]

There are two test sets that I see here, one of the model like I'm doing with BioT. Another of the attention functions @martinwimpff

[bruAristimunha]

pinging @martinwimpff

[bruAristimunha]

Maybe this help you @martinwimpff: https://tighten.com/insights/adding-commits-to-a-pull-request/

[bruAristimunha]

pinging @tomMoral

already fixed

[tomMoral]

A few comments but overall this looks good (did not check in details)

[bruAristimunha]

Model integrated @martinwimpff!

[bruAristimunha]

Thank you for the review @tomMoral