Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minimalist version of Mamba #53

Open
Zihan-Liu-00 opened this issue Dec 13, 2023 · 6 comments
Open

Minimalist version of Mamba #53

Zihan-Liu-00 opened this issue Dec 13, 2023 · 6 comments

Comments

@Zihan-Liu-00
Copy link

I'm looking for a very simple version for Mamba. And a teaching video of implementation will be great. I know professors are very busy, but are there any enthusiastic netizens to do tutorials?

@dejardim
Copy link

I would appreciate a tutorial as well! I'm a computer science student from CIn-UFPE, and we have recently established a GenAI Lab. We are interested in building a Minimal Mamba Pretrained Model with a Brazilian Portuguese language data.

@albertfgu
Copy link
Contributor

We'd be glad to see community effort here!

@G-Wamat
Copy link

G-Wamat commented Dec 13, 2023

It would be a pleasure to build a tutorial focused on Mamba. I am also a student at https://portal.cin.ufpe.br/

@LucasFig0
Copy link

I am a student at cin as well and i would like to see this happening

@evelynmitchell
Copy link

I found this Mamba explainer helpful:
https://www.youtube.com/watch?v=ouF-H35atOY
That pointed to the very thorough Annotated S4:
https://srush.github.io/annotated-s4/

I hope this helps.

@johnma2006
Copy link

Hi all, I wrote a minimal implementation here: https://github.com/johnma2006/mamba-minimal/tree/master. Hope it helps!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants