Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gan is real...Look what tiny just generated! #192

Merged
merged 4 commits into from
Dec 14, 2020

Conversation

kartik4949
Copy link
Contributor

@kartik4949 kartik4949 commented Dec 13, 2020

Had mode collapse problem because of
bad distribution choice - np.random.uniform

Convergence Problem
couldnt get the Equilibrium.
because of bad ADAM lr and b value

#161

@kartik4949
Copy link
Contributor Author

@geohot @skoshx
See what this TinyGrad has generated in 100 epochs i.e 2-3 hours roughly:
mnist_by_tinygrad

@kartik4949 kartik4949 changed the title Gan is real... Gan is real...Look what tiny just generated! Dec 13, 2020
@skoshx
Copy link
Contributor

skoshx commented Dec 13, 2020

@kartik4949 Incredible! Just goes to show what a small library with concise code can accomplish!

What I really want to accomplish now is to optimize the GPU Ops and work on ANE support (although i first need to get the M1 Macbook :D ). The big advantage of tinygrad in my opinion comes from the ability to use other GPUs than just Nvidia, and I think it will attract a lot of users.

Great work!!

@kartik4949
Copy link
Contributor Author

kartik4949 commented Dec 13, 2020

Cheers!
Also readability is top notch thanks to @geohot

@geohot geohot merged commit 1a1c63a into tinygrad:master Dec 14, 2020
@kartik4949 kartik4949 deleted the gan_enhancements branch December 14, 2020 06:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants