Skip to content
View shivendrra's full-sized avatar
🎯
Focusing
🎯
Focusing
23 followers · 27 following

Achievements

Achievement: Pull Sharkx3Achievement: Starstruckx2Achievement: QuickdrawAchievement: YOLO

Achievements

Achievement: Pull Sharkx3Achievement: Starstruckx2Achievement: QuickdrawAchievement: YOLO

Organizations

@delveopers

Block or report shivendrra

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
shivendrra/README.md

"what i can't create, i don't understand" - Richard Feynman

About me

Hello, I'm Shivendra. I like to code and make videos. Check out some of my previous work at Vakya

Main Projects:

1- SmallLanguageModel [completed, closed]: Making a LLM from scratch all the way from generating raw training data to tokenizing it, creating a model & then training it.

2- Enigma [completed, closed]: Transformer model trained on raw DNA data to predict the next letter of the DNA.

3- Axon [completed, updating]: Lightweight multi-dimensional array manipulation library powered by GPU.

4- Axgrad [completed, updating]: Lightweight Tensor manipulation library like PyTorch written in c/c++, cuda & python.

5- Axon.drop [completed, closed]: A small & lightweight, experimental Tensor manipulation library wrapped on top of Scalar level autograd, written in c/c++, cuda & python.

6- WebGraze [completed, closed]: A Python-based library for scraping data from various sources on the internet. For ML usecases.

7- Synapse [completed, closed]: A free platform for streaming music & audio/podcasts, based on Youtube V3 API.

8- Micrograd.c [completed, closed]: Micrograd by Karpathy written in C & C++.

9- Tqdm.c [completed, closed]: Tqdm library of python for c/c++ code usage.

10- AVA [in progress, backlogged]: A multimodal ai system inspired by AVA from Ex-Machina, but currently more like OpenAi's 4o, (I started working on it prior to the model launch).

11- Shred [completed, updating]: Fast & efficient BPE tokenizer written in C & python for LLM tranining.

12- Enigma2 [in progres, backlogged]: Second version of Enigma to predict & classify DNA & proteins more accurately using Transformers.

13- Biosaic [completed, updating]: Tokenizer for DNA & Protein specific ML applications, for Enigma2 specifically and other applicable programs if any.

Socials

Instagram | Twitter | LinkedIn | Youtube

📊 GitHub Stats:

Pinned Loading

  1. SmallLanguageModel SmallLanguageModel Public

    a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model

    Jupyter Notebook 147 19

  2. axgrad axgrad Public

    lightweight tensor library that contains it's own auto-diff engine like pytorch

    C++ 3

  3. delveopers/Axon delveopers/Axon Public

    Lightweight multi-dimensional array manipulation library powered by GPU

    C++

  4. enigma2 enigma2 Public

    dna protein prediction using transformer. second version of engima

    Python 1

  5. delveopers/Shredword delveopers/Shredword Public

    Fast & efficient BPE tokenizer written in C & python for LLM tranining

    C++

  6. micrograd.c micrograd.c Public

    kaprathy's micrograd implemented in c & cpp

    C