Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/v2 #201

Merged
merged 89 commits into from
Jun 6, 2024
Merged

Feature/v2 #201

merged 89 commits into from
Jun 6, 2024

Conversation

FL33TW00D
Copy link
Collaborator

No description provided.

Copy link

github-actions bot commented May 17, 2024

Code Metrics Report
  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 TOML                    1           74           62            2           10
-------------------------------------------------------------------------------
 Rust                   62        10438         8994          119         1325
 |- Markdown            30          270            0          210           60
 (Total)                          10708         8994          329         1385
===============================================================================
 Total                  63        10512         9056          121         1335
===============================================================================
  

@FL33TW00D
Copy link
Collaborator Author

FL33TW00D commented May 17, 2024

Now we can render the following from our tensors:

@group(0) @binding(0)
var<storage, read> X0: array<f32>;
@group(0) @binding(1)
var<storage, read> X1: array<f16>;
@group(0) @binding(2)
var<storage, read> X2: array<u32>;
@group(0) @binding(3)
var<storage, read_write> X3: array<f32>;

Test of interest: https://github.com/huggingface/ratchet/pull/201/files#diff-d764a0a61755e5c830799f2036b0737842cd02cb9377ecb47bacab761c2859b0R189

EDIT: already needs to be rewritten.

@FL33TW00D
Copy link
Collaborator Author

TODO:

  1. Bring back vectorized GEMM & GEMV
  2. Fix whisper end to end
  3. Refactor matmuls

@FL33TW00D FL33TW00D marked this pull request as ready for review June 6, 2024 16:06
@FL33TW00D FL33TW00D merged commit 4ff7092 into master Jun 6, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants