Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make way for aarch64 #2

Merged
merged 38 commits into from Aug 14, 2023
Merged

Make way for aarch64 #2

merged 38 commits into from Aug 14, 2023

Conversation

jerinphilip
Copy link
Owner

@jerinphilip jerinphilip commented Aug 12, 2023 •
edited

Enable the following paths.

  1. google/ruy for aarch64 int8*int8 matmul (affine) - Mac M1, Android Phones.
  2. google/ruy for android aarch64 float32*float32 matmul (attention).
  3. Apple Accelerate for Mac M1 float32*float32 matmul (attention)

Effectively, this supports Mac (x86_64 Intel, aarch64 M1) and Android (untested, aarch64) now. There are obvious optimizations pending on some fronts in the newly created branches.

@jerinphilip
Add ruy as a dependency
a7a3e8d
@jerinphilip
Moving things around, refactor begins
3f6c1e7
@jerinphilip
Add android-ndk build script
08afe7f
@jerinphilip
Setting i8 specific header for time being
015bf8a
@jerinphilip
Have we regained compilation?
290a51f
@jerinphilip
Using templates for ODR co-existence
3e2ed1b
@jerinphilip
Ruy code in place, now I find the segfault
1a93363
@jerinphilip
B_cols changes to indices.size(), but not sure if this sticks?
d0391d9
@jerinphilip
Remove hacks around Wemb_QuantMultA
7132b44
@jerinphilip
Only selected_B_cols, not B_cols
7a8372b
@jerinphilip
Templating vectors...
a171aef
@jerinphilip
Move vectorized_ to simd.hh
234005b
@jerinphilip
w8 -> w4
f1c1149
@jerinphilip
Finishing up android ndk compile
ecf4968
@jerinphilip
MacOS M1 patches
8cf0bc9
@jerinphilip
Fix formatting after M1
06206c7
@jerinphilip
Add neon.h
9611c50
@jerinphilip
Updates to README.md
c387d33
@jerinphilip
Add submodule clone instructions in the README.md
2714f58
@jerinphilip
Add Apple Accelerate BLAS
7a234c3
@jerinphilip
Refine as a cmake-target?
01d2c72
@jerinphilip
Fix linking on actual M1
5e5c74f
@jerinphilip
Fix formatting
5c57a51
@jerinphilip
Indirect CI to sh via scripts
cc339e6
@jerinphilip
Update android paths and try
1c8e507
@jerinphilip
fail-fast false
cc2e477
@jerinphilip
Add an 03-test.sh placeholder
d9143fa
@jerinphilip
Empty, trigger CI
7c27280
@jerinphilip
Fix path from CI
1dcdcbd
@jerinphilip
Quote prefix
1c5b502
@jerinphilip jerinphilip changed the title aarch64 and associated refactor Make way for aarch64 Aug 14, 2023
@jerinphilip jerinphilip marked this pull request as ready for review August 14, 2023 07:57
@jerinphilip jerinphilip merged commit 774fbc7 into main Aug 14, 2023
4 checks passed
@jerinphilip jerinphilip deleted the aarch64+refactor branch August 20, 2023 11:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@jerinphilip