Skip to content

[Unity][Dlight] Metal Performance#15985

Merged
junrushao merged 2 commits intoapache:unityfrom
spectrometerHBH:metal-perf
Nov 5, 2023
Merged

[Unity][Dlight] Metal Performance#15985
junrushao merged 2 commits intoapache:unityfrom
spectrometerHBH:metal-perf

Conversation

@spectrometerHBH
Copy link
Contributor

@spectrometerHBH spectrometerHBH commented Oct 26, 2023

On M2 Ultra, q4f16_1:

Llama2 7B: 74 tok/s -> 89 tok/s
Llama2 13B: 45 tok/s -> 55 tok/s

@spectrometerHBH spectrometerHBH changed the title metal perf [Unity][Dlight] Metal Performance Oct 26, 2023
@junrushao
Copy link
Member

Would you like to fix the unittest? Thanks!

Bohan Hou and others added 2 commits November 1, 2023 12:59
@Hzfengsy
Copy link
Member

Hzfengsy commented Nov 2, 2023

Is it ready to merge?

@junrushao junrushao merged commit 151aa74 into apache:unity Nov 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants