Skip to content

Conversation

@Mionsz
Copy link
Collaborator

@Mionsz Mionsz commented Mar 27, 2025

ADD: Create doc/experimental/performance_optimizations.md with know how basics on kernel and generally OS level related optimizations.

@Mionsz Mionsz added documentation Improvements or additions to documentation enhancement New feature or request help wanted Extra attention is needed labels Mar 27, 2025
Mionsz added 2 commits March 31, 2025 08:13
ADD: Create `doc/experimental/performance_optimizations.md` with know how basics on mainly kernel related optimizations.
@Mionsz Mionsz force-pushed the private/mlinkiew/docs-optimization branch from 31dbc73 to 5096fd0 Compare March 31, 2025 06:13
@DawidWesierski4 DawidWesierski4 changed the title ADD: Create performance_optimizations.md Add: Create performance_optimizations.md Apr 15, 2025
@DawidWesierski4
Copy link
Collaborator

This is a greate iniciative ( ◡̀_◡́)ᕤ
But--> those optimizations does not apply directly to mtl in a lot of scenarios described

When you get really into it the maximum performance for mtl should be first investigated,

There are a lot of changes here that we suspect will have performance benefits but don't have solid proof and giving them to the clients seem rushed

Also there is a lot of considerations that need to be added

areas of improvement

  • queues sizes and their role in limitations for the sessions throughput/amount
  • MTL isolation for cores limitations (lcores specified )
  • Amount of schedulers per session
  • Hyperthreading
  • Framebuffer size and its role in input jitter mitigation
  • Memory allocation max_memzone argument for big session scenarios
  • Numa cores and how to manage the NUMA ram memory throughput
  • NIC's limitations and how to find them
  • Memory bandwidths

Copy link
Collaborator

@DawidWesierski4 DawidWesierski4 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM ദ്ദി( • ᴗ - ) ✧

@DawidWesierski4 DawidWesierski4 merged commit 41b07e8 into main May 21, 2025
29 checks passed
@DawidWesierski4 DawidWesierski4 deleted the private/mlinkiew/docs-optimization branch May 21, 2025 12:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation enhancement New feature or request help wanted Extra attention is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants