Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GPU] Use array for tracking memory usage instead of map #25269

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Commits on Jun 27, 2024

  1. Use array for tracking memory usage instead of map

    `std::map` has very slow access are requires lock on every access. We can use `std::array` instead to hold compile time known number of buckets. This method should have less latency and memory overhead, as well as possibly no lock on access.
    ialbrecht committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    9366d68 View commit details
    Browse the repository at this point in the history
  2. [GPU] Remove device memory tracking mutex

    No need to lock mutex to update atomic values
    ialbrecht committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    09cd4e8 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. [GPU] added default initializer

    Make sure atomic values are zero initialized.
    ialbrecht committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    6ddc020 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. [GPU] Removed double increment on memory usage counter

    As in description
    ialbrecht committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    2ac044a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7041fd7 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. [GPU] Fix current mem size value fetch

    `fetch_add` returns old value, therefore we need to increment current memory usage value before storing current max.
    ialbrecht committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    47bc055 View commit details
    Browse the repository at this point in the history