Add 'csv' format to the 'transform' reporter #241
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
1 task
When there is a lot of different allocations, some of the reporters that we currently offer do not allow for very granular inspection of the data. This can happen for example when certain libraries like tensorflow or sklearn or pandas are imported as the number of allocations goes easily to several thousand. In these situations reporters like the summary reporter are not helpful as the number of rows to display needs to be really high and is not easy to analyze. To allow other more specialized data analysis tools to work with the data, add a new 'csv' output format to the 'transform' reporter that will dump a comma-separated-value file with every allocation in the high water mark as a row with the columns representing different properties of every allocation. The stack trace will be represented as a string joined with characters that are illegal in function names. Signed-off-by: Pablo Galindo <pablogsal@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
When there are a lot of different allocations, some of the reporters that
we currently offer do not allow for a very granular inspection of the
data. This can happen for example when certain libraries like TensorFlow
or sklearn or pandas are imported as the number of allocations
goes easily to several thousand. In these situations, reporters like the
summary reporter are not helpful as the number of rows to display needs
to be really high and is not easy to analyze.
To allow other more specialized data analysis tools to work with the
data, add a new 'csv' output format to the 'transform' reporter that
will dump a comma-separated-value file with every allocation in the high
watermark as a row with columns representing different properties
of every allocation. The stack trace will be represented as a string
joined with characters that are illegal in function names.
Closes: #239
Signed-off-by: Pablo Galindo pablogsal@gmail.com