Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Profile: Add specifying dir for take_heap_snapshot and handling if current dir is unwritable #50476

Merged
merged 3 commits into from
Jul 11, 2023

Conversation

IanButterworth
Copy link
Sponsor Member

@IanButterworth IanButterworth commented Jul 8, 2023

Replaces #50443
Reverts #50026 which changed the default to always use tempdir

Implements the idea here #50026 (comment)

  • If the current dir is unwritable saves to tempdir() with a maxlog=1 warning
  • Adds dir kwarg to override the directory the named file is saved to
shell> cd unwritable/
/Users/ian/Documents/GitHub/julia/unwritable

julia> Profile.take_heap_snapshot()
┌ Warning: Cannot write to current directory `/Users/ian/Documents/GitHub/julia/unwritable` so saving heap snapshot to `tempdir()`
└ @ Profile ~/Documents/GitHub/julia/usr/share/julia/stdlib/v1.11/Profile/src/Profile.jl:1247
"/var/folders/1z/jf841bdj73bdj3vk7kc7f_3w0000gn/T/31236_782350876174583.heapsnapshot"

shell> cd ..
/Users/ian/Documents/GitHub/julia

julia> Profile.take_heap_snapshot()
"/Users/ian/Documents/GitHub/julia/31236_782356649496041.heapsnapshot"

julia> Profile.take_heap_snapshot(dir = "~/Documents")
"/Users/ian/Documents/31236_782363162146916.heapsnapshot"

julia> Profile.take_heap_snapshot("/Users/ian/Documents/mysnap.snapshot")
"/Users/ian/Documents/mysnap.snapshot"

fyi @kpamnany @NHDaly @adnan-alhomssi @vchuravy

Co-authored-by: Valentin Churavy <vchuravy@users.noreply.github.com>
@IanButterworth IanButterworth merged commit 0f6bfd6 into JuliaLang:master Jul 11, 2023
6 checks passed
@IanButterworth IanButterworth deleted the ib/heap_snapshot_fix branch July 11, 2023 12:33
@vchuravy vchuravy added the backport 1.10 Change should be backported to the 1.10 release label Jul 11, 2023
@IanButterworth
Copy link
Sponsor Member Author

Whoops, needs tests. I'll followup

@IanButterworth IanButterworth added the needs tests Unit tests are required for this change label Jul 11, 2023
Copy link
Member

@NHDaly NHDaly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perfect. Thank you for taking this on, @IanButterworth! 👍 👍 LGTM too. Much appreciated

KristofferC pushed a commit that referenced this pull request Jul 17, 2023
…current dir is unwritable (#50476)

Co-authored-by: Valentin Churavy <vchuravy@users.noreply.github.com>
(cherry picked from commit 0f6bfd6)
KristofferC added a commit that referenced this pull request Jul 24, 2023
Backported PRs:
- [x] #50411 <!-- Fix weird dispatch of * with zero arguments -->
- [x] #50202 <!-- Remove dynamic dispatch from _wait/wait2 -->
- [x] #50064 <!-- Fix numbered prompt with input only with comment -->
- [x] #50026 <!-- Store heapsnapshot files in tempdir() instead of
current directory -->
- [x] #50402 <!-- Add CPU feature helper function -->
- [x] #50387 <!-- update newpages pointer after actually sweeping pages
-->
- [x] #50424 <!-- avoid potential type-instability in _replace_(str,
...) -->
- [x] #50444 <!-- Optimize getfield lowering to avoid boxing in some
cases -->
- [x] #50474 <!-- docs: Fix a `!!! note` which was miscapitalized -->
- [x] #50466 <!-- relax assertion involving pg->nold to reflect that it
may be a bit in… -->
- [x] #50490 <!-- Fix compat annotation for italic printstyled -->
- [x] #50488 <!-- fix typo in `Base.isassigned` with `Tridiagonal` -->
- [x] #50476 <!-- Profile: Add specifying dir for `take_heap_snapshot`
and handling if current dir is unwritable -->
- [x] #50461 <!-- fix typo in the --gcthreads argument description -->
- [x] #50528 <!-- ssair: Correctly handle stmt insertion at end of basic
block -->
- [x] #50533 <!-- ensure internal_obj_base_ptr checks whether objects
past freelist pointer are in freelist -->
- [x] #49322 <!-- improve cat design / performance -->
- [x] #50540 <!-- gc: remove over-eager assertion -->
- [x] #50542 <!-- gf: remove unnecessary assert cycle==depth -->
- [x] #50559 <!-- Expand kwcall lowering positional default check to
vararg -->
- [x] #50058 <!-- Add unwrapping mechanism for triangular mul and solves
-->
- [x] #50551 <!-- typeintersect: also record chained `innervars` -->
- [x] #50552 <!-- read(io, Char): fix read with too many leading ones
-->
- [x] #50541 <!-- precompile: ensure globals are not accidentally
created where disallowed -->
- [x] #50576 <!-- use atomic compare exchange when setting the GC
mark-bit -->
- [x] #50578 <!-- gf: make method overwrite/delete an error during
precompile -->
- [x] #50516 <!-- Fix visibility of assert on GCC12/13 -->
- [x] #50597 <!-- Fix memory corruption if task is launched inside
finalizer -->
- [x] #50591 <!-- build: fix various makefile bugs -->
- [x] #50599 <!-- faster invalid object lookup in conservative gc -->
- [x] #50634 <!-- 🤖 [master] Bump the SparseArrays stdlib from b4b0e72
to 99c99b4 -->
- [x] #50639 <!-- Backport LLVM patches to fix various issues. -->
- [x] #50546 <!-- Revert storage of method instance in LineInfoNode -->
- [x] #50631 <!-- Shift DCE pass to optimize imaging mode code better
-->
- [x] #50525 <!-- only check that values are finite in `generic_lufact`
when `check=true` -->
- [x] #50587 <!-- isassigned for ranges with BigInt indices -->
- [x] #50144 <!-- Page based heap size heuristics -->


Need manual backport:
- [ ] #50595 <!-- Rename ENV variable `JULIA_USE_NEW_PARSER` ->
`JULIA_USE_FLISP_PARSER` -->



Non-merged PRs with backport label:
- [ ] #50637 <!-- Remove SparseArrays legacy code -->
- [ ] #50618 <!-- inference: continue const-prop' when concrete-eval
returns non-inlineable -->
- [ ] #50598 <!-- only limit types in stack traces in the REPL -->
- [ ] #50594 <!-- Disallow non-index Integer types in isassigned -->
- [ ] #50568 <!-- `Array(::AbstractRange)` should return an `Array` -->
- [ ] #50523 <!-- Avoid generic call in most cases for getproperty -->
- [ ] #50172 <!-- print feature flags used for matching pkgimage -->
@KristofferC KristofferC removed the backport 1.10 Change should be backported to the 1.10 release label Jul 24, 2023
adnan-alhomssi pushed a commit to RelationalAI/julia that referenced this pull request Aug 13, 2023
…current dir is unwritable (JuliaLang#50476)

Co-authored-by: Valentin Churavy <vchuravy@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs tests Unit tests are required for this change profiler
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants