Increase VRAM usage from 75% to 90%?

[x66ccff]

Hi, I noticed that Reactant.jl is consistently using about 75% of the GPU memory. Is there a way to increase this to 90%? I want to make the most out of the available memory.

[avik-pal]

Set XLA_REACTANT_GPU_MEM_FRACTION=0.9

[ChiMaoShuPhy]

I ran into the same issue using gpu as default backend. Setting XLA_REACTANT_GPU_MEM_FRACTION=0.9 in deed increase
VRAM preallocation to 90% of the total VRAM (32GiB) however @compile throws

W external/xla/xla/hlo/transforms/simplifiers/hlo_rematerialization.cc:3021] Can't reduce memory use below 23.06GiB (24764946267 bytes) by rematerialization; only reduced to 25.01GiB (26852944880 bytes), down from 163.85GiB (175937890320 bytes) originally

Execution of the compiled function throws OOM error

W external/xla/xla/tsl/framework/bfc_allocator.cc:501] Allocator (GPU_0_bfc) ran out of memory trying to allocate 160.33GiB (rounded to 172155231488)requested by op 

[avik-pal]

Can you open a new issue with the code you are trying to compile?

[ChiMaoShuPhy]

@avik-pal please find the code in #1214