Skip to content

Using Data compression options in "workflow.swift" #11

@abidmalikwaterloo

Description

@abidmalikwaterloo

@jychoi-hpc @kshitij-v-mehta @mw70
When I used the following in my workflow.swift:

arguments2 = split("heat.bp staged.bp FLEXPATH "" MPI "" "T,dt" "SZ:accuracy=0.001"", " "); ( try the other compression as well)

It breaks. The error is given below. I tried on different machines and also tried to rebuild every thing from scratch. I see that some people have successfully run this options. tried with TAU and without TAU as well.


rank 0: Write variable 12: dT
*** Error in `stage_write/stage_write': corrupted size vs. prev_size: 0x000000000330b740 ***
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(+0x777e5)[0x7f21229d77e5]
/lib/x86_64-linux-gnu/libc.so.6(+0x80dfb)[0x7f21229e0dfb]
/lib/x86_64-linux-gnu/libc.so.6(cfree+0x4c)[0x7f21229e453c]
/lib/x86_64-linux-gnu/libz.so.1(deflateEnd+0x4e)[0x7f212341708e]
/home/amalik/spack/opt/spack/linux-ubuntu16-x86_64/gcc-5.4.0/sz-develop-brcu2sscr2oucsvopcpncy7z2xdmfsic/lib/libsz.so.1(zlib_compress5+0x144)[0x7f21231ddf04]
/home/amalik/spack/opt/spack/linux-ubuntu16-x86_64/gcc-5.4.0/sz-develop-brcu2sscr2oucsvopcpncy7z2xdmfsic/lib/libsz.so.1(SZ_compress_args_double+0x2f5)[0x7f21231ef4f5]
/home/amalik/spack/opt/spack/linux-ubuntu16-x86_64/gcc-5.4.0/sz-develop-brcu2sscr2oucsvopcpncy7z2xdmfsic/lib/libsz.so.1(SZ_compress_args+0x43)[0x7f21231f4bb3]
/home/amalik/spack/opt/spack/linux-ubuntu16-x86_64/gcc-5.4.0/sz-develop-brcu2sscr2oucsvopcpncy7z2xdmfsic/lib/libsz.so.1(SZ_compress+0x4c)[0x7f21231f4e1c]
stage_write/stage_write[0x4aca62]
stage_write/stage_write[0x4a95d3]
stage_write/stage_write[0x4a849e]
stage_write/stage_write[0x40b580]
stage_write/stage_write[0x40baf1]
stage_write/stage_write[0x40c0ed]
stage_write/stage_write[0x4090e7]
stage_write/stage_write[0x408c77]
stage_write/stage_write[0x407c05]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f2122980830]
stage_write/stage_write[0x4064d9]
======= Memory map: ========
00400000-005e5000 r-xp 00000000 08:03 97655616 /home/amalik/spack/opt/spack/linux-ubuntu16-x86_64/gcc-5.4.0/savanna-develop-5ivzn2ix66rrsufmfqwr5hcug6nah6go/Heat_Transfer/stage_write/stage_write
007e4000-007e6000 r--p 001e4000 08:03 97655616 /home/amalik/spack/opt/spack/linux-ubuntu16-x86_64/gcc-5.4.0/savanna-develop-5ivzn2ix66rrsufmfqwr5hcug6nah6go/Heat_Transfer/stage_write/stage_write
007e6000-007f0000 rw-p 001e6000 08:03 97655616 /home/amalik/spack/opt/spack/linux-ubuntu16-x86_64/gcc-5.4.0/savanna-develop-5ivzn2ix66rrsufmfqwr5hcug6nah6go/Heat_Transfer/stage_write/stage_write
007f0000-007f7000 rw-p 00000000 00:00 0
0174d000-033fc000 rw-p 00000000 00:00 0 [heap]
7f2114000000-7f2114021000 rw-p 00000000 00:00 0
7f2114021000-7f2118000000 ---p 00000000 00:00 0
7f211c000000-7f211c021000 rw-p 00000000 00:00 0
7f211c021000-7f2120000000 ---p 00000000 00:00 0
7f2120404000-7f2120405000 ---p 00000000 00:00 0
7f2120405000-7f2120c05000 rw-p 00000000 00:00 0
7f2120c05000-7f2120c1c000 r-xp 00000000 08:03 72617629 /lib/x86_64-linux-gnu/libresolv-2.23.so
7f2120c1c000-7f2120e1c000 ---p 00017000 08:03 72617629 /lib/x86_64-linux-gnu/libresolv-2.23.so
7f2120e1c000-7f2120e1d000 r--p 00017000 08:03 72617629 /lib/x86_64-linux-gnu/libresolv-2.23.so
7f2120e1d000-7f2120e1e000 rw-p 00018000 08:03 72617629 /lib/x86_64-linux-gnu/libresolv-2.23.so
7f2120e1e000-7f2120e20000 rw-p 00000000 00:00 0
7f2120e20000-7f2120e25000 r-xp 00000000 08:03 72617595 /lib/x86_64-linux-gnu/libnss_dns-2.23.so
7f2120e25000-7f2121025000 ---p 00005000 08:03 72617595 /lib/x86_64-linux-gnu/libnss_dns-2.23.so
7f2121025000-7f2121026000 r--p 00005000 08:03 72617595 /lib/x86_64-linux-gnu/libnss_dns-2.23.so
7f2121026000-7f2121027000 rw-p 00006000 08:03 72617595 /lib/x86_64-linux-gnu/libnss_dns-2.23.so

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions