Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

report.py crashed #1

Open
carverdamien opened this issue Nov 4, 2019 · 1 comment
Open

report.py crashed #1

carverdamien opened this issue Nov 4, 2019 · 1 comment

Comments

@carverdamien
Copy link
Owner

On i80 with BENCH=nas_cg.C_2/POWER=performance-n/MONITORING=all/IPANEMA=cfs_unblock_wwc/160-ipanema/1.

I think it crashed in this loop for k in df.columns because the shutil.rmtree(i_path) was not executed.

damien@i80:/mnt/data/damien/git/carverdamien/RecordSchedLog/output/BENCH=nas_cg.C_2/POWER=performance-n/MONITORING=all/IPANEMA=cfs_unblock_wwc/160-ipanema/1$ ls sched_log/tracer
0   100  103  106  109  111  114  117  12   122  125  128  130  133  136  139  141  144  147  15   152  155  158  17  2   22  25  28  30  33  36  39  41  44  47  5   52  55  58  60  63  66  69  71  74  77  8   82  85  88  90  93  96  99
1   101  104  107  11   112  115  118  120  123  126  129  131  134  137  14   142  145  148  150  153  156  159  18  20  23  26  29  31  34  37  4   42  45  48  50  53  56  59  61  64  67  7   72  75  78  80  83  86  89  91  94  97
10  102  105  108  110  113  116  119  121  124  127  13   132  135  138  140  143  146  149  151  154  157  16   19  21  24  27  3   32  35  38  40  43  46  49  51  54  57  6   62  65  68  70  73  76  79  81  84  87  9   92  95  98
damien@i80:/mnt/data/damien/git/carverdamien/RecordSchedLog/output/BENCH=nas_cg.C_2/POWER=performance-n/MONITORING=all/IPANEMA=cfs_unblock_wwc/160-ipanema/1/sched_log$ tree tracer_npz/
tracer_npz/
├── addr.npz
├── arg0.npz
├── arg1.npz
├── comm.json
├── event.npz
├── pid.npz
└── timestamp.npz

It might have something to do with event dropping.

damien@i80:/mnt/data/damien/git/carverdamien/RecordSchedLog/output/BENCH=nas_cg.C_2/POWER=performance-n/MONITORING=all/IPANEMA=cfs_unblock_wwc/160-ipanema/1$ tail dmesg.prepare 
[34890.275074] cpu24 dropped 562690 schedlog events
[38408.310518] cpu0 dropped 24016600 schedlog events
[38424.776118] cpu4 dropped 19111754 schedlog events
[38431.416341] cpu5 dropped 3155632 schedlog events
[38438.033831] cpu6 dropped 3551542 schedlog events
[38449.670654] cpu8 dropped 10650893 schedlog events
[38456.371625] cpu9 dropped 363388 schedlog events
[38472.130000] cpu12 dropped 4354102 schedlog events
[38490.447989] cpu16 dropped 7793393 schedlog events
[38505.474714] cpu20 dropped 3467029 schedlog events
@carverdamien
Copy link
Owner Author

TODO: catch exceptions in @parallel.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant