forked from MohsenKoohi/MS-BioGraphs-Validation
/
MS1-sample.txt
143 lines (116 loc) · 4.46 KB
/
MS1-sample.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
*** MS-Biographs Validation Script ***
path: /users/2635474/sharedscratch/1/MS1
graph_name: MS1
Checking shasum of MS1.ojson (/users/2635474/sharedscratch/1/MS1.ojson)
ojson shasum: c60afa0652955fd46f1bb8056380523504d69fa6
local shasum: c60afa0652955fd46f1bb8056380523504d69fa6
shasum matches.
JSON:
{
"name": "MS1",
"directed": 0,
"edge_weighted": 1,
"vertices_count": 43144218,
"edges_count": 2660495200,
"max_weight": 634925,
"max_degree": 14212,
"zero_degrees_count": 0,
"cp_first_degree": 6,
"cp_last_degree": 1,
"cp_first_neighbour": 0,
"cp_first_weight": 74811,
"cp_last_neighbour": 43144217,
"cp_last_weight": 3714,
"min_weight": 3680,
"largest_component_size": 124003393,
"cc_count": 15746208,
"wg_size_underlying_ver_1": 6378487341,
"wg_size_weights_ver_1": 8282238556,
"offsets_ver_1_shasum": "0abedde32e1ac7181897f82d10d40acfe14f2022",
"wcc_ver_1_shasum": "4c491dd96e3582b70a203ae4a910001381278d75",
"n2o_ver_1_shasum": "b163320b6349fed7a00fb17c4a4a22e7d124b716",
"edges_shas_ver_1_shasum": "27974edb4bf8f3b17b00ff3a72a703da18f3807a"
}
Checking file offsets.bin:
file-path: /users/2635474/sharedscratch/1/MS1_offsets.bin
json shasum: 0abedde32e1ac7181897f82d10d40acfe14f2022
local shasum: 0abedde32e1ac7181897f82d10d40acfe14f2022
shasum matches.
Checking file wcc.bin:
file-path: /users/2635474/sharedscratch/1/MS1-wcc.bin
json shasum: 4c491dd96e3582b70a203ae4a910001381278d75
local shasum: 4c491dd96e3582b70a203ae4a910001381278d75
shasum matches.
Checking file n2o.bin:
file-path: /users/2635474/sharedscratch/1/MS1-n2o.bin
json shasum: b163320b6349fed7a00fb17c4a4a22e7d124b716
local shasum: b163320b6349fed7a00fb17c4a4a22e7d124b716
shasum matches.
Checking file trans_offsets.bin:
File does not exist.
Checking file edges_shas.txt:
file-path: /users/2635474/sharedscratch/1/MS1_edges_shas.txt
json shasum: 27974edb4bf8f3b17b00ff3a72a703da18f3807a
local shasum: 27974edb4bf8f3b17b00ff3a72a703da18f3807a
shasum matches.
*** Files' shasum verified. ***
JLIBS_FOLDER: jlibs
Archive: jlibs.zip
creating: jlibs/
inflating: jlibs/mg4j-4.0.3.jar
inflating: jlibs/stax-api-1.0.1.jar
inflating: jlibs/fastutil-8.5.6.jar
inflating: jlibs/commons-io-2.4.jar
inflating: jlibs/log4j-1.2.17.jar
inflating: jlibs/commons-collections-20040616.jar
inflating: jlibs/mg4j-big-4.0.4.jar
inflating: jlibs/jung-algorithms-2.0.1.jar
inflating: jlibs/lama4j-1.1.1.jar
inflating: jlibs/commons-lang-2.6.jar
inflating: jlibs/guava-31.0.1-jre.jar
inflating: jlibs/concurrent-1.3.4.jar
inflating: jlibs/commons-configuration-1.8.jar
inflating: jlibs/logback-classic-1.1.6.jar
inflating: jlibs/collections-generic-4.01.jar
inflating: jlibs/sux4j-5.2.3.jar
inflating: jlibs/slf4j-api-1.7.14.jar
inflating: jlibs/fastutil-core-8.5.6.jar
inflating: jlibs/wstx-asl-3.2.6.jar
inflating: jlibs/jung-io-2.0.1.jar
inflating: jlibs/colt-1.2.0.jar
inflating: jlibs/joda-time-2.5.jar
inflating: jlibs/commons-lang3-3.4.jar
inflating: jlibs/law-2.7.2.jar
inflating: jlibs/jung-api-2.0.1.jar
inflating: jlibs/webgraph-3.6.10.jar
inflating: jlibs/fastutil-extra-8.5.4.jar
inflating: jlibs/logback-core-1.1.6.jar
inflating: jlibs/law-library-2.6.0.jar
inflating: jlibs/webgraph-big-3.6.6.jar
inflating: jlibs/jsap-2.1.jar
inflating: jlibs/commons-math3-3.6.jar
inflating: jlibs/commons-logging-1.1.1.jar
inflating: jlibs/dsiutils-2.6.17.jar
Java libararies downloaded.
[1;32mSHA Calculator for MS-BioGraphs Arc-Labeled Graphs Using WebGraph Library[0;37m
graph_file (args[0]): /users/2635474/sharedscratch/1/MS1
output_file (args[1]): MS1_local_edges_shas.txt
offsets_file: /users/2635474/sharedscratch/1/MS1_offsets.bin
threads_count: 128
Graph Init. Time: 5.25 seconds
RandomAccess: true
Arc labeled: Yes
#Nodes: 43,144,218
#Arcs: 2,660,495,200
block_size: 67,108,864
blocks_count: 40
[0;32m2023/08/11 13:20:05.050[0;37m Step 0: Started.
[0;32m2023/08/11 13:20:33.455[0;37m Step 0: Done.
[0;32m2023/08/11 13:20:33.456[0;37m Step 0: Setting blocks' start points completed.
[0;32m2023/08/11 13:20:33.457[0;37m Step 1: Started.
[0;32m2023/08/11 13:21:16.487[0;37m Step 1: Done.
processed_edges: 2,660,495,200
[0;32m2023/08/11 13:21:16.503[0;37m Step 1: Writing SHAs to files completed.
Exec. Time for creating sha of edge blocks: 76.71 seconds
The shasums of edge blocks matches.
Total exec. time: 85,709.526 (ms)