From d3ac8cf7002c488c6ec39353a99bcf0d5cfb1188 Mon Sep 17 00:00:00 2001 From: kgolubic Date: Wed, 22 May 2024 15:25:36 +0200 Subject: [PATCH 1/7] Update --- pages/fundamentals/storage-memory-usage.mdx | 1 + 1 file changed, 1 insertion(+) diff --git a/pages/fundamentals/storage-memory-usage.mdx b/pages/fundamentals/storage-memory-usage.mdx index beadd1f8..4abc7fbb 100644 --- a/pages/fundamentals/storage-memory-usage.mdx +++ b/pages/fundamentals/storage-memory-usage.mdx @@ -808,3 +808,4 @@ vm.max_map_count`. The RPM and Debian packages will configure this setting automatically so you don't need to do any more configurations. + From 6243a33a61bfabc08d1a608f2a786db8f6c453f7 Mon Sep 17 00:00:00 2001 From: kgolubic Date: Wed, 22 May 2024 15:36:09 +0200 Subject: [PATCH 2/7] Update Delta values --- pages/fundamentals/storage-memory-usage.mdx | 13 ++++++------- 1 file changed, 6 insertions(+), 7 deletions(-) diff --git a/pages/fundamentals/storage-memory-usage.mdx b/pages/fundamentals/storage-memory-usage.mdx index 4abc7fbb..c015e384 100644 --- a/pages/fundamentals/storage-memory-usage.mdx +++ b/pages/fundamentals/storage-memory-usage.mdx @@ -430,7 +430,7 @@ accurately. If you want to **estimate** IN_MEMORY_TRASNACTIONAL storage mode memory usage in the in-memory transactional storage mode, use the following formula: -$\texttt{StorageRAMUsage} = \texttt{NumberOfVertices} \times 212\text{B} + \texttt{NumberOfEdges} \times 162\text{B}$ +\texttt{StorageRAMUsage} = \texttt{NumberOfVertices} \times 188\text{B} + \texttt{NumberOfEdges} \times 162\text{B} @@ -448,7 +448,7 @@ According to the formula, storage memory usage should be: $ \begin{aligned} -\texttt{StorageRAMUsage} &= 21,723 \times 260\text{B} + 682,943 \times 180\text{B} \\ &= 5,647,980\text{B} + 122,929,740\text{B}\\ &= 128,577,720\text{B} \approx 125\text{MB} +\texttt{StorageRAMUsage} &= 21,723 \times 188\text{B} + 682,943 \times 162\text{B} \\ &= 4,086,924\text{B} + 110,552,466\text{B}\\ &= 114,639,390\text{B} \approx 109.3\text{MB} \end{aligned} $ @@ -489,8 +489,8 @@ Each `Delta` object has a least **56B**. {

Vertex memory layout

} -Each `Vertex` object has at least **112B** + **56B** for the `Delta` object, in -total, a minimum of **168B**. +Each `Vertex` object has at least **88B** + **56B** for the `Delta` object, in +total, a minimum of **144B**. Each additional label takes **4B**. @@ -578,7 +578,7 @@ Let's assume the name on average has $3\text{B}+10\text{B} = 13\text{B}$ (each name is on average 10 characters long). One the average values are included, the calculation is: -$19,148 \times (112\text{B} + 13\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 19,148 \times 213\text{B} = 4,078,524\text{B}.$ +$19,148 \times (88\text{B} + 13\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 19,148 \times 189\text{B} = 3,618,972\text{B}.$ The remaining 2,584 vertices are the `ComicSeries` vertices with the `title` and `publishYear` properties. Let's assume that the `title` property is @@ -626,7 +626,7 @@ $3 \times 21,723 \times (80\text{B}+13\text{B}+16\text{B})= 65,169 \times 109\te Now let's sum up everything we calculated: -$4,659,924\text{B} + 87,416,704\text{B} + 2,606,760\text{B} + 7,103,421\text{B} = 101,786,809 \text{B} \approx 102\text{MB}.$ +$3,618,972\text{B} + 581,400\text{B} + 87,416,704\text{B} + 2,606,760\text{B} + 7,103,421\text{B} = 101,327,257\text{B} \approx 96.6\text{MB}.$ Bear in mind the number can vary because objects can have higher overhead due to the additional data. @@ -808,4 +808,3 @@ vm.max_map_count`. The RPM and Debian packages will configure this setting automatically so you don't need to do any more configurations. - From df311811880fe53a4911e4e8273fc86f4999344a Mon Sep 17 00:00:00 2001 From: kgolubic Date: Wed, 22 May 2024 15:37:22 +0200 Subject: [PATCH 3/7] Fix typo --- pages/fundamentals/storage-memory-usage.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pages/fundamentals/storage-memory-usage.mdx b/pages/fundamentals/storage-memory-usage.mdx index c015e384..ad42c68a 100644 --- a/pages/fundamentals/storage-memory-usage.mdx +++ b/pages/fundamentals/storage-memory-usage.mdx @@ -430,7 +430,7 @@ accurately. If you want to **estimate** IN_MEMORY_TRASNACTIONAL storage mode memory usage in the in-memory transactional storage mode, use the following formula: -\texttt{StorageRAMUsage} = \texttt{NumberOfVertices} \times 188\text{B} + \texttt{NumberOfEdges} \times 162\text{B} +$\texttt{StorageRAMUsage} = \texttt{NumberOfVertices} \times 188\text{B} + \texttt{NumberOfEdges} \times 162\text{B} From d15c68ade3ffbbdc63ad709755e73ae08fecfba0 Mon Sep 17 00:00:00 2001 From: kgolubic Date: Wed, 22 May 2024 15:42:04 +0200 Subject: [PATCH 4/7] Update code --- pages/fundamentals/storage-memory-usage.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pages/fundamentals/storage-memory-usage.mdx b/pages/fundamentals/storage-memory-usage.mdx index ad42c68a..162326ae 100644 --- a/pages/fundamentals/storage-memory-usage.mdx +++ b/pages/fundamentals/storage-memory-usage.mdx @@ -430,7 +430,7 @@ accurately. If you want to **estimate** IN_MEMORY_TRASNACTIONAL storage mode memory usage in the in-memory transactional storage mode, use the following formula: -$\texttt{StorageRAMUsage} = \texttt{NumberOfVertices} \times 188\text{B} + \texttt{NumberOfEdges} \times 162\text{B} +$\texttt{StorageRAMUsage} = \texttt{NumberOfVertices} \times 188\text{B} + \texttt{NumberOfEdges} \times 162\text{B}$ From 3dc4b2710b625a2effd1449e08e2bb694336e798 Mon Sep 17 00:00:00 2001 From: kgolubic Date: Wed, 22 May 2024 15:46:18 +0200 Subject: [PATCH 5/7] Update values --- pages/fundamentals/storage-memory-usage.mdx | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/pages/fundamentals/storage-memory-usage.mdx b/pages/fundamentals/storage-memory-usage.mdx index 162326ae..beadd1f8 100644 --- a/pages/fundamentals/storage-memory-usage.mdx +++ b/pages/fundamentals/storage-memory-usage.mdx @@ -430,7 +430,7 @@ accurately. If you want to **estimate** IN_MEMORY_TRASNACTIONAL storage mode memory usage in the in-memory transactional storage mode, use the following formula: -$\texttt{StorageRAMUsage} = \texttt{NumberOfVertices} \times 188\text{B} + \texttt{NumberOfEdges} \times 162\text{B}$ +$\texttt{StorageRAMUsage} = \texttt{NumberOfVertices} \times 212\text{B} + \texttt{NumberOfEdges} \times 162\text{B}$ @@ -448,7 +448,7 @@ According to the formula, storage memory usage should be: $ \begin{aligned} -\texttt{StorageRAMUsage} &= 21,723 \times 188\text{B} + 682,943 \times 162\text{B} \\ &= 4,086,924\text{B} + 110,552,466\text{B}\\ &= 114,639,390\text{B} \approx 109.3\text{MB} +\texttt{StorageRAMUsage} &= 21,723 \times 260\text{B} + 682,943 \times 180\text{B} \\ &= 5,647,980\text{B} + 122,929,740\text{B}\\ &= 128,577,720\text{B} \approx 125\text{MB} \end{aligned} $ @@ -489,8 +489,8 @@ Each `Delta` object has a least **56B**. {

Vertex memory layout

} -Each `Vertex` object has at least **88B** + **56B** for the `Delta` object, in -total, a minimum of **144B**. +Each `Vertex` object has at least **112B** + **56B** for the `Delta` object, in +total, a minimum of **168B**. Each additional label takes **4B**. @@ -578,7 +578,7 @@ Let's assume the name on average has $3\text{B}+10\text{B} = 13\text{B}$ (each name is on average 10 characters long). One the average values are included, the calculation is: -$19,148 \times (88\text{B} + 13\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 19,148 \times 189\text{B} = 3,618,972\text{B}.$ +$19,148 \times (112\text{B} + 13\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 19,148 \times 213\text{B} = 4,078,524\text{B}.$ The remaining 2,584 vertices are the `ComicSeries` vertices with the `title` and `publishYear` properties. Let's assume that the `title` property is @@ -626,7 +626,7 @@ $3 \times 21,723 \times (80\text{B}+13\text{B}+16\text{B})= 65,169 \times 109\te Now let's sum up everything we calculated: -$3,618,972\text{B} + 581,400\text{B} + 87,416,704\text{B} + 2,606,760\text{B} + 7,103,421\text{B} = 101,327,257\text{B} \approx 96.6\text{MB}.$ +$4,659,924\text{B} + 87,416,704\text{B} + 2,606,760\text{B} + 7,103,421\text{B} = 101,786,809 \text{B} \approx 102\text{MB}.$ Bear in mind the number can vary because objects can have higher overhead due to the additional data. From 4ca8a96b1e5521c7c85a504c766467f0e1e362f8 Mon Sep 17 00:00:00 2001 From: kgolubic Date: Wed, 22 May 2024 15:57:10 +0200 Subject: [PATCH 6/7] Update one --- pages/fundamentals/storage-memory-usage.mdx | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/pages/fundamentals/storage-memory-usage.mdx b/pages/fundamentals/storage-memory-usage.mdx index beadd1f8..784c1531 100644 --- a/pages/fundamentals/storage-memory-usage.mdx +++ b/pages/fundamentals/storage-memory-usage.mdx @@ -489,8 +489,8 @@ Each `Delta` object has a least **56B**. {

Vertex memory layout

} -Each `Vertex` object has at least **112B** + **56B** for the `Delta` object, in -total, a minimum of **168B**. +Each `Vertex` object has at least **88B** + **56B** for the `Delta` object, in +total, a minimum of **144B**. Each additional label takes **4B**. @@ -578,7 +578,7 @@ Let's assume the name on average has $3\text{B}+10\text{B} = 13\text{B}$ (each name is on average 10 characters long). One the average values are included, the calculation is: -$19,148 \times (112\text{B} + 13\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 19,148 \times 213\text{B} = 4,078,524\text{B}.$ +$19,148 \times (88\text{B} + 13\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 19,148 \times 213\text{B} = 4,078,524\text{B}.$ The remaining 2,584 vertices are the `ComicSeries` vertices with the `title` and `publishYear` properties. Let's assume that the `title` property is @@ -590,7 +590,7 @@ list occupies $3 \times 2\text{B} \times 2\text{B} = 12\text{B}$. Using the same formula as above, but being careful to include both `title` and `publishYear` properties, the calculation is: -$2584 \times (112\text{B} + 13\text{B} + 12\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 2584 \times 225\text{B} = 581,400\text{B}.$ +$2584 \times (88\text{B} + 13\text{B} + 12\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 2584 \times 225\text{B} = 581,400\text{B}.$ In total, $4,659,924\text{B}$ to store vertices. From a9b3babd507e3d7712573315e6ceef6f7d9ce37c Mon Sep 17 00:00:00 2001 From: kgolubic Date: Wed, 22 May 2024 16:09:24 +0200 Subject: [PATCH 7/7] Update calculations --- pages/fundamentals/storage-memory-usage.mdx | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/pages/fundamentals/storage-memory-usage.mdx b/pages/fundamentals/storage-memory-usage.mdx index 784c1531..f19f403f 100644 --- a/pages/fundamentals/storage-memory-usage.mdx +++ b/pages/fundamentals/storage-memory-usage.mdx @@ -578,7 +578,7 @@ Let's assume the name on average has $3\text{B}+10\text{B} = 13\text{B}$ (each name is on average 10 characters long). One the average values are included, the calculation is: -$19,148 \times (88\text{B} + 13\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 19,148 \times 213\text{B} = 4,078,524\text{B}.$ +$19,148 \times (88\text{B} + 13\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 19,148 \times 189\text{B} = 3,618,972\text{B}.$ The remaining 2,584 vertices are the `ComicSeries` vertices with the `title` and `publishYear` properties. Let's assume that the `title` property is @@ -590,9 +590,9 @@ list occupies $3 \times 2\text{B} \times 2\text{B} = 12\text{B}$. Using the same formula as above, but being careful to include both `title` and `publishYear` properties, the calculation is: -$2584 \times (88\text{B} + 13\text{B} + 12\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 2584 \times 225\text{B} = 581,400\text{B}.$ +$2584 \times (88\text{B} + 13\text{B} + 12\text{B} + 16\text{B} + 16\text{B} + 56\text{B}) = 2584 \times 201\text{B} = 519,384\text{B}.$ -In total, $4,659,924\text{B}$ to store vertices. +In total, $4,138,356\text{B}$ to store vertices. The edges don't have any properties on them, so the formula is as follows: @@ -626,7 +626,7 @@ $3 \times 21,723 \times (80\text{B}+13\text{B}+16\text{B})= 65,169 \times 109\te Now let's sum up everything we calculated: -$4,659,924\text{B} + 87,416,704\text{B} + 2,606,760\text{B} + 7,103,421\text{B} = 101,786,809 \text{B} \approx 102\text{MB}.$ +$4,138,356\text{B} + 87,416,704\text{B} + 2,606,760\text{B} + 7,103,421\text{B} = 101,265,241 \text{B} \approx 99\text{MB}.$ Bear in mind the number can vary because objects can have higher overhead due to the additional data.