Skip to content

chore/SOF 7666 - Migration to New Platform, New Infrastructure Specs #332

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Oct 8, 2025
Merged

chore/SOF 7666 - Migration to New Platform, New Infrastructure Specs #332

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
ff8b687
chore: update HW descriptions for AWS, AZ
timurbazhirov Oct 8, 2025
ebb6429
chore: update HW descriptions for AWS, AZ
timurbazhirov Oct 8, 2025
62150e6
feat: add GCP description
timurbazhirov Oct 8, 2025
74a0b53
feat: add free tier description
timurbazhirov Oct 8, 2025
17c6652
chore: add migration page
timurbazhirov Oct 8, 2025
a988255
chore: add migration directives
timurbazhirov Oct 8, 2025
f877d1c
Merge branch 'main' into chore/SOF-7666
timurbazhirov Oct 8, 2025
5dad347
chore: add apptainer descrtipion
timurbazhirov Oct 8, 2025
ec56a31
chore: update mpirun commands
timurbazhirov Oct 8, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
86 changes: 36 additions & 50 deletions lang/en/docs/infrastructure/clusters/aws.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,69 +4,55 @@ This page contains information about clusters hosted on Amazon Web Services[^1]

## Clusters

The following table provides information about available clusters on Amazon Web Services (AWS) cloud computing platform. The latest cluster status can be found on <a href="https://platform.mat3ra.com/clusters" target="_blank">Clusters</a> page in web application.
The following table provides information about available clusters on Amazon Web Services (AWS) cloud computing platform.
The latest cluster status can be found on <a href="https://platform.mat3ra.com/clusters" target="_blank">Clusters</a>
page in web application.

| Name | Master Hostname | Location |
| :---: | :---: | :---: |
| cluster-001 | master-production-20160630-cluster-001.exabyte.io | West US |
| Name | Master Hostname | Location |
|:-------------:|:---------------------------------------------------:|:--------:|
| `cluster-002` | `master-production-20250821-cluster-001.mat3ra.com` | West US |

## Queues

The list of currently enabled queues is given below. Price per core hour is shown in relation to the [relative unit price](../../pricing/service-levels.md#comparison-table) and is subject to change at any time. Total number of nodes can be increased upon [request](../../ui/support.md).

| Name | Category[^2] | Mode[^3] | Charge Policy[^4] | Price | Max Nodes per Job<sup>+</sup> | Max Nodes Total |
| :---: | :---: | :---: | :---: | :---: | :---: | :---: |
| D | debug | debug | core-seconds | 2.251 | 1 | 10 |
| OR | ordinary | regular | core-seconds | 1.000 | 1 | 10 |
| OR4 | ordinary | regular | core-seconds | 1.126 | 1 | 20 |
| OR8 | ordinary | regular | core-seconds | 1.126 | 1 | 20 |
| OR16 | ordinary | regular | core-seconds | 1.126 | 1 | 20 |
| OF | ordinary | fast | core-hours | 1.000 | &le;5 | 100 |
| OFplus| ordinary | fast | core-hours | 0.962 | &le;5 | 10 |
| SR | saving | regular | core-seconds | 0.200 | 1 | 10 |
| SR4 | saving | regular | core-seconds | 0.225 | 1 | 20 |
| SR8 | saving | regular | core-seconds | 0.225 | 1 | 20 |
| SR16 | saving | regular | core-seconds | 0.225 | 1 | 20 |
| SF | saving | fast | core-hours | 0.200 | &le;5 | 100 |
| SFplus| saving | fast | core-hours | 0.379 | &le;5 | 10 |
| GOF | ordinary | fast | core-hours | 8.655 | &le;5 | 10 |
| G4OF | ordinary | fast | core-hours | 8.655 | &le;5 | 10 |
| G8OF | ordinary | fast | core-hours | 8.655 | &le;5 | 10 |
| GSF | saving | fast | core-hours | 3.370 | &le;5 | 10 |
| G4SF | saving | fast | core-hours | 4.158 | &le;5 | 10 |
| G8SF | saving | fast | core-hours | 4.335 | &le;5 | 10 |
The list of currently enabled queues is given below. Price per core hour is shown in relation to
the [relative unit price](../../pricing/service-levels.md#comparison-table) and is subject to change at any time. Total
number of nodes can be increased upon [request](../../ui/support.md).

| Name | Category[^2] | Mode[^3] | Charge Policy[^4] | Price | Max Nodes per Job<sup>+</sup> | Max Nodes Total |
|:------:|:------------:|:--------:|:-----------------:|:-----:|:-----------------------------:|:---------------:|
| D | debug | debug | core-seconds | 2.251 | 1 | 10 |
| OR | ordinary | regular | core-seconds | 1.000 | 1 | 10 |
| OF | ordinary | fast | core-hours | 1.000 | 10 | 100 |
| OFplus | ordinary | fast | core-hours | 0.962 | 5 | 10 |
| SR | saving | regular | core-seconds | 0.200 | 1 | 10 |
| SF | saving | fast | core-hours | 0.200 | 10 | 100 |
| SFplus | saving | fast | core-hours | 0.379 | 5 | 10 |
| GOF | ordinary | fast | core-hours | 8.655 | 5 | 10 |
| GSF | saving | fast | core-hours | 1.731 | 5 | 10 |
| G4OF | ordinary | fast | core-hours | 8.655 | 5 | 10 |

<sup>+</sup> please contact support to inquire about attempting a larger node count per job

## Hardware Specifications

The following table contains hardware specifications for the above queues.

| Name | CPU[^5] | Cores per Node | GPU[^6] | GPU per Node | Memory (GB) | Bandwidth (Gbps) |
| :---: | :---: | :---: | :---: | :---: | :---: | :---: |
| D | c-3 | 8 | - | - | 15 | &le;10 |
| OR | c-3 | 36 | - | - | 60 | &le;10 |
| OR4 | c-3 | 4 | - | - | 7.5 | &le;10 |
| OR8 | c-3 | 8 | - | - | 15 | &le;10 |
| OR16 | c-3 | 16 | - | - | 30 | &le;10 |
| OF | c-3 | 36 | - | - | 60 | 10 |
| OFplus| c-5 | 72 | - | - | 144 | 25 |
| SR | c-3 | 36 | - | - | 60 | 10 |
| SR4 | c-3 | 4 | - | - | 7.5 | &le;10 |
| SR8 | c-3 | 8 | - | - | 15 | &le;10 |
| SR16 | c-3 | 16 | - | - | 30 | &le;10 |
| SF | c-3 | 36 | - | - | 60 | 10 |
| SFplus| c-5 | 72 | - | - | 144 | 25 |
| GOF | c-4 | 8 | g-1 | 1 | 61 | 10 |
| G4OF | c-4 | 32 | g-1 | 4 | 244 | 10 |
| G8OF | c-4 | 64 | g-1 | 8 | 488 | 25 |
| GSF | c-4 | 8 | g-1 | 1 | 61 | 10 |
| G4SF | c-4 | 32 | g-1 | 4 | 244 | 10 |
| G8SF | c-4 | 64 | g-1 | 8 | 488 | 25 |

| Name | CPU[^5] | Cores per Node | GPU[^6] | GPU per Node | Memory (GB) | Bandwidth (Gbps) | Instance Type |
|:------:|:-------:|:--------------:|:-------:|:------------:|:-----------:|:----------------:|:-------------------:|
| D | c-3 | 4 | - | - | 15 | &le;10 | c4.2xlarge |
| OR | c-3 | 36 | - | - | 60 | &le;10 | c4.8xlarge |
| OF | c-3 | 36 | - | - | 60 | 10 | c4.8xlarge |
| OFplus | c-5 | 72 | - | - | 192 | 100 | c5n.18xlarge |
| SR | c-3 | 36 | - | - | 60 | 10 | c4.8xlarge |
| SF | c-3 | 36 | - | - | 60 | 10 | c4.8xlarge |
| SFplus | c-5 | 72 | - | - | 192 | 100 | c5n.18xlarge |
| GOF | c-8 | 8 | g-3 | 8 | 1152 | 400 | p4d.24xlarge |
| GSF | c-8 | 8 | g-3 | 8 | 1152 | 400 | p4d.24xlarge |
| G4OF | c-4 | 32 | g-4 | 1 | 256 | 10 | p5.4xlarge |

!!! note "Hyper-threading"
Hyper-threading[^7] is enabled on all AWS compute nodes by default. It is recommended to use half of available cores on each compute node (e.g 18 cores on OF queue) if the application does not benefit from the extra virtual cores.
Hyper-threading[^7] is enabled on all AWS compute nodes by default. It is recommended to use half of available cores on
each compute node (e.g. 18 cores on OF queue) if the application does not benefit from the extra virtual cores.

## Links

Expand Down
81 changes: 35 additions & 46 deletions lang/en/docs/infrastructure/clusters/azure.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,70 +4,59 @@ This page contains information about clusters hosted on Microsoft Azure[^1] and

## Clusters

The following table provides information about available clusters on Microsoft Azure cloud computing platform. The latest cluster status can be found on <a href="https://platform.mat3ra.com/clusters" target="_blank">Clusters</a> page in web application.
The following table provides information about available clusters on Microsoft Azure cloud computing platform. The
latest cluster status can be found on <a href="https://platform.mat3ra.com/clusters" target="_blank">Clusters</a> page
in web application.

| Name | Hostname | Location |
| :---: | :---: | :---: |
| cluster-007 | master-production-20160630-cluster-007.exabyte.io | East US |
| Name | Hostname | Location |
|:-----------:|:-------------------------------------------------:|:--------:|
| cluster-003 | master-production-20250821-cluster-003.mat3ra.com | East US |

## Queues

The list of currently enabled queues is given below. Price per core hour is shown in relation to the [relative unit price](../../pricing/service-levels.md#comparison-table) and is subject to change at any time. Total number of nodes can be increased upon [request](../../ui/support.md).

| Name | Category[^2] | Mode[^3] | Charge Policy[^4] | Price | Max Nodes per Job<sup>+</sup> | Max Nodes Total |
| :---: | :---: | :---: | :---: | :---: | :---: | :---: |
| D | debug | debug | core-seconds | 4.002 | 1 | 10 |
| OR | ordinary | regular | core-seconds | 1.275 | 1 | 10 |
| OF | ordinary | fast | core-hours | 1.275 | &le;5 | 100 |
| OFplus| ordinary | fast | core-hours | 1.275 | 5 | 10 |
| SR | saving | regular | core-seconds | 0.379 | 1 | 10 |
| SF | saving | fast | core-hours | 0.379 | 1<sup>*</sup> | 100 |
| SFplus | saving | fast | core-hours | 0.379 | 5 | 10 |
| GPOF | ordinary | fast | core-hours | 6.110 | &le;5 | 10 |
| GP2OF | ordinary | fast | core-hours | 6.110 | &le;5 | 10 |
| GP4OF | ordinary | fast | core-hours | 6.110 | &le;5 | 10 |
| GPSF | saving | fast | core-hours | 1.222 | &le;5 | 10 |
| GP2SF | saving | fast | core-hours | 1.222 | &le;5 | 10 |
| GP4SF | saving | fast | core-hours | 1.222 | &le;5 | 10 |
The list of currently enabled queues is given below. Price per core hour is shown in relation to
the [relative unit price](../../pricing/service-levels.md#comparison-table) and is subject to change at any time. Total
number of nodes can be increased upon [request](../../ui/support.md).

<sup>+</sup> please contact support to inquire about attempting a larger node count per job

<sup>*</sup> presently the infrastructure limitations are not allowing for the multi-node communication in SF queue, so only single-node jobs should be attempted (as of Oct 2022)
| Name | Category[^2] | Mode[^3] | Charge Policy[^4] | Price | Max Nodes per Job<sup>+</sup> | Max Nodes Total |
|:------:|:------------:|:--------:|:-----------------:|:-----:|:-----------------------------:|:---------------:|
| D | debug | ordinary | core-seconds | 4.002 | 1 | 10 |
| OR | regular | ordinary | core-seconds | 1.275 | 1 | 10 |
| SR | regular | saving | core-seconds | 0.379 | 1 | 10 |
| OF | fast | ordinary | core-hours | 1.275 | 5 | 100 |
| SF | fast | saving | core-hours | 0.379 | 5 | 100 |
| GPOF | fast | ordinary | core-hours | 6.110 | 5 | 10 |
| GPSF | fast | saving | core-hours | 1.222 | 5 | 10 |

<sup>+</sup> please contact support to inquire about attempting a larger node count per job

## Hardware Specifications

The following table contains hardware specifications for the above queues.

| Name | CPU[^5] | Cores per Node | GPU[^6] | GPU per Node | Memory (GB) | Bandwidth (Gb/sec) |
| :---: | :---: | :---: | :---: | :---: | :---: | :---: |
| D | c-7 | 16 | - | - | 32 | &le;10 |
| OR | c-6 | 44 | - | - | 352 | 100 |
| OF | c-6 | 44 | - | - | 352 | 100 |
| OFplus| c-6 | 44 | - | - | 352 | 100 |
| SR | c-6 | 44 | - | - | 352 | 100 |
| SF | c-6 | 44 | - | - | 352 | 100 |
| SFPlus| c-6 | 44 | - | - | 352 | 100 |
| GPOF | c-2 | 6 | g-2 | 1 | 112 | 10 |
| GP2OF | c-2 | 12 | g-2 | 2 | 224 | 10 |
| GP4OF | c-2 | 24 | g-2 | 4 | 448 | 10 |
| GPSF | c-2 | 6 | g-2 | 1 | 112 | 10 |
| GP2SF | c-2 | 12 | g-2 | 2 | 224 | 10 |
| GP4SF | c-2 | 24 | g-2 | 4 | 448 | 10 |
The following table contains hardware specifications for the above queues.

| Name | Cores per Node | GPU per Node | Memory (GB) | Bandwidth (Gb/sec) | VM Size |
|:------:|:--------------:|:------------:|:-----------:|:------------------:|:------------------------:|
| D | 8 | - | 2 | &le;10 | Standard_F8s_v2 |
| OR | 44 | - | 352 | 100 | Standard_HC44rs |
| OF | 44 | - | 352 | 100 | Standard_HC44rs |
| SR | 44 | - | 352 | 100 | Standard_HC44rs |
| SF | 44 | - | 352 | 100 | Standard_HC44rs |
| GPOF | 40 | 1 | 320 | 40 | Standard_NC40ads_H100_v5 |
| GPSF | 40 | 1 | 320 | 40 | Standard_NC40ads_H100_v5 |

## Links

[^1]: [Microsoft Azure, Website](https://azure.microsoft.com/en-us/)

[^2]: [Queue Cost Categories, Website](../resource/category.md#cost-categories)
[^2]: [Queue Cost Categories, this documentation](../resource/category.md#cost-categories)

[^3]: [Queue Provision Modes, Website](../resource/category.md#provision-modes)
[^3]: [Queue Provision Modes, this documentation](../resource/category.md#provision-modes)

[^4]: [Charge polices, Website](../resource/queues.md#charge-policies)
[^4]: [Charge polices, this documentation](../resource/queues.md#charge-policies)

[^5]: [CPU types, Website](hardware.md#cpu-types)
[^5]: [CPU types, this documentation](hardware.md#cpu-types)

[^6]: [GPU types, Website](hardware.md#gpu-types)
[^6]: [GPU types, this documentation](hardware.md#gpu-types)

[^7]: [Azure high performance compute virtual machines, Website](https://docs.microsoft.com/en-us/azure/virtual-machines/linux/sizes-hpc)

Expand Down
Loading