Skip to content

Latest commit

 

History

History
105 lines (72 loc) · 5.18 KB

vdbench.md

File metadata and controls

105 lines (72 loc) · 5.18 KB
Raw

Mar 2020 - Update

We have added new terraform VDBench examples for a more automatic install:

  1. HPC Cache and VDBench example
  2. Avere vFXT and VDBench example

The below instructions will still work, if you do not wish to use the Terraform examples.

Vdbench - measuring HPC cache or vFXT performance

This is a basic setup to generate small and medium sized workloads to test the Azure HPC Cache or Avere vFXT for Azure memory and disk subsystems. The suggested configuration is 12 x Standard_D2s_v3 clients for each group of 3 vFXT nodes or for each 2 GB/s of throughput capacity in an HPC cache.

vdbench download and documentation

Deployment

These deployment instructions describe the installation of all components required to run Vdbench:

  1. Deploy an Azure HPC Cache or Avere vFXT for Azure.

  2. If you have not already done so, ssh to the controller, and mount to the addresses of the HPC cache or Avere vFXT:

    1. Run the following commands:

      sudo -s
apt-get update
apt-get install nfs-common
mkdir -p /nfs/node0
mkdir -p /nfs/node1
mkdir -p /nfs/node2
chown nobody:nogroup /nfs/node0
chown nobody:nogroup /nfs/node1
chown nobody:nogroup /nfs/node2

    2. Edit /etc/fstab to add the following lines but using your HPC cache or vFXT node IP addresses. Add more lines if your cluster has more than three nodes.

      10.0.0.12:/msazure    /nfs/node0    nfs hard,nointr,proto=tcp,mountproto=tcp,retry=30 0 0
10.0.0.13:/msazure    /nfs/node1    nfs hard,nointr,proto=tcp,mountproto=tcp,retry=30 0 0
10.0.0.14:/msazure    /nfs/node2    nfs hard,nointr,proto=tcp,mountproto=tcp,retry=30 0 0

    3. To mount all shares, type mount -a

  3. On the controller, download the vdbench bootstrap script:

    mkdir -p /nfs/node0/bootstrap
cd /nfs/node0/bootstrap
curl --retry 5 --retry-delay 5 -o /nfs/node0/bootstrap/bootstrap.vdbench.sh https://raw.githubusercontent.com/Azure/Avere/main/src/clientapps/vdbench/bootstrap.vdbench.sh

  4. Download the latest vdbench from https://www.oracle.com/technetwork/server-storage/vdbench-downloads-1901681.html, and scp the zip file to the /nfs/node0/bootstrap directory. To download you will need to create an account with Oracle and accept the license.

  5. From your controller, verify your vdbench setup by running the following script. If the script shows success, you are ready to deploy. Otherwise you will need to fix each error listed.

    curl -o- https://raw.githubusercontent.com/Azure/Avere/main/src/clientapps/vdbench/vdbenchVerify.sh | bash

  6. Deploy the clients by clicking the "Deploy to Azure" button below, but set the following settings:

  • SSH key is required for vdbench

  • specify /bootstrap/bootstrap.vdbench.sh for the bootstrap script

Using vdbench

  1. After deployment is complete, find the IP of one of the VDBench clients from the portal or https://resources.azure.com, and login from the controller and run the following commands to set your private SSH secret:

    touch ~/.ssh/id_rsa
chmod 600 ~/.ssh/id_rsa
vi ~/.ssh/id_rsa

  2. During installation, copy_dirsa.sh was installed to ~/. on the vdbench client machine, to enable easy copying of your private key to all vdbench clients. Run ~/copy_idrsa.sh to copy your private key to all vdbench clients, and to add all clients to the "known hosts" list. (Note if your ssh key requires a passphrase, some extra steps are needed to make this work. Consider creating a key that does not require a passphrase for ease of use.)

Memory test

  1. To run the memory test (approximately 20 minutes), issue the following command:

    cd
./run_vdbench.sh inmem.conf uniquestring1

  2. Browse to the Azure HPC Cache resource in the portal or log in to Avere vFXT cluster GUI (Avere Control Panel - instructions here) to watch the performance metrics. You will see a similar performance chart to the following:

On-disk test

  1. To run the on-disk test (approximately 40 minutes) issue the following command:

    cd
./run_vdbench.sh ondisk.conf uniquestring2

  2. Log in to the Avere Control Panel (instructions) to watch the performance metrics. You will see a performance chart similar to the following one: