Permalink
..
Failed to load latest commit information.
00-azure-introduction.md Clarifying comment on DSVM (#274) May 17, 2018
01-getting-started.md Documentation rewrite (#273) May 15, 2018
02-getting-started-script.md add sharedKey to credentials related code and doc (#266) May 3, 2018
03-national-clouds.md Documentation rewrite (#273) May 15, 2018
20-package-management.md Feature/custom package (#272) May 14, 2018
22-parallelizing-cores.md README update Mar 13, 2017
30-customize-cluster.md Documentation rewrite (#273) May 15, 2018
31-vm-sizes.md Documentation rewrite (#273) May 15, 2018
32-autoscale.md Documentation rewrite (#273) May 15, 2018
33-building-containers.md Documentation rewrite (#273) May 15, 2018
40-clusters.md Documentation rewrite (#273) May 15, 2018
51-long-running-job.md Documentation rewrite (#273) May 15, 2018
52-azure-foreach-options.md Fix Azure foreach options documentation (#288) Jul 13, 2018
53-error-handling.md Documentation rewrite (#273) May 15, 2018
71-distributing-data.md Documentation rewrite (#273) May 15, 2018
72-persistent-storage.md Fix: Updating Persistent Storage Documentation (#283) Jun 27, 2018
73-managing-storage.md Documentation rewrite (#273) May 15, 2018
80-performance-tuning.md Fix: Updated MaxTasksPerNode documentation (#279) Jun 7, 2018
90-troubleshooting.md Documentation rewrite (#273) May 15, 2018
91-quota-limitations.md Documentation rewrite (#273) May 15, 2018
92-faq.md Documentation rewrite (#273) May 15, 2018
README.md Documentation rewrite (#273) May 15, 2018

README.md

doAzureParallel Guide

This section will provide information about how Azure works, how best to take advantage of Azure, and best practices when using the doAzureParallel package.

  1. Azure Introduction (link)

    Using Azure Batch

  2. Getting Started (link)

    Using the Getting Started to create credentials

    i. Generate Credentials Script (link)

    • Pre-built bash script for getting Azure credentials without Azure Portal

    ii. National Cloud Support (link)

    • How to run workload in Azure national clouds
  3. Customize Cluster (link)

    Setting up your cluster to user's specific needs

    i. Virtual Machine Sizes (link)

    • How do you choose the best VM type/size for your workload?

    ii. Autoscale (link)

    • Automatically scale up/down your cluster to save time and/or money.

    iii. Building Containers (link)

    • Creating your own Docker containers for reproducibility
  4. Managing Cluster (link)

    Managing your cluster's lifespan

  5. Customize Job

    Setting up your job to user's specific needs

    i. Asynchronous Jobs (link)

    • Best practices for managing long running jobs

    ii. Foreach Azure Options (link)

    • Use Azure package-defined foreach options to improve performance and user experience

    iii. Error Handling (link)

    • How Azure handles errors in your Foreach loop?
  6. Package Management (link)

    Best practices for managing your R packages in code. This includes installation at the cluster or job level as well as how to use different package providers.

  7. Storage Management

    i. Distributing your Data (link)

    • Best practices and limitations for working with distributed data.

    ii. Persistent Storage (link)

    • Taking advantage of persistent storage for long-running jobs

    iii. Accessing Azure Storage through R (link)

    • Manage your Azure Storage files via R
  8. Performance Tuning (link)

    Best practices on optimizing your Foreach loop

  9. Debugging and Troubleshooting (link)

    Best practices on diagnosing common issues

  10. Azure Limitations (link)

    Learn about the limitations around the size of your cluster and the number of foreach jobs you can run in Azure.

Additional Documentation

Read our FAQ for known issues and common questions.