From 1d20c92c5d483e396f35a9d67d30cead484e49c2 Mon Sep 17 00:00:00 2001 From: Rob Gray <104205257+kwcanuck@users.noreply.github.com> Date: Mon, 11 Mar 2024 10:41:39 -0400 Subject: [PATCH 1/2] Preliminary edits. --- .../azure_blob_storage.md | 5 +- .../google_cloud_storage.md | 51 +++++++++++++++++-- 2 files changed, 50 insertions(+), 6 deletions(-) diff --git a/docs/docusaurus/docs/core/installation_and_setup/additional_dependencies/azure_blob_storage.md b/docs/docusaurus/docs/core/installation_and_setup/additional_dependencies/azure_blob_storage.md index 2bb92ee5cba5..3b41729953d4 100644 --- a/docs/docusaurus/docs/core/installation_and_setup/additional_dependencies/azure_blob_storage.md +++ b/docs/docusaurus/docs/core/installation_and_setup/additional_dependencies/azure_blob_storage.md @@ -3,13 +3,14 @@ title: Install and set up Azure Blob Storage support --- import PrereqPythonInstalled from '../../_core_components/prerequisites/_python_installation.md'; -Azure Blob Storage allows users to store unstructured data on Microsoft's cloud data storage platform. With the installation of some additional Python libraries and the provision of a connection string, you will be able to use Great Expectations (GX) alongside data kept in Azure Blob Storge. +Azure Blob Storage stores unstructured data on the Microsoft cloud data storage platform. To validate Azure Blob Storage data with Great Expectations (GX) you install additional Python libraries and define a connection string. ## Prerequisites - - (Recommended) [A Python virtual environment](/core/installation_and_setup/set_up_a_python_environment.mdx#optional-create-a-virtual-environment). -- An [Azure Storage account](https://docs.microsoft.com/en-us/azure/storage). A [connection string](https://docs.microsoft.com/en-us/azure/storage/common/storage-account-keys-manage?tabs=azure-portal) is required to complete the setup. +- An [Azure Storage account](https://docs.microsoft.com/en-us/azure/storage). +- [Azure storage account access keys](https://docs.microsoft.com/en-us/azure/storage/common/storage-account-keys-manage?tabs=azure-portal). ## Installation diff --git a/docs/docusaurus/docs/core/installation_and_setup/additional_dependencies/google_cloud_storage.md b/docs/docusaurus/docs/core/installation_and_setup/additional_dependencies/google_cloud_storage.md index 263a56621bee..0a0eb79747e9 100644 --- a/docs/docusaurus/docs/core/installation_and_setup/additional_dependencies/google_cloud_storage.md +++ b/docs/docusaurus/docs/core/installation_and_setup/additional_dependencies/google_cloud_storage.md @@ -2,13 +2,56 @@ title: Install and set up Google Cloud Storage support --- -import InProgress from '../../_core_components/_in_progress.md'; - - +import PrereqPythonInstalled from '../../_core_components/prerequisites/_python_installation.md'; +To validate Google Cloud Platform (GCP) data with GX Core, you create your GX Python environment, install GX Core locally, and then configure the necessary dependencies. ## Prerequisites +- +- pip can be used to install Python modules. +- A [GCP service account](https://cloud.google.com/iam/docs/service-account-overview) with permissions to access GCP resources and storage Objects. +- The `GOOGLE_APPLICATION_CREDENTIALS` environment variable is set. See [Set up Application Default Credentials](https://cloud.google.com/docs/authentication/provide-credentials-adc). +- Google Cloud API authentication is set up. See [Set up authentication](https://cloud.google.com/storage/docs/reference/libraries#authentication). + ## Installation -## Next steps \ No newline at end of file +1. Run the following code to confirm your Python version: + + ```bash title="Terminal input" + python --version + ``` + If your existing Python version is not 3.8 to 3.11, see [Active Python Releases](https://www.python.org/downloads/). + +2. Run the following code to create a virtual environment and a directory named `my_venv`: + + ```bash title="Terminal input" + python -m venv my_venv + ``` + Optional. Replace `my_venv` with another directory name. + + If you prefer, you can use virtualenv, pyenv, and similar tools to install GX in virtual environments. + +3. Run the following code to activate the virtual environment: + + ```bash title="Terminal input" + source my_venv/bin/activate + ``` + +4. Run the following code to install optional dependencies: + + ```bash title="Terminal input" + python -m pip install 'great_expectations[gcp]' + ``` + +5. Run the following code to confirm GX was installed successfully: + + ```bash title="Terminal input" + great_expectations --version + ``` + The output should be `great_expectations, version `. + + +## Next steps + +- [Manage Data Contexts](/core/installation_and_setup/manage_data_contexts.md) From 12365376e28d4dcd7358a4f1d5879f1d701e0ca9 Mon Sep 17 00:00:00 2001 From: Rob Gray <104205257+kwcanuck@users.noreply.github.com> Date: Mon, 11 Mar 2024 11:09:58 -0400 Subject: [PATCH 2/2] Removed icon. --- docs/docusaurus/sidebars.js | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/docusaurus/sidebars.js b/docs/docusaurus/sidebars.js index 6a783ede2846..8db8ac65de6a 100644 --- a/docs/docusaurus/sidebars.js +++ b/docs/docusaurus/sidebars.js @@ -43,7 +43,7 @@ module.exports = { { type: 'doc', id: 'core/installation_and_setup/additional_dependencies/google_cloud_storage', - label: '🚧 Google Cloud Storage' + label: 'Google Cloud Storage' }, { type: 'doc',