Skip to content

Commit

Permalink
Merge branch 'develop' into m/dx-153/create_ci_folder
Browse files Browse the repository at this point in the history
  • Loading branch information
@anthonyburdi
anthonyburdi committed Feb 27, 2023
2 parents 027af18 + 9b3a89a commit 057b3bd
Show file tree
Hide file tree
Showing 116 changed files with 3,679 additions and 310 deletions.
58 changes: 29 additions & 29 deletions README.md
View file
Expand Up @@ -50,7 +50,7 @@ Get useful results quickly even for large data volumes. GX’s Data Assistants p



![data_assistant_plot_expectations_and_metrics](./readme_assets/data_assistant_plot_expectations_and_metrics.png)
![data_assistant_plot_expectations_and_metrics](./docs/readme_assets/data_assistant_plot_expectations_and_metrics.png)

### Unified understanding

Expand All @@ -72,13 +72,13 @@ GX doesn’t ask you to exchange security for your insight. It processes your da

Checkpoints are a transparent, central, and automatable mechanism for testing Expectations and evaluating your data quality. Every Checkpoint run produces human-readable Data Docs reporting the results. You can also configure Checkpoints to take Actions based on the results of the evaluation, like sending alerts and preventing low-quality data from moving further in your pipelines.

![Image of data contact support](./readme_assets/data-contract-support.png)
![Image of data contact support](./docs/readme_assets/data-contract-support.png)

### Readable for collaboration

Everyone stays on the same page about your data quality with GX’s inspectable, shareable, and human-readable Data Docs. You can publish Data Docs to the locations where you need them in a variety of formats, making it easy to integrate Data Docs into your existing data catalogs, dashboards, and other reporting and data governance tools.

![Image of data docs](./readme_assets/datadocs-update.jpg)
![Image of data docs](./docs/readme_assets/datadocs-update.jpg)

Quick start
-------------------------------------------------------------
Expand Down Expand Up @@ -116,7 +116,7 @@ Great Expectations works with the tools and systems that you're already using wi
<tbody>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/datahub_logo.jpg" />
<img height="40" src="./docs/readme_assets/datahub_logo.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/integrations/integration_datahub/">
Expand All @@ -129,7 +129,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/aws-glue-logo__1_.jpg" />
<img height="40" src="./docs/readme_assets/aws-glue-logo__1_.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/deployment_patterns/how_to_use_great_expectations_in_aws_glue/">
Expand All @@ -142,7 +142,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/Athena_logo.jpg" />
<img height="40" src="./docs/readme_assets/Athena_logo.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/database/athena/">
Expand All @@ -155,7 +155,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/datasource_redshift.jpg" />
<img height="40" src="./docs/readme_assets/datasource_redshift.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/database/redshift/">
Expand All @@ -168,7 +168,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/awss3.jpg" />
<img height="40" src="./docs/readme_assets/awss3.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/setup/configuring_data_docs/how_to_host_and_share_data_docs_on_amazon_s3/">
Expand All @@ -181,7 +181,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/bigquery.jpg" />
<img height="40" src="./docs/readme_assets/bigquery.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/deployment_patterns/how_to_use_great_expectations_with_google_cloud_platform_and_bigquery/">
Expand All @@ -194,7 +194,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/og-databricks.jpg" />
<img height="40" src="./docs/readme_assets/og-databricks.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/deployment_patterns/how_to_use_great_expectations_in_databricks/">
Expand All @@ -207,7 +207,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/deepnote_logo_400x.jpg" />
<img height="40" src="./docs/readme_assets/deepnote_logo_400x.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/deployment_patterns/how_to_use_great_expectations_in_deepnote/">
Expand All @@ -220,7 +220,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/Google_Cloud_logo.jpg" />
<img height="40" src="./docs/readme_assets/Google_Cloud_logo.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/deployment_patterns/how_to_use_great_expectations_with_google_cloud_platform_and_bigquery/">
Expand All @@ -233,7 +233,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/microsoft-azure-blob-storage-logo.jpg" />
<img height="40" src="./docs/readme_assets/microsoft-azure-blob-storage-logo.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/setup/configuring_data_docs/how_to_host_and_share_data_docs_on_azure_blob_storage/">
Expand All @@ -246,7 +246,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/microsoft-sql-server-logo-96AF49E2B3-seeklogo.jpg" />
<img height="40" src="./docs/readme_assets/microsoft-sql-server-logo-96AF49E2B3-seeklogo.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/database/mssql">
Expand All @@ -259,7 +259,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/mysql.jpg" />
<img height="40" src="./docs/readme_assets/mysql.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/database/mysql/">
Expand All @@ -272,7 +272,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/pandas.jpg" />
<img height="40" src="./docs/readme_assets/pandas.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/in_memory/pandas/">
Expand All @@ -285,7 +285,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/postgres.jpg" />
<img height="40" src="./docs/readme_assets/postgres.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/database/postgres/">
Expand All @@ -298,7 +298,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/snowflake.jpg" />
<img height="40" src="./docs/readme_assets/snowflake.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/database/snowflake/">
Expand All @@ -311,7 +311,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/spark.jpg" />
<img height="40" src="./docs/readme_assets/spark.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/deployment_patterns/how_to_instantiate_a_data_context_on_an_emr_spark_cluster/">
Expand All @@ -324,7 +324,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/SQLite370.jpg" />
<img height="40" src="./docs/readme_assets/SQLite370.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/database/sqlite/">
Expand All @@ -337,7 +337,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/trino-og.jpg" />
<img height="40" src="./docs/readme_assets/trino-og.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/database/trino/">
Expand All @@ -350,7 +350,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/Apache_Airflow.jpg" />
<img height="40" src="./docs/readme_assets/Apache_Airflow.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/deployment_patterns/how_to_use_great_expectations_with_airflow/">
Expand All @@ -363,7 +363,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/flyte_logo.jpg" />
<img height="40" src="./docs/readme_assets/flyte_logo.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/deployment_patterns/how_to_use_great_expectations_in_flyte/">
Expand All @@ -376,7 +376,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/meltano-logo.jpg" />
<img height="40" src="./docs/readme_assets/meltano-logo.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/deployment_patterns/how_to_use_great_expectations_with_meltano/">
Expand All @@ -389,7 +389,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/prefect-logo-gradient-navy.jpg" />
<img height="40" src="./docs/readme_assets/prefect-logo-gradient-navy.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/deployment_patterns/how_to_use_great_expectations_with_prefect/">
Expand All @@ -402,7 +402,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/zenml.jpg" />
<img height="40" src="./docs/readme_assets/zenml.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/integrations/integration_zenml/">
Expand All @@ -415,7 +415,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/slack.jpg" />
<img height="40" src="./docs/readme_assets/slack.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/guides/validation/validation_actions/how_to_trigger_slack_notifications_as_a_validation_action/">
Expand All @@ -428,7 +428,7 @@ Great Expectations works with the tools and systems that you're already using wi
</tr>
<tr>
<td style="text-align: center; height: 40px; background-color: #fff;">
<img height="40" src="./readme_assets/jupyter.jpg" />
<img height="40" src="./docs/readme_assets/jupyter.jpg" />
</td>
<td style="width: 200px;">
<a href="https://docs.greatexpectations.io/docs/tutorials/getting_started/tutorial_create_expectations/#creating-expectations-in-jupyter-notebooks">
Expand All @@ -452,7 +452,7 @@ Great Expectations is _not_ a database or storage software. It processes your da

Great Expectations is _not_ a data versioning tool. If you want to bring your data itself under version control, check out tools like [DVC](https://dvc.org/) and [Quilt](https://github.com/quiltdata/quilt).

Great Expectations is _not_ a language-agnostic platform. Instead, it follows the philosophy of “take the compute to the data” by using the popular Python language to support native execution of Expectations in pandas, SQL (via SQLAlchemy), and Spark environments.
Great Expectations is _not_ a language-agnostic platform. Instead, it follows the philosophy of “take the compute to the data” by using the popular Python language to support native execution of Expectations in pandas, SQL (via SQLAlchemy), and Spark environments.

Great Expectations is _not_ exclusive to Python programming environments. It can be invoked from the command line without a Python environment. However, if you’re working into another ecosystem, you may want to explore ecosystem-specific alternatives such as [assertR](https://github.com/ropensci/assertr) (for R environments) or [TFDV](https://www.tensorflow.org/tfx/guide/tfdv) (for Tensorflow environments).

Expand Down

0 comments on commit 057b3bd

Please sign in to comment.