Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Make integration tests of Pandas against Azure more robust. #3339

Conversation

alexsherstinsky
Copy link
Contributor

@alexsherstinsky alexsherstinsky commented Sep 2, 2021

Currently, the integration test for Azure with Pandas does not include the most important aspect of the Datasource: the DataConnector does NOT get exercised – it is not used to connect to Azure and load a list of batches of data. The present task repairs this, and will serve as a template for doing the same for Spark.

Please annotate your PR title to describe what the PR does, then give a brief bulleted description of your PR below. PR titles should begin with [BUGFIX], [FEATURE], [DOCS], or [MAINTENANCE]. If a new feature introduces breaking changes for the Great Expectations API or configuration files, please also add [BREAKING]. You can read about the tags in our contributor checklist.

Changes proposed in this pull request:

  • JIRA: GREAT-192/GREAT-242

After submitting your PR, CI checks will run and @tiny-tim-bot will check for your CLA signature.

For a PR with nontrivial changes, we review with both design-centric and code-centric lenses.

In a design review, we aim to ensure that the PR is consistent with our relationship to the open source community, with our software architecture and abstractions, and with our users' needs and expectations. That review often starts well before a PR, for example in github issues or slack, so please link to relevant conversations in notes below to help reviewers understand and approve your PR more quickly (e.g. closes #123).

Previous Design Review notes:

Definition of Done

Please delete options that are not relevant.

  • My code follows the Great Expectations style guide
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have added unit tests where applicable and made sure that new and existing tests are passing.
  • I have run any local integration tests and made sure that nothing is broken.

Thank you for submitting!

@github-actions
Copy link
Contributor

github-actions bot commented Sep 2, 2021

HOWDY! This is your friendly 🤖 CHANGELOG bot 🤖

Please don't forget to add a clear and succinct description of your change under the Develop header in docs_rtd/changelog.rst, if applicable. This will help us with the release process. See the Contribution checklist in the Great Expectations documentation for the type of labels to use!

Thank you!

@netlify
Copy link

netlify bot commented Sep 2, 2021

✔️ Deploy Preview for niobium-lead-7998 ready!

🔨 Explore the source changes: 47fb833

🔍 Inspect the deploy log: https://app.netlify.com/sites/niobium-lead-7998/deploys/61302306e156f600082e23e1

😎 Browse the preview: https://deploy-preview-3339--niobium-lead-7998.netlify.app

…tinsky/pandas_against_azure_integration_test_must_load_batches-2021_09_31-2
@alexsherstinsky alexsherstinsky marked this pull request as ready for review September 2, 2021 01:17
@alexsherstinsky alexsherstinsky merged commit d6d10c7 into develop Sep 2, 2021
@alexsherstinsky alexsherstinsky deleted the maintenance/GREAT-192/GREAT-242/alexsherstinsky/pandas_against_azure_integration_test_must_load_batches-2021_09_31-2 branch September 2, 2021 01:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants