-
Notifications
You must be signed in to change notification settings - Fork 62
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature/pred2bq bulk update #230
base: main
Are you sure you want to change the base?
Feature/pred2bq bulk update #230
Commits on May 15, 2023
-
Configuration menu - View commit details
-
Copy full SHA for c5d3250 - Browse repository at this point
Copy the full SHA c5d3250View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1ed693e - Browse repository at this point
Copy the full SHA 1ed693eView commit details -
pred2bq: Refactor executor.py.
- Adds unit tests - Also adds credits to original code author
Configuration menu - View commit details
-
Copy full SHA for 9708b46 - Browse repository at this point
Copy the full SHA 9708b46View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7f25633 - Browse repository at this point
Copy the full SHA 7f25633View commit details -
Configuration menu - View commit details
-
Copy full SHA for f4ca221 - Browse repository at this point
Copy the full SHA f4ca221View commit details -
pred2bq: Add integration test - executor to BQ
Adds a test that runs the executor module's Beam pipeline using a DirectRunner and exports prediction data to an actual BigQuery table.
Configuration menu - View commit details
-
Copy full SHA for 6938e58 - Browse repository at this point
Copy the full SHA 6938e58View commit details -
Configuration menu - View commit details
-
Copy full SHA for cd17b95 - Browse repository at this point
Copy the full SHA cd17b95View commit details -
Configuration menu - View commit details
-
Copy full SHA for 60faa2d - Browse repository at this point
Copy the full SHA 60faa2dView commit details -
Configuration menu - View commit details
-
Copy full SHA for e4d78ce - Browse repository at this point
Copy the full SHA e4d78ceView commit details -
Changes: - Refactors the component integrate test and adds a test to run the component on Vertex AI Pipelines. - Adds a Dockerfile to package the component code into a Docker image based on OSS TFX image. The image can then be used as the base image when running a pipeline in Vertex AI. - Updates the `bigquery_export` output of the predictions-to-bigquery to store the generated BigQuery table name. This aids with checking the output of the component during testing, but also allows any downstream component receive this component's output.
Configuration menu - View commit details
-
Copy full SHA for 497e3f9 - Browse repository at this point
Copy the full SHA 497e3f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for c68667b - Browse repository at this point
Copy the full SHA c68667bView commit details -
pred2bq: Add integration test with transform.
Adds a test that integrates the transform component into the pipeline. Test is implemented for local runner only.
Configuration menu - View commit details
-
Copy full SHA for 8f48517 - Browse repository at this point
Copy the full SHA 8f48517View commit details -
Configuration menu - View commit details
-
Copy full SHA for f8a53d2 - Browse repository at this point
Copy the full SHA f8a53d2View commit details -
pred2bq: Add Transform component in Vertex AI test.
Adds a container component stub to represent the TFX Transform component for integration testing on Vertex AI.
Configuration menu - View commit details
-
Copy full SHA for 4fca0a9 - Browse repository at this point
Copy the full SHA 4fca0a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for b57d02a - Browse repository at this point
Copy the full SHA b57d02aView commit details -
Configuration menu - View commit details
-
Copy full SHA for a33b419 - Browse repository at this point
Copy the full SHA a33b419View commit details -
pred2bq: Replace abseil tempfile creation.
Replaces create_tempfile and create_tempdir calls from abseil's absltest.TestCase and parameterized.TestCase with equivalent methods from the tempfile package. The reason is that the abseil methods require parsing of the FLAGs variable, which may not be executed if absltest.main() is not invoked. This can happen when test filtering is performed, e.g. ``` python -m unittest path.to.test ```
Configuration menu - View commit details
-
Copy full SHA for 6df1007 - Browse repository at this point
Copy the full SHA 6df1007View commit details -
Configuration menu - View commit details
-
Copy full SHA for 685cd60 - Browse repository at this point
Copy the full SHA 685cd60View commit details -
Configuration menu - View commit details
-
Copy full SHA for f68f0d7 - Browse repository at this point
Copy the full SHA f68f0d7View commit details -
Mentions the predictions-to-bigquery component in top-level readme.
Configuration menu - View commit details
-
Copy full SHA for 6035c17 - Browse repository at this point
Copy the full SHA 6035c17View commit details -
Update code based on reviewer comments.
- Fix issues in pred2bq readme - Reverted version change in setup.py - Add abls-py test prerequisite in setup.py
Configuration menu - View commit details
-
Copy full SHA for d091922 - Browse repository at this point
Copy the full SHA d091922View commit details
Commits on May 26, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a5de9d2 - Browse repository at this point
Copy the full SHA a5de9d2View commit details
Commits on Jul 13, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 91feb1c - Browse repository at this point
Copy the full SHA 91feb1cView commit details