You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
I need to run tests on tables using AWS Athena as backend. This would enable us to test a great amount of data on a data lake using dbt features.
Describe the solution you'd like
Enable the expectations to be run against an AWS Athena connection.
Describe alternatives you've considered
I tried to use athena_utils with compatibility "shims" but it does not work with all expectations. And it seems that its not possible to make all expectations compatible in this way because some of then does not use a adapter.dispatch . This turns harder to overwrite some of the dbt package tests code.
Additional context
Some expectations that does not work with athena_utils "shims" package:
-expect_column_to_exist
-expect_row_values_to_have_recent_data
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
I need to run tests on tables using AWS Athena as backend. This would enable us to test a great amount of data on a data lake using dbt features.
Describe the solution you'd like
Enable the expectations to be run against an AWS Athena connection.
Describe alternatives you've considered
I tried to use athena_utils with compatibility "shims" but it does not work with all expectations. And it seems that its not possible to make all expectations compatible in this way because some of then does not use a
adapter.dispatch
. This turns harder to overwrite some of the dbt package tests code.Additional context
Some expectations that does not work with athena_utils "shims" package:
-expect_column_to_exist
-expect_row_values_to_have_recent_data
The text was updated successfully, but these errors were encountered: