feat: use glue api to delete table instead of athena drop

[chrischin478]

Description

Feature #44. Use Glue API instead of Athena to drop tables and views.

Models used to test

Table

{{ config(materialized='table') }}

WITH source_data AS (
    SELECT 1 AS id
    UNION ALL
    SELECT NULL AS id
)
SELECT *
FROM source_data

Iceberg Table

{{ config(
    materialized='table',
    table_type='iceberg',
    format='parquet'
) }}

SELECT
  'A' AS user_id,
  'pi' AS name,
  'active' AS status,
  17.89 AS cost,
  1 AS quantity,
  100000000 AS quantity_big,
  current_date AS my_date

Hive HA Table

{{ config(
    materialized='table_hive_ha',
    format='parquet',
    partition_by=['status'],
    s3_data_naming='table_unique'
) }}

SELECT
  'a' as user_id,
  'pi' as user_name,
  'active' as status
UNION ALL
SELECT
  'b' as user_id,
  'sh' as user_name,
  'disabled' as status

Incremental Table

{{ 
    config(
        materialized='incremental',
        unique_key='id'
    ) 
}}

SELECT
    1 AS id,
    'a' AS key_value
UNION ALL
SELECT
    2 AS id,
    'b' AS key_value

Checklist

• You followed contributing section
• You added unit testing when necessary
• You added functional testing when necessary

[chrischin478]

I'm not sure if any test cases need to be added. I haven't yet tested an incremental table but am planning to tomorrow.

[nicor88]

inside https://github.com/dbt-athena/dbt-athena/blob/main/dbt/include/athena/macros/materializations/models/table/table_hive_ha.sql#L42 please refactor the method to call delete_from_glue_catalog instead of drop!

[nicor88]

@Jrmyy would you mind to have a look at this one?
@chrischin478 so far code looks good to me, did you run integration tests ?

[chrischin478]

@Jrmyy would you mind to have a look at this one? @chrischin478 so far code looks good to me, did you run integration tests ?

@nicor88 There's no option for me to reply to this comment for some reason. I ran integration tests and there were a few that skipped but the ones that ran all passed.

[nicor88]

@chrischin478 do you think that you can add some unit tests for delete_from_glue_catalog ? we aim to release tomorrow ideally, and will be nice to have this one in. Thanks:)