Return the Query ID after execute query in Athena

[phamhoangtuan]

• Purpose: Get the query ID to search for the file in S3, download that file and add data to our DB.
• Current situation: We have no way to retrieve the query ID after execute the query. We need to search for the latest file in S3 and download that file.
• Proposed approach: Have a function, maybe called getQueryID in cursor to return the executed query ID.

[tewfik-ghariani]

Hello,
As a matter of fact, there is a method to retrieve the query ID. It is already mentioned in the official documentation of Athena JDBC driver and it is functional within PyAthenajdbc module.

It consists in specifying the log_path option in the connection method

Example

BASE_DIR = os.path.dirname(os.path.dirname(os.path.abspath(__file__)))
athena_jdbc_driver_path = BASE_DIR + "/lib/static/AthenaJDBC.jar"
log_path = BASE_DIR + "/lib/static/queries.log"



conn = pyathenajdbc.connect(
                              s3_staging_dir="s3://athena",
                              access_key=access_key_id,
                              secret_key=secret_key_id,
                              region_name="us-east-1",
                              log_path=log_path,
                              driver_path=athena_jdbc_driver_path
                              )

[laughingman7743]

I think that it can be realized with the following simple implementation.

    @property
    def query_id(self):
        if not self.has_result_set:
            raise ProgrammingError('No result set.')
        return self._result_set.getClient().getQueryId()

I will check on the weekend.
Thanks,

[laughingman7743]

I added a property to retrieve the query_id to the cursor object with the following pull request.
#10

Please check it.

[miltoneck]

so... that's gone?
is there a different way of doing this?
or where did the getClient() property go?