Ability to query redshift into dataframe

[robertaves]

i have a use case where querying redshift into a dataframe would be a good addition. Any ideas if this is possible?

[igorborgest]

Hey @robertaves, this is one of the most wanted features!

We are waiting for the "UNLOAD to Parquet" feature release on the Redshift service.
Of course we can do with CSV or JDBC, but we would like to wait for Parquet that will be the best approach.

[robertaves]

looks to be available now..

https://docs.aws.amazon.com/redshift/latest/dg/r_UNLOAD.html

[igorborgest]

Hi @robertaves, you are right!

And I'm already working on that, take a look in the snippet of code that I committed yesterday!

Of course that stills a lot of work to do, so I will keep working on it.

[igorborgest]

Available on version >= 0.1.0