ENH: Add support for dask and rapids

[zbrookle]

No description provided.

[acivitillo]

Thanks for this, me and my team use dask and it makes sense to run SQL on top of parquet files on AWS S3 using something like this rather than a completely different product like Spark or AWS Spectrum.

What are your plans with this library? I see you are parsing the SQL with lark and mapping SQL objects to Pandas objects. I am trying to understand where you want to bring this. In theory with dask you could have this doing what spark sql or apache drill do. What are your thoughts?

[zbrookle]

@acivitillo Yes thanks for asking! That's exactly where the project is going. It always seemed strange to me that spark was the go-to program when someone wants to use sql with an open source data processing framework when the same thing could be done for all the python based frameworks, so this package is meant to fill that gap in capability

[acivitillo]

Will your dask support be available once Ibis adds theirs?

Seems they plan to add support: https://ibis-project.org/

[zbrookle]

@acivitillo Yes, the moment ibis finishes dask support I’ll be adding that into this package

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs.