Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Spark SQL support (#4602) #4956

Merged
merged 3 commits into from
May 19, 2023
Merged

Add Spark SQL support (#4602) #4956

merged 3 commits into from
May 19, 2023

Commits on May 19, 2023

  1. Add Spark SQL support (#4602) 

    # Add Spark SQL support 
* Add Spark SQL support. It can connect to Spark via building a
local/remote SparkSession.
* Include a notebook example

I tried some complicated queries (window function, table joins), and the
tool works well.
Compared to the [Spark Dataframe
agent](https://python.langchain.com/en/latest/modules/agents/toolkits/examples/spark.html),
this tool is able to generate queries across multiple tables.

---------

Co-authored-by: Mike W <62768671+skcoirz@users.noreply.github.com>
Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>
Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>
Co-authored-by: UmerHA <40663591+UmerHA@users.noreply.github.com>
Co-authored-by: 张城铭 <z@hyperf.io>
Co-authored-by: assert <zhangchengming@kkguan.com>
Co-authored-by: blob42 <spike@w530>
Co-authored-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: Richard He <he.yucheng@outlook.com>
Co-authored-by: Dev 2049 <dev.dev2049@gmail.com>
Co-authored-by: Leonid Ganeline <leo.gan.57@gmail.com>
Co-authored-by: Alexey Nominas <60900649+Chae4ek@users.noreply.github.com>
Co-authored-by: elBarkey <elbarkey@gmail.com>
Co-authored-by: Davis Chase <130488702+dev2049@users.noreply.github.com>
Co-authored-by: Jeffrey D <1289344+verygoodsoftwarenotvirus@users.noreply.github.com>
Co-authored-by: so2liu <yangliu35@outlook.com>
Co-authored-by: Viswanadh Rayavarapu <44315599+vishwa-rn@users.noreply.github.com>
Co-authored-by: Chakib Ben Ziane <contact@blob42.xyz>
Co-authored-by: Daniel Chalef <131175+danielchalef@users.noreply.github.com>
Co-authored-by: Daniel Chalef <daniel.chalef@private.org>
Co-authored-by: Jari Bakken <jari.bakken@gmail.com>
Co-authored-by: escafati <scafatieugenio@gmail.com>
    @gengliangwang @skcoirz
    @hwchase17 @eyurtsev @UmerHA @assert6 @yuekaizhang @richardyc @dev2049 @leo-gan @Chae4ek @elBarkey @verygoodsoftwarenotvirus @so2liu @vishwa-rn @blob42 @danielchalef @jarib @scafati98
    23 people committed May 19, 2023
    Configuration menu
    Copy the full SHA
    ff5039b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into harrison/spark-sql

    @hwchase17
    hwchase17 committed May 19, 2023
    Configuration menu
    Copy the full SHA
    64e32a3 View commit details
    Browse the repository at this point in the history

  3. cr

    @hwchase17
    hwchase17 committed May 19, 2023
    Configuration menu
    Copy the full SHA
    21e26a5 View commit details
    Browse the repository at this point in the history