Add new function under Class InteractiveQuery in queryservice.py to enable data load using pyspark.sql data frame

[yoyo6022]

[pitchmuc]

Hello @yoyo6022
Sorry for the late response and not sure how much you still want that feature.
However, I feel like having to return the pyspark would create a dependency to pyspark that is less commonly used than pandas.
This dependency would be for all user of interactive query service...
What I would recommend instead is to document the translation to pyspark dataframe in our documentation.

# Pandas to Spark
df_sp = spark_session.createDataFrame(df_pd)

I think it should be clear enough.