Input/Output

pyspark.pandas

Data Generator

range

Spark Metastore Table

read_table DataFrame.to_table

Delta Lake

read_delta DataFrame.to_delta

Parquet

read_parquet DataFrame.to_parquet

ORC

read_orc DataFrame.to_orc

Generic Spark I/O

read_spark_io DataFrame.to_spark_io

Flat File / CSV

read_csv DataFrame.to_csv

Clipboard

read_clipboard DataFrame.to_clipboard

Excel

read_excel DataFrame.to_excel

JSON

read_json DataFrame.to_json

HTML

read_html DataFrame.to_html

SQL

read_sql_table read_sql_query read_sql