Skip to content

Commit

Permalink
Fix rendering table in Readme
Browse files Browse the repository at this point in the history
  • Loading branch information
dolfinus committed Apr 18, 2024
1 parent a7abef9 commit 305d82f
Showing 1 changed file with 59 additions and 44 deletions.
103 changes: 59 additions & 44 deletions README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -62,50 +62,65 @@ Requirements
Supported storages
------------------

+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| Type | Storage | Powered by |
+====================+==============+=========================================================================================================================+
| Database | Clickhouse | Apache Spark `JDBC Data Source <https://spark.apache.org/docs/latest/sql-data-sources-jdbc.html>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | MSSQL | |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | MySQL | |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | Postgres | |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | Oracle | |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | Teradata | |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | Hive | Apache Spark `Hive integration <https://spark.apache.org/docs/latest/sql-data-sources-hive-tables.html>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | Kafka | Apache Spark `Kafka integration <https://spark.apache.org/docs/latest/structured-streaming-kafka-integration.html>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | Greenplum | VMware `Greenplum Spark connector <https://docs.vmware.com/en/VMware-Greenplum-Connector-for-Apache-Spark/index.html>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | MongoDB | `MongoDB Spark connector <https://www.mongodb.com/docs/spark-connector/current>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| File | HDFS | `HDFS Python client <https://pypi.org/project/hdfs/>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | S3 | `minio-py client <https://pypi.org/project/minio/>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | SFTP | `Paramiko library <https://pypi.org/project/paramiko/>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | FTP | `FTPUtil library <https://pypi.org/project/ftputil/>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | FTPS | |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | WebDAV | `WebdavClient3 library <https://pypi.org/project/webdavclient3/>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | Samba | `pysmb library <https://pypi.org/project/pysmb/>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| Files as DataFrame | SparkLocalFS | Apache Spark `File Data Source <https://spark.apache.org/docs/latest/sql-data-sources-generic-options.html>`_ |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | SparkHDFS | |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+
| | SparkS3 | `Hadoop AWS <https://hadoop.apache.org/docs/current3/hadoop-aws/tools/hadoop-aws/index.html>`_ library |
+--------------------+--------------+-------------------------------------------------------------------------------------------------------------------------+

Database
~~~~~~~~

+--------------+-------------------------------------------------------------------------------------------------------------------------+
| Storage | Powered by |
+==============+=========================================================================================================================+
| Clickhouse | Apache Spark `JDBC Data Source <https://spark.apache.org/docs/latest/sql-data-sources-jdbc.html>`_ |
+--------------+-------------------------------------------------------------------------------------------------------------------------+
| MSSQL | |
+--------------+-------------------------------------------------------------------------------------------------------------------------+
| MySQL | |
+--------------+-------------------------------------------------------------------------------------------------------------------------+
| Postgres | |
+--------------+-------------------------------------------------------------------------------------------------------------------------+
| Oracle | |
+--------------+-------------------------------------------------------------------------------------------------------------------------+
| Teradata | |
+--------------+-------------------------------------------------------------------------------------------------------------------------+
| Hive | Apache Spark `Hive integration <https://spark.apache.org/docs/latest/sql-data-sources-hive-tables.html>`_ |
+--------------+-------------------------------------------------------------------------------------------------------------------------+
| Kafka | Apache Spark `Kafka integration <https://spark.apache.org/docs/latest/structured-streaming-kafka-integration.html>`_ |
+--------------+-------------------------------------------------------------------------------------------------------------------------+
| Greenplum | VMware `Greenplum Spark connector <https://docs.vmware.com/en/VMware-Greenplum-Connector-for-Apache-Spark/index.html>`_ |
+--------------+-------------------------------------------------------------------------------------------------------------------------+
| MongoDB | `MongoDB Spark connector <https://www.mongodb.com/docs/spark-connector/current>`_ |
+--------------+-------------------------------------------------------------------------------------------------------------------------+

File
~~~~
+--------------+--------------------------------------------------------------------+
| Storage | Powered by |
+==============+====================================================================+
| HDFS | `HDFS Python client <https://pypi.org/project/hdfs/>`_ |
+--------------+--------------------------------------------------------------------+
| S3 | `minio-py client <https://pypi.org/project/minio/>`_ |
+--------------+--------------------------------------------------------------------+
| SFTP | `Paramiko library <https://pypi.org/project/paramiko/>`_ |
+--------------+--------------------------------------------------------------------+
| FTP | `FTPUtil library <https://pypi.org/project/ftputil/>`_ |
+--------------+--------------------------------------------------------------------+
| FTPS | |
+--------------+--------------------------------------------------------------------+
| WebDAV | `WebdavClient3 library <https://pypi.org/project/webdavclient3/>`_ |
+--------------+--------------------------------------------------------------------+
| Samba | `pysmb library <https://pypi.org/project/pysmb/>`_ |
+--------------+--------------------------------------------------------------------+

Files as DataFrame
~~~~~~~~~~~~~~~~~~

+--------------+---------------------------------------------------------------------------------------------------------------+
| Storage | Powered by |
+==============+===============================================================================================================+
| SparkLocalFS | Apache Spark `File Data Source <https://spark.apache.org/docs/latest/sql-data-sources-generic-options.html>`_ |
+--------------+---------------------------------------------------------------------------------------------------------------+
| SparkHDFS | |
+--------------+---------------------------------------------------------------------------------------------------------------+
| SparkS3 | `Hadoop AWS <https://hadoop.apache.org/docs/current3/hadoop-aws/tools/hadoop-aws/index.html>`_ library |
+--------------+---------------------------------------------------------------------------------------------------------------+

.. documentation
Expand Down

0 comments on commit 305d82f

Please sign in to comment.