Skip to content
Branch: master
Find file History
Latest commit 5ee198f Apr 18, 2019
Permalink
Type Name Latest commit message Commit time
..
Failed to load latest commit information.
app-deploy Replacing endpoint-service-proxy with mgmtproxy-svc-external. Apr 13, 2019
data-pool
data-virtualization ADded IGNORE_CASE connection option Apr 18, 2019
deployment
machine-learning
spark
README.md
bootstrap-sample-db.cmd
bootstrap-sample-db.sh Updated default knox port number Apr 18, 2019
bootstrap-sample-db.sql

README.md

SQL Server big data clusters

Installation instructions for SQL Server 2019 big data clusters can be found here.

Samples Setup

Before you begin, load the sample data into your big data cluster. For instructions, see Load sample data into a SQL Server 2019 big data cluster.

Executing the sample scripts

The scripts should be executed in a specific order to test the various features. Execute the scripts from each folder in below order:

  1. spark/dataloading/transform-csv-files.sql
  2. data-virtualization/storage-pool
  3. data-virtualization/oracle
  4. data-pool
  5. machine-learning/sql/r
  6. machine-learning/sql/python

data-pool

SQL Server 2019 big data cluster contains a data pool which consists of many SQL Server instances to store data & query in a scale-out manner.

Data ingestion using Spark

The sample script data-pool/data-ingestion-spark.sql shows how to perform data ingestion from Spark into data pool table(s).

Data ingestion using sql

The sample script data-pool/data-ingestion-sql.sql shows how to perform data ingestion from T-SQL into data pool table(s).

data-virtualization

SQL Server 2019 or SQL Server 2019 big data cluster can use PolyBase external tables to connect to other data sources.

External table over Storage Pool

SQL Server 2019 big data cluster contains a storage pool consisting of HDFS, Spark and SQL Server instances. The data-virtualization/storage-pool folder contains samples that demonstrate how to query data in HDFS inside SQL Server 2019 big data cluster.

External table over Oracle

SQL Server 2019 uses new ODBC connectors to enable connectivity to SQL Server, Oracle, Teradata, MongoDB and generic ODBC data sources.

The data-virtualization/oracle folder contains samples that demonstrate how to query data in Oracle using external tables.

deployment

The deployment folder contains the scripts for deploying a Kubernetes cluster for SQL Server 2019 big data cluster.

machine-learning

SQL Server 2016 added support executing R scripts from T-SQL. SQL Server 2017 added support for executing Python scripts from T-SQL. SQL Server 2019 adds support for executing Java code from T-SQL. SQL Server 2019 big data cluster adds support for executing Spark code inside the big data cluster.

SQL Server Machine Learning Services

The machine-learning\sql folder contains the sample SQL scripts that show how to invoke R, Python, and Java code from T-SQL.

Spark Machine Learning

The machine-learning\spark folder contains the Spark samples.

You can’t perform that action at this time.