Skip to content

Added pointers to user creation for MsSQLSpark connector #677

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
rajmera3 merged 1 commit into from
Nov 7, 2019
Merged

Added pointers to user creation for MsSQLSpark connector #677

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions ...les/features/sql-big-data-cluster/spark/data-loading/spark-twitter-streaming-sample.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,14 +22,15 @@
"\r\n",
"# **Twitter Streaming with SQL Server & Spark**\r\n",
"\r\n",
"In this notebook, we will go through the process of using Spark to stream tweets from the Twitter API, and then stream the resulting data into the SQL Server data pool. Once the data is in the data pool, we will perform queries on it using T-SQL or the Spark-SQL connector. \r\n",
"In this notebook, we will go through the process of using Spark to stream tweets from the Twitter API, and then stream the resulting data into the SQL Server data pool. To stream the data to SQL Server data pools, we use the MsSQL-Spark connector. Once the data is in the data pool, we will perform queries on it using T-SQL or the Spark-SQL connector. \r\n",
"\r\n",
"## **Steps**\r\n",
"1. [Create a Twitter Developer Account](https://developer.twitter.com/en/apply-for-access.html).\r\n",
"2. Setup\r\n",
" 1. Create 'TwitterData' database.\r\n",
" 2. Create an External Data Source 'TweetsDataSource'.\r\n",
" 2. Create an External Data Source 'TweetsDataSource'. \r\n",
" 3. Create an External Table 'Tweets'.\r\n",
" 4. Create a user account with permissions for data pools, created datasource and the external table. Refer [here](https://github.com/microsoft/sql-server-samples/blob/master/samples/features/sql-big-data-cluster/spark/data-virtualization/mssql_spark_connector_user_creation.ipynb) \r\n",
" 4. Change kernel from \"SQL\" to \"Spark | Scala\".\r\n",
" 5. Import packages.\r\n",
" 6. Enter required parameters.\r\n",
Expand Down Expand Up @@ -252,6 +253,7 @@
"val accessTokenSecret = \"\"\r\n",
"\r\n",
"// Provide username/password to SQL Server master instance\r\n",
"// Refer mssql_spark_connector_user_creation.ipynb in samples repo on how to create this user.\r\n",
"val user = \"user\"\r\n",
"val password = \"password\"\r\n",
"\r\n",
Expand Down