Skip to content

Commit 3d0ae48

Browse files
authored
Merge pull request #677 from shivsood/streming_sample_fix_users
Added pointers to user creation for MsSQLSpark connector
2 parents 22f9293 + 45759b4 commit 3d0ae48

1 file changed

Lines changed: 4 additions & 2 deletions

File tree

samples/features/sql-big-data-cluster/spark/data-loading/spark-twitter-streaming-sample.ipynb

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,15 @@
2222
"\r\n",
2323
"# **Twitter Streaming with SQL Server & Spark**\r\n",
2424
"\r\n",
25-
"In this notebook, we will go through the process of using Spark to stream tweets from the Twitter API, and then stream the resulting data into the SQL Server data pool. Once the data is in the data pool, we will perform queries on it using T-SQL or the Spark-SQL connector. \r\n",
25+
"In this notebook, we will go through the process of using Spark to stream tweets from the Twitter API, and then stream the resulting data into the SQL Server data pool. To stream the data to SQL Server data pools, we use the MsSQL-Spark connector. Once the data is in the data pool, we will perform queries on it using T-SQL or the Spark-SQL connector. \r\n",
2626
"\r\n",
2727
"## **Steps**\r\n",
2828
"1. [Create a Twitter Developer Account](https://developer.twitter.com/en/apply-for-access.html).\r\n",
2929
"2. Setup\r\n",
3030
" 1. Create 'TwitterData' database.\r\n",
31-
" 2. Create an External Data Source 'TweetsDataSource'.\r\n",
31+
" 2. Create an External Data Source 'TweetsDataSource'. \r\n",
3232
" 3. Create an External Table 'Tweets'.\r\n",
33+
" 4. Create a user account with permissions for data pools, created datasource and the external table. Refer [here](https://github.com/microsoft/sql-server-samples/blob/master/samples/features/sql-big-data-cluster/spark/data-virtualization/mssql_spark_connector_user_creation.ipynb) \r\n",
3334
" 4. Change kernel from \"SQL\" to \"Spark | Scala\".\r\n",
3435
" 5. Import packages.\r\n",
3536
" 6. Enter required parameters.\r\n",
@@ -252,6 +253,7 @@
252253
"val accessTokenSecret = \"\"\r\n",
253254
"\r\n",
254255
"// Provide username/password to SQL Server master instance\r\n",
256+
"// Refer mssql_spark_connector_user_creation.ipynb in samples repo on how to create this user.\r\n",
255257
"val user = \"user\"\r\n",
256258
"val password = \"password\"\r\n",
257259
"\r\n",

0 commit comments

Comments
 (0)