Skip to content

Instantly share code, notes, and snippets.

@mwinkle
Created April 6, 2014 18:01
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mwinkle/10009475 to your computer and use it in GitHub Desktop.
Save mwinkle/10009475 to your computer and use it in GitHub Desktop.
Interacting with Azure SQL DB From HDInsight
Sqoop using Command line (SQL to Hive)
bin\sqoop import --connect "jdbc:sqlserver://[yourserver].database.windows.net:1433;database=AdventureWorks2012;user=[username];password=[password]" --table SalesOrderDetail --hive-import -m 10 -- --schema Sales
Sqoop using Remote PowerShell
New-AzureHDInsightSqoopJobDefinition –Command 'import --connect "jdbc:sqlserver://[yourserver].database.windows.net:1433;database=AdventureWorks2012;user=[username];password=[password]" --table SalesOrderDetail --hive-import -m 10 -- --schema Sales'
Pig to SQL using DBStorage
REGISTER lib/piggybank.jar;
REGISTER c:\apps\dist\sqljdbc_3.0\enu\sqljdbc4.jar;
STORE limited_summary INTO '/doesnotmatter'
USING org.apache.pig.piggybank.storage.DBStorage('com.microsoft.sqlserver.jdbc.SQLServerDriver',
'jdbc:sqlserver://[yourserver].database.windows.net;database=AdventureWorks2012;user=[username];
password=[password]',
'INSERT INTO OutputFromPig(cs_uri_stem, NumberOfRequests, TotalEgress, AverageTimeTaken) VALUES (?,?,?,?)');
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment