Skip to content

Instantly share code, notes, and snippets.

View ashisharora1909's full-sized avatar

ashisharora1909

0 followers · 1 following
View GitHub Profile
@ashisharora1909
ashisharora1909 / release_pipeline_ps_script.ps1
Last active October 2, 2020 00:44
Run Publish-AdfV2FromJson function from azure.datafactory.tools PowerShell module
# Install the required modules
Install-PackageProvider -Name NuGet -Force -Scope CurrentUser
Install-Module -Name azure.datafactory.tools -Scope CurrentUser -Force -Verbose
Import-Module -Name azure.datafactory.tools
# Publish the ADF artefacts
Publish-AdfV2FromJson `
-RootFolder "$(System.DefaultWorkingDirectory)/_AzureDataFactory-CI/drop" `
-ResourceGroupName "$(resourceGroupName)" `
-DataFactoryName "$(dataFactoryName)" `
@ashisharora1909
ashisharora1909 / azure-pipelines.yml
Created September 29, 2020 01:44
Azure Data Factory V2 CI YAML pipeline
# Starter pipeline
# Start with a minimal pipeline that you can customize to build and deploy your code.
# Add steps that build, run tests, deploy, and more:
# https://aka.ms/yaml
trigger:
- master
pool:
vmImage: 'ubuntu-latest'
@ashisharora1909
ashisharora1909 / create_table_dbo_output.sql
Created September 17, 2020 23:58
dbo.output create table script
create table dbo.output
(
name varchar(20),
location varchar(20),
salary integer
);
@ashisharora1909
ashisharora1909 / setup_permissions_adf_keyvault.azcli
Created September 16, 2020 02:19
Grant ADF v2 access to Key Vault (Managed Identity Object ID)
az keyvault set-policy --name KV-Ash-Dev --object-id XXADFDev_ManagedIdentityObjectIDXX --secret-permissions get list set delete --key-permissions create decrypt delete encrypt get list unwrapKey wrapKey
az keyvault set-policy --name KV-Ash-Prod --object-id XXADFProd_ManagedIdentityObjectIDXX --secret-permissions get list set delete --key-permissions create decrypt delete encrypt get list unwrapKey wrapKey
@ashisharora1909
ashisharora1909 / setup_permissions.azcli
Last active September 11, 2020 01:02
Give service principal access to Azure Key Vault.
az keyvault set-policy -n KV-Ash-Dev --spn XXappId_DEVXX --secret-permissions get list set delete --key-permissions create decrypt delete encrypt get list unwrapKey wrapKey
az keyvault set-policy -n KV-Ash-Prod --spn XXappId_PRODXX --secret-permissions get list set delete --key-permissions create decrypt delete encrypt get list unwrapKey wrapKey
@ashisharora1909
ashisharora1909 / create_secret_spn_pwd.azcli
Created September 11, 2020 00:52
Create a secret to store Service Principal password generated in the previous step in Azure Key Vault for both Dev and Prod
az keyvault secret set --vault-name KV-Ash-Dev --name "SpnPassword" --value XXSPN_Password_DEVXX
az keyvault secret set --vault-name KV-Ash-Prod --name "SpnPassword" --value XXSPN_Password_PRODXX
@ashisharora1909
ashisharora1909 / create_service_principal.azcli
Created September 11, 2020 00:50
Create a service principal for Dev & Prod
az ad sp create-for-rbac --name spn-ash-dev
az ad sp create-for-rbac --name spn-ash-prod
@ashisharora1909
ashisharora1909 / create_secret_sql_connstring.azcli
Last active September 11, 2020 00:47
Create a secret to store Azure SQL Database Connection String in Key Vault. ConnectionString format : "Server=tcp:XXDatabaseServerNameXX.database.windows.net,1433;Initial Catalog=XXDatabaseNameXX;Persist Security Info=False;User ID=XXUserName_DEVXX;Password=XXPassword_DEVXX;Encrypt=True;TrustServerCertificate=False;Connection Timeout=30;"
az keyvault secret set --vault-name KV-Ash-Dev --name "AzureSQLConnString" --value XXAzureSQL_ConnectionString_DEVXX
az keyvault secret set --vault-name KV-Ash-Prod --name "AzureSQLConnString" --value XXAzureSQL_ConnectionString_PRODXX
@ashisharora1909
ashisharora1909 / create_secret_storage_account_connstring.azcli
Last active September 16, 2020 03:35
Create a secret to store Storage Account Access Key in Key Vault
az keyvault secret set --vault-name KV-Ash-Dev --name "StorageAccountConnString" --value XXStorageAccountConnectionString_DEVXX
az keyvault secret set --vault-name KV-Ash-Prod --name "StorageAccountConnString" --value XXStorageAccountConnectionString_PRODXX
@ashisharora1909
ashisharora1909 / create_key_vault.azcli
Created September 11, 2020 00:41
Create Azure Key Vault for both Dev & Prod. This will be used to store keys & secrets. Set location to AustraliaEast
az keyvault create --name KV-Ash-Dev --resource-group RG-Ash-Dev --location AustraliaEast
az keyvault create --name KV-Ash-Prod --resource-group RG-Ash-Prod --location AustraliaEast