Azure Data Engineering Resources.md

Azure Data Engineering Resources

---

Basics

https://docs.microsoft.com/en-us/learn/paths/azure-for-the-data-engineer/

https://docs.microsoft.com/en-us/azure/cloud-adoption-framework/

Azure Data Factory

---

https://docs.microsoft.com/en-us/learn/modules/intro-to-azure-data-factory/

https://docs.microsoft.com/en-us/learn/paths/data-integration-scale-azure-data-factory/

ADF Naming standards (Terry M) https://adatis.co.uk/azure-data-factory-suggested-naming-conventions-and-best-practices/

ADF Pricing Video (Cathrine W) https://www.youtube.com/watch?v=c958SwJ8lpg

ADF Videos https://www.youtube.com/channel/UC2S0k7NeLcEm5_IhHUwpN0g/videos

Beginner's Guide to Azure Data Factory (Series) | Cathrine Wilhelmsen https://www.cathrinewilhelmsen.net/series/beginners-guide-azure-data-factory/

https://www.dcac.com/dcac/azure-data-factory-activity-failures-and-pipeline-outcomes

https://www.dcac.com/dcac/looking-at-activity-queue-times-from-azure-data-factory-with-log-analytics/

https://www.dcac.com/dcac/control-flow-limitations-in-data-factory/

https://www.dcac.com/microsoft/azure/parameterizing-a-rest-api-linked-service-in-data-factory/

Data Lake

---

https://docs.microsoft.com/en-us/learn/paths/data-processing-with-azure-adls/

https://docs.microsoft.com/en-us/azure/architecture/data-guide/scenarios/data-lake

https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-best-practices

https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-performance-tuning-guidance

https://github.com/Azure/AzureDataLake

https://github.com/rukmani-msft/adlsguidancedoc/blob/master/Hitchhikers_Guide_to_the_Datalake.md

Dimensional Modeling

Synapse Analytics

https://docs.microsoft.com/en-us/learn/paths/realize-integrated-analytical-solutions-with-azure-synapse-analytics/

https://docs.microsoft.com/en-us/learn/paths/build-data-analytics-solutions-using-azure-synapse-serverless-sql-pools/

https://docs.microsoft.com/en-us/learn/paths/perform-data-engineering-with-azure-synapse-apache-spark-pools/

https://docs.microsoft.com/en-us/azure/synapse-analytics/sql/develop-dynamic-sql

Databricks

https://docs.microsoft.com/en-us/learn/paths/data-engineer-azure-databricks/?ns-enrollment-type=Collection&ns-enrollment-id=e248honn8pqj2r

Spark

Delta Lake

T-SQL

https://docs.microsoft.com/en-us/learn/paths/get-started-querying-with-transact-sql/

https://docs.microsoft.com/en-us/learn/paths/write-advanced-transact-sql-queries/

https://docs.microsoft.com/en-us/learn/paths/optimize-query-performance-sql-server/

https://docs.microsoft.com/en-us/sql/relational-databases/json/json-data-sql-server?view=sql-server-ver15

https://docs.microsoft.com/en-us/sql/relational-databases/track-changes/about-change-data-capture-sql-server?view=sql-server-ver15

https://www.red-gate.com/website/sql-formatter

https://docs.microsoft.com/en-us/visualstudio/data-tools/creating-and-managing-databases-and-data-tier-applications-in-visual-studio?view=vs-2022

Tabular Modeling / DAX (PBI| Analysis Services)

https://powerbi.microsoft.com/en-us/blog/best-practice-rules-to-improve-your-models-performance/

https://docs.microsoft.com/en-us/analysis-services/tutorial-tabular-1400/as-adventure-works-tutorial?view=asallproducts-allversions

Misc