Skip to content

Instantly share code, notes, and snippets.

@jackawatts

jackawatts/Data Storage Decisions.md

Created December 9, 2022 05:10
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jackawatts/bf6621cb04d60d794d32491077ae5838 to your computer and use it in GitHub Desktop.
Save jackawatts/bf6621cb04d60d794d32491077ae5838 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Data Storage Decisions.md

Azure

Structured Data

  1. Do you have any tables with more than 1 billion rows?
    • Synapse Dedicated pools distribute each row into 1 of 60 distributions, small tables will see little performance increase
  2. Is your database larger than 1 TB?
    • Synapse performance gains typically start to be seen between 1-5TB
  3. Are you issuing more than 128 queries simultaneously?
    • Synapse starts queueing queries after 128 simultaenous queries, SQL Analytics may be a better solution
  4. Are data requirements ad-hoc or continuous?
    • Serverless Pools are better served for adhoc workloads: exploratory or ML workloads
    • Dedicated Pools are better served for continuous workloads and need to be explicitly stopped when not in use.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment