Skip to content

Instantly share code, notes, and snippets.

@liu-peiwen
liu-peiwen / Spark high availability.md
Created December 16, 2018 00:21 — forked from aseigneurin/Spark high availability.md
Spark - High availability

Spark - High availability

Components in play

As a reminder, here are the components in play to run an application:

  • The cluster:
    • Spark Master: coordinates the resources
    • Spark Workers: offer resources to run the applications
  • The application: