Skip to content

Instantly share code, notes, and snippets.

1. Product (#)

1.1.Guides

Chapter (###)

Section (####)

Article (#####)

Spark Core

Spark Jobs

So, what Spark does is that as soon as action operations like collect(), count(), etc., is triggered, the driver program, which is responsible for launching the spark application as well as considered the entry point of any spark application, converts this spark application into a single job which can be seen in the figure below

1.REST

1.1.Guides

1.2.Resources

POST is NOT idempotent. So if you retry the request N times, you will end up having N resources with N different URIs created on server.