Tasks arrive and queue while waiting for the queueing stage. One at a time they are run through the queueing stage and put into file queues. Eventually the file queues fill up and backpressure is applied.
Last active
July 31, 2023 13:22
-
-
Save westonpace/3205cb06632feb67c916749da48655b6 to your computer and use it in GitHub Desktop.
Arrow dataset writer backpressure diagram
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment