Skip to content

Instantly share code, notes, and snippets.

@live-wire
Created May 3, 2023 08:42
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save live-wire/e4ecf3d0eb5ed00c769676eff11b5b8c to your computer and use it in GitHub Desktop.
Save live-wire/e4ecf3d0eb5ed00c769676eff11b5b8c to your computer and use it in GitHub Desktop.
History server fork demo

Flink History Server (fork)


Current


  • The History server just needs the job-archive (GCS Bucket) location to start.
flowchart TD
    subgraph HistoryServer
    A[HistoryServer start] --> B[Start background thread]
    B --> C[(GCS job archives)]
    C --> |Prepare local static files from archives| B
    B --> |refresh| B
    A --> D[Serve static files on port 8082]
    end
    subgraph User
    E[Browser] --> |static content| D
    end

Fork


flowchart TD
    subgraph HistoryServer
    A[HistoryServer start] --> B[ /fetch/:jobid endpoint on port 8082]
    B --> C[(GCS job archives)]
    C --> |Prepare local static files for jobid archive| B
    A --> D[Serve static files on port 8082]
    end
    subgraph User
    E[Browser] --> |fetch jobid + get static content| F[foreground]
    F <--> B
    F <--> D
    F --> |static content| E
    end
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment