Skip to content

Instantly share code, notes, and snippets.

@rmetzger
Created April 15, 2021 18:39
Show Gist options
  • Save rmetzger/0cf4ba081d685d26478525bf69c7bd39 to your computer and use it in GitHub Desktop.
Save rmetzger/0cf4ba081d685d26478525bf69c7bd39 to your computer and use it in GitHub Desktop.
Flink with Hadoop (untested)
services:
flink-jobmanager:
container_name: flink-jobmanager
build:
context: .
dockerfile: Dockerfile.flink
args:
FLINK_VERSION: 1.11.3-scala_2.12-java11
image: 'flink-test:1.11.3-scala_2.12-java11'
ports:
- "8091:8081"
- "8092:8082"
command: jobmanager
environment:
- |
FLINK_PROPERTIES=
jobmanager.rpc.address: flink-jobmanager
rest.port: 8081
historyserver.web.port: 8082
web.upload.dir: /opt/flink
env.hadoop.conf.dir: /opt/hadoop/conf
env.yarn.conf.dir: /opt/hadoop/conf
- |
HADOOP_CLASSPATH=...
- HADOOP_CONF_DIR=/opt/hadoop/conf
- YARN_CONF_DIR=/opt/hadoop/conf
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment