Skip to content

Instantly share code, notes, and snippets.

@nathan815
Last active November 6, 2023 23:50
Show Gist options
  • Save nathan815/a938b3f7a4d06b2811cf2b1a917800e1 to your computer and use it in GitHub Desktop.
Save nathan815/a938b3f7a4d06b2811cf2b1a917800e1 to your computer and use it in GitHub Desktop.
Updated docker-compose.yml for big-data-europe/docker-hadoop
version: "2.1"
services:
namenode:
build: ./namenode
container_name: namenode
volumes:
- hadoop_namenode:/hadoop/dfs/name
environment:
- CLUSTER_NAME=test
env_file:
- ./hadoop.env
ports:
- "9870:9870"
resourcemanager:
build: ./resourcemanager
container_name: resourcemanager
restart: on-failure
depends_on:
- namenode
- datanode1
- datanode2
- datanode3
env_file:
- ./hadoop.env
ports:
- "8089:8088"
historyserver:
build: ./historyserver
container_name: historyserver
depends_on:
- namenode
- datanode1
- datanode2
volumes:
- hadoop_historyserver:/hadoop/yarn/timeline
env_file:
- ./hadoop.env
ports:
- "8188:8188"
nodemanager1:
build: ./nodemanager
container_name: nodemanager1
depends_on:
- namenode
- datanode1
- datanode2
env_file:
- ./hadoop.env
ports:
- "8042:8042"
datanode1:
build: ./datanode
container_name: datanode1
depends_on:
- namenode
volumes:
- hadoop_datanode1:/hadoop/dfs/data
env_file:
- ./hadoop.env
datanode2:
build: ./datanode
container_name: datanode2
depends_on:
- namenode
volumes:
- hadoop_datanode2:/hadoop/dfs/data
env_file:
- ./hadoop.env
datanode3:
build: ./datanode
container_name: datanode3
depends_on:
- namenode
volumes:
- hadoop_datanode3:/hadoop/dfs/data
env_file:
- ./hadoop.env
volumes:
hadoop_namenode:
hadoop_datanode1:
hadoop_datanode2:
hadoop_datanode3:
hadoop_historyserver:
@sasdahab
Copy link

apologize @Fyroze, it doesn't work with three datanodes. And i have the same logs errors. But with one datanode, it is well working.
Do you have any idea of the cause of the problem ?

Best regards

@Fyroze
Copy link

Fyroze commented Nov 25, 2020 via email

@sasdahab
Copy link

Ok, thank you !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment