Skip to content

Instantly share code, notes, and snippets.

@hochun836
Last active May 31, 2021 04:32
Show Gist options
  • Save hochun836/0949990110b12e80df3dfd208f9df2e6 to your computer and use it in GitHub Desktop.
Save hochun836/0949990110b12e80df3dfd208f9df2e6 to your computer and use it in GitHub Desktop.
=====================================
pseudo distribution
=====================================
# hadoop-env.sh
export JAVA_HOME=/home/hadoop/app/java
# core-site.xml
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://centos01:9000/</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/app/hadoop/data</value>
</property>
</configuration>
# hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
# mapred-site.xml
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>
# yarn-site.xml
<configuration>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>centos01</value>
</property>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
</configuration>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment