Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save gigsforlinux/86bb4c8cff25aee6c983d8e78ed3db2a to your computer and use it in GitHub Desktop.
Save gigsforlinux/86bb4c8cff25aee6c983d8e78ed3db2a to your computer and use it in GitHub Desktop.
I'll Do Anything Goes With Hadoop For You
sudo apt update
sudo apt install default-jdk
java -version
wget https://dlcdn.apache.org/hadoop/common/hadoop-3.3.1/hadoop-3.3.1.tar.gz
wget https://downloads.apache.org/hadoop/common/hadoop-3.3.1/hadoop-3.3.1.tar.gz.sha512
shasum -a 512 hadoop-3.3.1.tar.gz
cat hadoop-3.3.1.tar.gz.sha512
tar -xzvf hadoop-3.3.1.tar.gz
sudo mv hadoop-3.3.1 /usr/local/hadoop
readlink -f /usr/bin/java | sed "s:bin/java::"
###Running Hadoop
/usr/local/hadoop/bin/hadoop
Output
Usage: hadoop [OPTIONS] SUBCOMMAND [SUBCOMMAND OPTIONS]
or hadoop [OPTIONS] CLASSNAME [CLASSNAME OPTIONS]
where CLASSNAME is a user-provided Java class
OPTIONS is none or any of:
--config dir Hadoop config directory
--debug turn on shell script debug mode
--help usage information
buildpaths attempt to add class files from build tree
hostnames list[,of,host,names] hosts to use in slave mode
hosts filename list of hosts to use in slave mode
loglevel level set the log4j level for this command
workers turn on worker mode
SUBCOMMAND is one of:
. . .
@gigsforlinux
Copy link
Author

Screenshot from 2022-06-29 00-44-36

@gigsforlinux
Copy link
Author

Screenshot from 2022-06-29 00-37-36

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment