Skip to content

Instantly share code, notes, and snippets.

@ruo91
Created January 31, 2014 02:48
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ruo91/8725814 to your computer and use it in GitHub Desktop.
Save ruo91/8725814 to your computer and use it in GitHub Desktop.
Hadoop HDFS over HTTP (HttpFS) Part4
- Start Hadoop (pseudo distributed mode)
hadoop@ruo91:~$ start-all.sh
- Start HttpFS
hadoop@ruo91:~$ httpfs.sh start
Setting HTTPFS_HOME: /home/hadoop/2.2.0
Setting HTTPFS_CONFIG: /home/hadoop/2.2.0/etc/hadoop
Sourcing: /home/hadoop/2.2.0/etc/hadoop/httpfs-env.sh
setting HTTPFS_HTTP_HOSTNAME=your-cluster-hostname
Setting HTTPFS_LOG: /home/hadoop/2.2.0/logs
Setting HTTPFS_TEMP: /home/hadoop/2.2.0/temp
Setting HTTPFS_HTTP_PORT: 14000
Setting HTTPFS_ADMIN_PORT: 14001
Using HTTPFS_HTTP_HOSTNAME: your-cluster-hostname
Setting CATALINA_BASE: /home/hadoop/2.2.0/share/hadoop/httpfs/tomcat
Setting HTTPFS_CATALINA_HOME: /home/hadoop/2.2.0/share/hadoop/httpfs/tomcat
Setting CATALINA_OUT: /home/hadoop/2.2.0/logs/httpfs-catalina.out
Setting CATALINA_PID: /tmp/httpfs.pid
Using CATALINA_OPTS:
Adding to CATALINA_OPTS: -Dhttpfs.home.dir=/home/hadoop/2.2.0 -Dhttpfs.config.dir=/home/hadoop/2.2.0/etc/hadoop -Dhttpfs.log.dir=/home/hadoop/2.2.0/logs -Dhttpfs.temp.dir=/home/hadoop/2.2.0/temp -Dhttpfs.admin.port=14001 -Dhttpfs.http.port=14000 -Dhttpfs.http.hostname=your-cluster-hostname
Using CATALINA_BASE: /home/hadoop/2.2.0/share/hadoop/httpfs/tomcat
Using CATALINA_HOME: /home/hadoop/2.2.0/share/hadoop/httpfs/tomcat
Using CATALINA_TMPDIR: /home/hadoop/2.2.0/share/hadoop/httpfs/tomcat/temp
Using JRE_HOME: /home/hadoop/jdk
Using CLASSPATH: /home/hadoop/2.2.0/share/hadoop/httpfs/tomcat/bin/bootstrap.jar
Using CATALINA_PID: /tmp/httpfs.pid
- Test HttpFS is working
hadoop@ruo91:~$ curl -i "http://your-cluster:14000/webhdfs/v1?op=gethomedirectory&user.name=hadoop"
HTTP/1.1 200 OK
Server: Apache-Coyote/1.1
Set-Cookie: hadoop.auth="u=hadoop&p=hadoop&t=simple&e=1391172244468&s=9+3kbPD5KPnYKSezu+YoEmsSTJg="; Version=1; Path=/
Content-Type: application/json
Transfer-Encoding: chunked
Date: Fri, 31 Jan 2014 02:44:04 GMT
{"Path":"\/user\/hadoop"}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment