Skip to content

Instantly share code, notes, and snippets.

@ScottEvil
Created July 20, 2015 12:46
Show Gist options
  • Star 4 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save ScottEvil/668fd0ea4f244458e078 to your computer and use it in GitHub Desktop.
Save ScottEvil/668fd0ea4f244458e078 to your computer and use it in GitHub Desktop.
Notes from installing GeoMesa on GeoServer and Hortonworks Sandbox
Installing GeoMesa on GeoServer
- Downloaded geoserver 2.5.2 war wget http://downloads.sourceforge.net/project/geoserver/GeoServer/2.5.2/geoserver-2.5.2-war.zip
- and the corresponding WPS plugin wget http://downloads.sourceforge.net/project/geoserver/GeoServer/2.5.2/extensions/geoserver-2.5.2-wps-plugin.zip
- Deployed war file to Tomcat_HOME/webapps folder and then copied WPS plugin jars over to WEB-INF/lib and checked to ensure permissions were good
- Download Accumulo 1.5.3 :: wget http://apache.go-parts.com/accumulo/1.5.3/accumulo-1.5.3-bin.tar.gz
- Download Scala 2.10 :: wget http://downloads.typesafe.com/scala/2.10.5/scala-2.10.5.tgz
- Download Kafka 2.10-0.8.2.1 (Kafka 0.8 install that corresponds to scala 2.10) http://ftp.wayne.edu/apache/kafka/0.8.2.1/kafka_2.10-0.8.2.1.tgz
- Download Hadoop wget http://apache.mirrors.tds.net/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz
Unzip each of the downloads
Install scala (Reference http://decisionstats.com/2014/04/15/installing-scala-on-centos/)
mv scala-2.10.5 /usr/lib
ln -s /usr/lib/scala-2.10.5 /usr/lib/scala
export PATH=$PATH:/usr/lib/scala/bin
scala -version
Copy the necessary Accumulo jars to GeoServer
cp ~/Downloads/accumulo/accumulo-1.5.3/lib/accumulo-core.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp ~/Downloads/accumulo/accumulo-1.5.3/lib/accumulo-fate.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp ~/Downloads/accumulo/accumulo-1.5.3/lib/accumulo-trace.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
Copy the necessary Hadoop jars to GeoServer
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/common/hadoop-common-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/common/lib/hadoop-auth-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0 /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp ~/Downloads/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cd var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
wget https://search.maven.org/remotecontent?filepath=org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar
wget https://search.maven.org/remotecontent?filepath=org/apache/thrift/libthrift/0.9.1/libthrift-0.9.1.jar
wget https://search.maven.org/remotecontent?filepath=commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar
wget https://search.maven.org/remotecontent?filepath=commons-lang/commons-lang/2.4/commons-lang-2.4.jar
make sure names and permissions are set properly on the jars
clone the geomesa github repository
mvn clean install -DskipTests
cp ~//Downloads/geomesa/geomesa/geomesa-plugin/target/geomesa-plugin-1.1.0-rc.3-SNAPSHOT-geoserver-plugin.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
restart GeoServer and make sure the accumulo data store is an option under stores
Run the steps in the GeoMesa Accumulo quickstart to verify everything works
Set up geomesa kafka plugin
cp ~/Downloads/geomesa/geomesa/geomesa-plugin/target/geomesa-plugin-1.1.0-rc.3-SNAPSHOT-geoserver-plugin.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
tar xvf kafka_2.10-0.8.2.1.tgz && cd kafka_2.10-0.8.2.1
cp kafka-clients-0.8.2.1.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp kafka_2.10-0.8.2.1.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp metrics-core-2.2.0.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
cp zkclient-0.3.jar /var/local/apache-tomcat-7.0.62/webapps/geoserver/WEB-INF/lib/
export CATALINA_OPTS="-Xms512M -Xmx1024M -XX:PermSize=256m -XX:MaxPermSize=256m"
restart GeoServer and make sure the kafka data store is an option under stores
On the Kafka machine run this command from the folder where the geomesa jars were built:
java -cp ./geomesa-examples/geomesa-kafka-quickstart/target/geomesa-kafka-quickstart-1.1.0-rc.3-SNAPSHOT.jar org.locationtech.geomesa.examples.KafkaQuickStart -brokers "192.168.99.75:6667" -zookeepers "192.168.99.75:2181"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment