Skip to content

Instantly share code, notes, and snippets.

@greenqy
Created September 22, 2015 07:21
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save greenqy/8b07ea8fbb2892b8818a to your computer and use it in GitHub Desktop.
Save greenqy/8b07ea8fbb2892b8818a to your computer and use it in GitHub Desktop.
install-sqoop.md

sqoop 安装

下载地址

解压Sqoop:

$ tar -zvxf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz
$ mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha /hadoop/sqoop

配置环境变量:

$ vim ~/.bashrc

export SQOOP_HOME=/hadoop/sqoop
export PATH=$SQOOP_HOME/bin:$PATH

修改配置文件:

vim /hadoop/sqoop/conf/sqoop-env.sh
#加上以下部分(设置为自己配置的hadoop,hive,hbase的路径)
#Set path to where bin/hadoop is available
export HADOOP_COMMON_HOME=/hadoop/hadoop

#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/hadoop/hadoop

#set the path to where bin/hbase is available
#export HBASE_HOME=/hadoop/hbase

#Set the path to where bin/hive is available
export HIVE_HOME=/hadoop/hive

添加数据库连接文件:

选择下载自己需要的JDBC连接文件,如oracle的ojdbc7.jar,和mysql的mysql-connector-java-5.0.8-bin.jar,并拷贝到sqoop的lib目录下。

安装完成

试用

查看 mysql 有哪些数据库:

sqoop list-databases --connect jdbc:mysql://localhost --username root --password mysqlpw

查看 hive 数据库中的表:

sqoop list-tables --connect jdbc:mysql://localhost/hive --username hive --password hive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment