環境說明
操作系統:Ubuntu 14.04
集羣節點:
- Master
- slave1
- slave2
解壓並安裝
hadoop@Master:~$ sudo tar xvfz sqoop-1.99.6-bin-hadoop200.tar.gz
hadoop@Master:~$ sudo mv sqoop-1.99.6-bin-hadoop200 /usr/local/sqoop
hadoop@Master:~$ sudo chmod -R 775 /usr/local/sqoop
hadoop@Master:~$ sudo chown -R hadoop:hadoop /usr/local/sqoop
修改環境變量
hadoop@Master:~$ sudo nano /etc/profile
#sqoop
export SQOOP_HOME=/usr/local/sqoop
export PATH=$SQOOP_HOME/bin:$PATH
export CATALINA_BASE=$SQOOP_HOME/server
export LOGDIR=$SQOOP_HOME/logs
hadoop@Master:~$ source /etc/profile
修改sqoop的環境變量
hadoop@Master:/$ sudo nano /usr/local/sqoop/server/conf/sqoop.properties
#修改指向我的hadoop安裝目錄
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/usr/local/hadoop/etc/hadoop
hadoop@Master:/$ sudo nano /usr/local/sqoop/server/conf/catalina.properties
common.loader=/usr/local/hadoop/share/hadoop/common/*.jar,/usr/local/hadoop/share/hadoop/common/lib/*.jar,/usr/local/hadoop/share/hadoop/hdfs/*.jar,/usr/local/hadoop/share/hadoop/hdfs/lib/*.jar,/usr/local/hadoop/share/hadoop/mapreduce/*.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/*.jar,/usr/local/hadoop/share/hadoop/tools/*.jar,/usr/local/hadoop/share/hadoop/tools/lib/*.jar,/usr/local/hadoop/share/hadoop/yarn/*.jar,/usr/local/hadoop/share/hadoop/yarn/lib/*.jar,/usr/local/hadoop/share/hadoop/httpfs/tomcat/lib/*.jar,
下載mysql驅動包,mysql-connector-java-5.1.27.jar
把jar包丟到到$SQOOP_HOME/server/lib下面
$ sudo cp mysql-connector-java-5.1.27.jar $SQOOP_HOME/server/lib
有時,啓動sqoop時可能會遇到找不到JAVA_HOME的情況,爲了保險起見我們直接在配置文件中寫入JAVA_HOME
#在/usr/local/sqoop/server/bin/setenv.sh中,添加
export JAVA_HOME=/usr/lib/jvm/
啓動sqoop
hadoop@Master:~/mysql-connector-java-5.0.8$ sqoop.sh server start
Sqoop home directory: /usr/local/sqoop
Setting SQOOP_HTTP_PORT: 12000
Setting SQOOP_ADMIN_PORT: 12001
Using CATALINA_OPTS:
Adding to CATALINA_OPTS: -Dsqoop.http.port=12000 -Dsqoop.admin.port=12001
Using CATALINA_BASE: /usr/local/sqoop/server
Using CATALINA_HOME: /usr/local/sqoop/server
Using CATALINA_TMPDIR: /usr/local/sqoop/server/temp
Using JRE_HOME: /usr/lib/jvm//jre
Using CLASSPATH: /usr/local/sqoop/server/bin/bootstrap.jar
驗證啓動成功
如果服務端已經啓動,則有Bootstrap這個進程:
hadoop@Master:~$ jps
...
13771 Bootstrap
...