hive lzo的安裝

第一步

1、在hadoop集羣每個節點上安裝lzo和lzop及其依賴(主要爲解決安裝lzop)：
yum -y install *lzo*
2. 安裝準備：
[root@hadoop01 home]# yum -y install gcc-c++ lzo-devel zlib-devel autoconf automake libtool
3.下載
[root@hadoop01 home]# wget http://www.oberhumer.com/opensource/lzo/download/lzo-2.10.tar.gz
4.解壓編譯
[root@hadoop01 home]# tar -zxvf /home/lzo-2.10.tar.gz
[root@hadoop01 home]# cd /home/lzo-2.10/
[root@hadoop01 lzo-2.10]# ./configure -prefix=/usr/local/lzo/ 
[root@hadoop01 lzo-2.10]# make 
[root@hadoop01 lzo-2.10]# make install

第二步:

[root@hadoop01 home]# wget https://github.com/twitter/hadoop-lzo/archive/master.zip
[root@hadoop01 home]# unzip /home/hadoop-lzo-master.zip
[root@hadoop01 home]# cd /home/hadoop-lzo-master
搜索內容hadoop.current並修改版本號：
<hadoop.current.version>2.7.7(你自己的hadoop版本號)</hadoop.current.version>

第三步

使用maven編譯(需要maven已經安裝) 
[root@hadoop01 hadoop-lzo-master]# export C_INCLUDE_PATH=/usr/local/lzo/include 
[root@hadoop01 hadoop-lzo-master]# export LIBRARY_PATH=/usr/local/lzo/lib
編譯 
[root@hadoop01 hadoop-lzo-master]# mvn package -Dmaven.test.skip=true
我這一步進行了半個小時
進入target，將hadoop-lzo-0.4.21-SNAPSHOT.jar放到hadoop的classpath下。如 ${HADOOP_HOME}/share/hadoop/common
[root@hadoop01 hadoop-lzo-master]# cp ./target/hadoop-lzo-0.4.21-SNAPSHOT.jar  ${HADOOP_HOME}/share/hadoop/common/
分發到其它服務器： 
[root@hadoop01 hadoop-lzo-master]# scp ./target/hadoop-lzo-0.4.21-SNAPSHOT.jar hadoop02: ${HADOOP_HOME}/share/hadoop/common/
[root@hadoop01 hadoop-lzo-master]# scp ./target/hadoop-lzo-0.4.21-SNAPSHOT.jar hadoop03: ${HADOOP_HOME}/share/hadoop/common/

第四步
把以下內容添加到core-stie.xml

<property> 
<name>io.compression.codecs</name>
<value>org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.BZip2Codec,com.hadoop.compression.lzo.LzoCodec,com.hadoop.compression.lzo.LzopCodec</value>
 </property>
  <property>
   <name>io.compression.codec.lzo.class</name> 
   <value>com.hadoop.compression.lzo.LzoCodec</value> 
</property>

把core-stie.xml分發到每臺服務器

重啓集羣和hive