Hawq安裝搭建

環境列表

操作系統:centos 7 64位

Hawq版本:git clonehttps://git-wip-us.apache.org/repos/asf/incubator-hawq.git

虛擬機主機列表

主機名

Ip

hawq1

192.168.204.201

hawq2

192.168.204.202

hawq3

192.168.204.203

參考資料:https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install

一hawq編譯安裝(root用戶操作hawq1, 192.168.204.201)

1操作系統環境準備

安裝centos7,設置主機名,關閉防火牆,關閉selinux

chkconfig iptables off

chkconfig ip6tables off

systemctl stop firewalld.service

sestatus  //查詢

vi  /etc/selinux/config  //關閉selinux

2軟件環境準備

curl -L"https://bintray.com/wangzw/rpm/rpm" -o/etc/yum.repos.d/bintray-wangzw-rpm.repo

yum install -y epel-release

yum makecache

yum install -y man passwd sudo tar whichgit mlocate links make bzip2 net-tools \

 autoconf automake libtool m4 gcc gcc-c++ gdb bison flex cmake gperfmaven indent \

 libuuid-devel krb5-devel libgsasl-devel expat-devel libxml2-devel \

 perl-ExtUtils-Embed pam-devel python-devel libcurl-devel snappy-devel \

 thrift-devel libyaml-devel libevent-devel bzip2-devel openssl-devel \

 openldap-devel protobuf-devel readline-devel net-snmp-devel apr-devel \

 libesmtp-devel xerces-c-devel python-pip json-c-devel libhdfs3-devel \

 apache-ivy java-1.7.0-openjdk-devel \

 openssh-clients openssh-server

yum install -y postgresql-devel

pip --retries=50 --timeout=300 installpg8000 simplejson unittest2 pycrypto pygresql pyyaml lockfile paramiko psi

pip --retries=50 --timeout=300 installhttp://darcs.idyll.org/~t/projects/figleaf-0.6.1.tar.gz

pip --retries=50 --timeout=300 installhttp://sourceforge.net/projects/pychecker/files/pychecker/0.8.19/pychecker-0.8.19.tar.gz/download

yum erase -y postgresql postgresql-libspostgresql-devel

 

碰到問題:

Transaction check error:

 file /usr/lib/systemd/system/blk-availability.service from install ofdevice-mapper-7:1.02.107-5.el7.x86_64 conflicts with file from packagelvm2-7:2.02.105-14.el7.x86_64

 file /usr/sbin/blkdeactivate from install ofdevice-mapper-7:1.02.107-5.el7.x86_64 conflicts with file from packagelvm2-7:2.02.105-14.el7.x86_64

 file /usr/share/man/man8/blkdeactivate.8.gz from install ofdevice-mapper-7:1.02.107-5.el7.x86_64 conflicts with file from packagelvm2-7:2.02.105-14.el7.x86_64

rpm -qa | grep lvm2

yum erase lvm2-2.02.105-14.el7.x86_64


3下載incubator-hawq

git clonehttps://git-wip-us.apache.org/repos/asf/incubator-hawq.git

4安裝libyarn

cd depends/libyarn/

mkdir build

cd build

../bootstrap --prefix=/usr/local/

make

sudo make install

把結果*.so文件複製至/usr/lib或者如下操作

ln -s /usr/local/libyarn.so  /usr/lib

ln -s /usr/local/libyarn.so.1  /usr/lib

ln -s /usr/local/libyarn.so.0.1.10  /usr/lib

ldconfig

5配置及編譯hawq(注意保持網絡通暢)

./configure --prefix=/hawq

make

make install

二虛擬機制作

第一部分操作完成後,保存虛擬機hawq1,然後copy成2份,然後分別打開虛擬機根據虛擬機主機列表更改主機名,IP等操作,然後互ping IP,確認虛機機之間網絡通暢。

三hadoop 2.X系統安裝配置(可以利用gpssh設置互信等),然後啓動運行,

hadoop 2.X系統安裝配置參考:http://blog.csdn.net/sunziyue/article/details/50735192

之後再配置好hawq軟件中相關配置文件(hawq用戶操作)。

四初始化hawq實例(hawq用戶操作)

source /install/dir/greenplum_path.sh

hawq init cluster

hawq stop/restart/start cluster

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章