環境列表
操作系統:centos 7 64位
Hawq版本:git clonehttps://git-wip-us.apache.org/repos/asf/incubator-hawq.git
虛擬機主機列表
主機名 |
Ip |
hawq1 |
192.168.204.201 |
hawq2 |
192.168.204.202 |
hawq3 |
192.168.204.203 |
參考資料:https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install
一hawq編譯安裝(root用戶操作hawq1, 192.168.204.201)
1操作系統環境準備
安裝centos7,設置主機名,關閉防火牆,關閉selinux
chkconfig iptables off
chkconfig ip6tables off
systemctl stop firewalld.service
sestatus //查詢
vi /etc/selinux/config //關閉selinux
2軟件環境準備
curl -L"https://bintray.com/wangzw/rpm/rpm" -o/etc/yum.repos.d/bintray-wangzw-rpm.repo
yum install -y epel-release
yum makecache
yum install -y man passwd sudo tar whichgit mlocate links make bzip2 net-tools \
autoconf automake libtool m4 gcc gcc-c++ gdb bison flex cmake gperfmaven indent \
libuuid-devel krb5-devel libgsasl-devel expat-devel libxml2-devel \
perl-ExtUtils-Embed pam-devel python-devel libcurl-devel snappy-devel \
thrift-devel libyaml-devel libevent-devel bzip2-devel openssl-devel \
openldap-devel protobuf-devel readline-devel net-snmp-devel apr-devel \
libesmtp-devel xerces-c-devel python-pip json-c-devel libhdfs3-devel \
apache-ivy java-1.7.0-openjdk-devel \
openssh-clients openssh-server
yum install -y postgresql-devel
pip --retries=50 --timeout=300 installpg8000 simplejson unittest2 pycrypto pygresql pyyaml lockfile paramiko psi
pip --retries=50 --timeout=300 installhttp://darcs.idyll.org/~t/projects/figleaf-0.6.1.tar.gz
pip --retries=50 --timeout=300 installhttp://sourceforge.net/projects/pychecker/files/pychecker/0.8.19/pychecker-0.8.19.tar.gz/download
yum erase -y postgresql postgresql-libspostgresql-devel
碰到問題:
Transaction check error:
file /usr/lib/systemd/system/blk-availability.service from install ofdevice-mapper-7:1.02.107-5.el7.x86_64 conflicts with file from packagelvm2-7:2.02.105-14.el7.x86_64
file /usr/sbin/blkdeactivate from install ofdevice-mapper-7:1.02.107-5.el7.x86_64 conflicts with file from packagelvm2-7:2.02.105-14.el7.x86_64
file /usr/share/man/man8/blkdeactivate.8.gz from install ofdevice-mapper-7:1.02.107-5.el7.x86_64 conflicts with file from packagelvm2-7:2.02.105-14.el7.x86_64
rpm -qa | grep lvm2
yum erase lvm2-2.02.105-14.el7.x86_64
3下載incubator-hawq
git clonehttps://git-wip-us.apache.org/repos/asf/incubator-hawq.git
4安裝libyarn
cd depends/libyarn/
mkdir build
cd build
../bootstrap --prefix=/usr/local/
make
sudo make install
把結果*.so文件複製至/usr/lib或者如下操作
ln -s /usr/local/libyarn.so /usr/lib
ln -s /usr/local/libyarn.so.1 /usr/lib
ln -s /usr/local/libyarn.so.0.1.10 /usr/lib
ldconfig
5配置及編譯hawq(注意保持網絡通暢)
./configure --prefix=/hawq
make
make install
二虛擬機制作
第一部分操作完成後,保存虛擬機hawq1,然後copy成2份,然後分別打開虛擬機根據虛擬機主機列表更改主機名,IP等操作,然後互ping IP,確認虛機機之間網絡通暢。
三hadoop 2.X系統安裝配置(可以利用gpssh設置互信等),然後啓動運行,
hadoop 2.X系統安裝配置參考:http://blog.csdn.net/sunziyue/article/details/50735192
之後再配置好hawq軟件中相關配置文件(hawq用戶操作)。
四初始化hawq實例(hawq用戶操作)
source /install/dir/greenplum_path.sh
hawq init cluster
hawq stop/restart/start cluster