ambari 2.6.1.5安裝

系統要求：
CentOS 7
Python 2.7.x
JDK1.8+
安裝環境準備
HDP版本兼容性

https://supportmatrix.hortonworks.com/

運維知識庫 > ambari安裝 > image2018-9-29_11-7-33.png

由於嚴格依賴版本，所以要先確定安裝的版本。

系統初始化
修改主機名
sudo hostnamectl set-hostname test-bg-xx
sudo hostname test-bg-xx

修改時區和字符集
#修改時區：
cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
同步集羣時間
yum install –y ntp
ntpdate -u cn.pool.ntp.org
或：
ntpdate time1.aliyun.com
硬件時間和系統時間同步:
clock -w
配置自動同步:/etc/crontab寫入
/1 * root ntpdate -u cn.pool.ntp.org >> /dev/null 2>&1

關閉防火牆和selinux
#關閉防火牆
systemctl stop firewalld
systemctl disable firewalld

#關閉selinux
修改配置
sed -i 's#SELINUX=enforcing#SELINUX=disabled#g' /etc/sysconfig/selinux
臨時關閉
setenforce 0

配置免密鑰登錄
爲了讓Ambari服務器在所有集羣主機上自動安裝Ambari代理，您必須在Ambari服務器主機和集羣中的所有其他主機之間設置無密碼SSH連接。Ambari服務器主機使用SSH公鑰認證來遠程訪問和安裝Ambari代理
ssh-keygen -t rsa
ssh-copy-id -i ~/.ssh/id_rsa.pub root@node1
ssh-copy-id -i ~/.ssh/id_rsa.pub root@node2
ssh-copy-id -i ~/.ssh/id_rsa.pub root@node3
注意：您可以選擇在每個集羣主機上手動安裝Ambari代理。在這種情況下，您不需要生成和分發SSH密鑰
可以使用非root SSH帳戶，如果該帳戶可以執行sudo而不輸入密碼

#
#如果ssh端口不是默認，可以在.ssh下創建config文件如下
[jt_ops@test-bg-m01 .ssh]$ cat config
Host test-bg-m01
HostName test-bg-m01
User jt_ops
Port 1876

Host test-bg-w01
HostName test-bg-w01
User jt_ops
Port 1876

系統初始化參數
cat >> /etc/sysctl.conf << EOF
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.tcp_fin_timeout = 30
vm.max_map_count = 262144
net.ipv4.ip_forward = 0
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.default.accept_source_route = 0
kernel.sysrq = 0
vm.swappiness = 0
kernel.core_uses_pid = 1
net.ipv4.tcp_syncookies = 1
kernel.msgmnb = 65536
kernel.msgmax = 65536
kernel.shmmax = 68719476736
kernel.shmall = 4294967296
net.core.somaxconn = 16384
EOF

文件描述符和用戶最大進程數
#調整文件描述符
cat >> /etc/security/limits.conf <<EOF

• soft nproc 65535
• hard nproc 65535
• soft nofile 65535
• hard nofile 65535
  EOF
  ##用戶進程限制
  cat >> /etc/security/limits.d/20-nproc.conf <<EOF
• soft nproc 8192
  root soft nproc unlimited
  EOF

安裝
安裝有兩種方法：在線安裝和搭建本地yum源倉庫安裝

在線安裝
下載yum源配置文件repo

#如果做了免祕鑰登陸，則只需要在主節點下載yum源
sudo wget -nv http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.1.5/ambari.repo -O /etc/yum.repos.d/ambari.repo

sudo wget –nv http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.4.0/hdp.repo -O /etc/yum.repos.d/hdp.rep

sudo wget -nv http://public-repo-1.hortonworks.com/HDP-GPL/centos7/2.x/updates/2.6.4.0/hdp.gpl.repo -O /etc/yum.repos.d/hdp.gpl.repo

離線安裝
 製作本地源
製作本地鏡像源安裝HDP，可以在主節點或者單獨的一臺服務器（建議）
選擇一臺可以訪問internet的服務器配置本地源
apache httpd
提供離線倉庫的下載服務
#安裝apache
yum install httpd –y
#開啓防火牆
firewall-cmd --add-service=http
firewall-cmd --permanent --add-service=http
#添加系統服務
systemctl start httpd.service
systemctl enable httpd.service
#安裝本地源製作工具
yum install yum-utils createrepo

下載軟件源

在httpd網站根目錄,默認是即/var/×××w/html/，創建目錄ambari， 
並且將下載的壓縮包解壓到/var/×××w/html/ambari目錄

cd /var/×××w/html/
mkdir ambari
cd /var/×××w/html/ambari/
http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.1.5/ambari-2.6.1.5-centos7.tar.gz
http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.4.0/HDP-2.6.4.0-centos6-rpm.tar.gz
http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos6/HDP-UTILS-1.1.0.22-centos6.tar.gz

http://public-repo-1.hortonworks.com/HDP-GPL/centos6/2.x/updates/2.6.4.0/HDP-GPL-2.6.4.0-centos6-rpm.tar.gz

解壓下載的tar包

下載repo並修改
下載yum源並修改

源文件內容：

[root@test-bg-w05 yum.repos.d]# cat ambari.repo 
#VERSION_NUMBER=2.6.1.5-3
[ambari-2.6.1.5]
name=ambari Version - ambari-2.6.1.5
baseurl=http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.1.5
gpgcheck=1
gpgkey=http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.1.5/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

修改爲：

[root@dev-bg-w01 yum.repos.d]# cat ambari.repo 
#VERSION_NUMBER=2.6.1.5-3
[ambari-2.6.1.5]
name=ambari Version - ambari-2.6.1.5
baseurl=http://192.168.103.194:8080/ambari/centos7/2.6.1.5-3
gpgcheck=1
gpgkey=http://192.168.103.194:8080/ambari/centos7/2.6.1.5-3/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1[root@dev-bg-w01 yum.repos.d]#

源文件內容：

[root@test-bg-w05 yum.repos.d]# cat ambari-hdp-1.repo 
[HDP-2.6-repo-1]
name=HDP-2.6-repo-1
baseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.4.0

path=/
enabled=1
gpgcheck=0
[HDP-UTILS-1.1.0.22-repo-1]
name=HDP-UTILS-1.1.0.22-repo-1
baseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7

path=/
enabled=1
gpgcheck=0[root@test-bg-w05 yum.repos.d]#

修改爲：

[root@dev-bg-w01 yum.repos.d]# cat ambari-hdp-1.repo 
[HDP-2.6-repo-1]
name=HDP-2.6-repo-1
baseurl=http://192.168.103.194:8080/HDP/centos7/2.6.4.0-91

path=/
enabled=1
gpgcheck=0
[HDP-2.6-GPL-repo-1]
name=HDP-2.6-GPL-repo-1
baseurl=http://192.168.103.194:8080/HDP-GPL-2.6.4.0-centos7-rpm/HDP-GPL/centos7/2.6.4.0-91

path=/
enabled=1
gpgcheck=0
[HDP-UTILS-1.1.0.22-repo-1]
name=HDP-UTILS-1.1.0.22-repo-1
baseurl=http://192.168.103.194:8080/HDP-UTILS-1.1.0.22-centos7

path=/
enabled=1
gpgcheck=0[root@dev-bg-w01 yum.repos.d]#

更新yum 元數據
yum clean all

yum makecache

yum repolist

安裝Ambari-server
在主節點安裝ambari-server
sudo yum install -y ambari-server

配置Ambari-server
配置mysql連接器
由於ambari要訪問數據庫，所以要添加lib包，請自行去mysql官網下載
sudo mkdir -p /usr/share/java
sudo cp /opt/mysql-connector-java-5.1.47/mysql-connector-java-5.1.47-bin.jar /usr/share/java/

在ambari-server配置文件中添加mysql lib包路徑地址

執行一下命令配置jdbc環境

ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java-5.1.47-bin.jar

vim /etc/ambari-server/conf/ambari.properties
###在jdbc區下面找個位置添加如下如下語句
server.jdbc.driver.path=/usr/share/java/mysql-connector-java-5.1.47-bin.jar

檢查環境並配置
執行以下命令
sudo ambari-server setup
按提示操作

會檢查selinux，是否自定義用戶，檢查防火牆，設置JDK路徑，數據庫配置等，按提示操作即可

具體操作如下：

[root@dev-bg-m01 opt]# vim /etc/ambari-server/conf/ambari.properties 
[root@dev-bg-m01 opt]# ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java-5.1.47-bin.jar
Using python /usr/bin/python
Setup ambari-server
Copying /usr/share/java/mysql-connector-java-5.1.47-bin.jar to /var/lib/ambari-server/resources
If you are updating existing jdbc driver jar for mysql with mysql-connector-java-5.1.47-bin.jar. Please remove the old driver jar, from all hosts. Restarting services that need the driver, will automatically copy the new jar to the hosts.
JDBC driver was successfully initialized.
Ambari Server 'setup' completed successfully.
[root@dev-bg-m01 opt]# vim /etc/ambari-server/conf/ambari.properties 
[root@dev-bg-m01 opt]# ambari-server setup
Using python /usr/bin/python
Setup ambari-server
Checking SELinux...
SELinux status is 'disabled'
Customize user account for ambari-server daemon [y/n] (n)? y
Enter user account for ambari-server daemon (root):ambari
Adjusting ambari-server permissions and ownership...
Checking firewall status...
Checking JDK...
Do you want to change Oracle JDK [y/n] (n)? y 
[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8
[2] Oracle JDK 1.7 + Java Cryptography Extension (JCE) Policy Files 7
[3] Custom JDK
==============================================================================
Enter choice (1): 3
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.
WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.
Path to JAVA_HOME: /opt/jdk1.8.0_161
Validating JDK on Ambari Server...done.
Checking GPL software agreement...
Completing setup...
Configuring database...
Enter advanced database configuration [y/n] (n)? y
Configuring database...
==============================================================================
Choose one of the following options:
[1] - PostgreSQL (Embedded)
[2] - Oracle
[3] - MySQL / MariaDB
[4] - PostgreSQL
[5] - Microsoft SQL Server (Tech Preview)
[6] - SQL Anywhere
[7] - BDB
==========================================

Enter choice (1): 3
Hostname (localhost): 192.168.103.3
Port (3306): 
Database name (ambari): 
Username (ambari): 
Enter Database Password (bigdata): 
Re-enter password: 
Configuring ambari database...
Configuring remote database connection properties...
WARNING: Before starting Ambari Server, you must run the following DDL against the database to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql
Proceed with configuring remote database connection properties [y/n] (y)? n
WARNING: Remote database setup aborted.
Ambari Server 'setup' completed with warnings.
[root@dev-bg-m01 opt]#

將Ambari數據庫腳本導入到數據庫

mysql -uambari -pxxx
use ambari;
source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql

啓動ambari server
ambari-server start

在瀏覽器中訪問ip:8080，默認登錄名：admin 密碼:admin

添加服務組件
https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-administration/content/ambari_admin_overview.html

spark配置
由於spark要訪問數據庫，所以要添加mysql lib包
cp /opt/mysql-connector-java-5.1.47/mysql-connector-java-5.1.47-bin.jar /usr/hdp/2.6.4.0-91/spark/lib/

 安裝數據庫
使用現有數據庫或者自己安裝

創建ambari和hive庫
create database ambari character set utf8 ;

添加權限

GRANT ALL PRIVILEGES ON ambari.* TO 'ambari'@'%';
FLUSH PRIVILEGES;

刪除權限：
revoke all privileges on ambari.* from ambari@'%';

# 程序安裝目錄

程序默認安裝目錄
[root@test-bg-m01 2.6.4.0-91]# pwd
/usr/hdp/2.6.4.0-91
[root@test-bg-m01 2.6.4.0-91]# ls
atlas hadoop hadoop-mapreduce hbase hive2 kafka pig ranger-hdfs-plugin ranger-kafka-plugin ranger-yarn-plugin spark storm tez usr
etc hadoop-hdfs hadoop-yarn hive hive-hcatalog livy ranger-hbase-plugin ranger-hive-plugin ranger-storm-plugin slider spark2 storm-slider-client tez_hive2 zookeeper
[root@test-bg-m01 2.6.4.0-91]#

PID目錄

/var/run/

日誌目錄
/var/logs/

一般修改log目錄，在安裝大數據組件的時候，修改配置文件即可。

刪除服務
先停止服務
Service Actions > Delete Service
yum remove xx
https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-administration/content/ambari_admin_overview.html

ambari監控

 ambari安裝默認用戶和用戶組

https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-administration/content/defining_service_users_and_groups_for_a_hdp_2x_stack.html

常見問題
問題1：Centos 7安裝 ambari-agent報錯NetUtil.py-[SSL: CERTIFICATE_VERIFY_FAILED]

Centos 7安裝 ambari通過Ambari部署系統時，ambari-agent註冊失敗，在/var/log/ambari-agent的log中可以看到日誌顯示：
ERROR 2018-03-08 15:02:25,223 NetUtil.py:88 - [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:579) 
ERROR 2018-03-08 15:02:25,223 NetUtil.py:89 - SSLError: Failed to connect. Please check openssl library versions.

解決方法：

修改/etc/python/cert-verification.cfg配置文件： 
# vim /etc/python/cert-verification.cfg
[https]
verify=platform_default ###(這是默認配置)
修改爲verify=disable

編輯 /etc/ambari-agent/conf/ambari-agent.ini 配置文件，在 [security] 節部分，確保設置如下兩個值，其它值保持不變：
[root@ambari ~]# vim /etc/ambari-agent/conf/ambari-agent.ini
[security]
ssl_verify_cert=0
force_https_protocol=PROTOCOL_TLSv1_2
以上配置修改完後，重試即可通過ambari-agent註冊，執行即可下一步

參考文檔
官方文檔安裝文檔

https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-installation/content/determine_product_interop.html

未完待續~