kafka監測工具kafka Eagle的安裝

1、下載

下載kafka-eagle-bin-1.2.4.tar.gz並放到/opt/softWare/kafkaEagle目錄下

2、解壓並進入解壓文件夾

[root@master kafkaEagle]# tar -zxvf kafka-eagle-bin-1.2.4.tar.gz 
kafka-eagle-bin-1.2.4/
kafka-eagle-bin-1.2.4/kafka-eagle-web-1.2.4-bin.tar.gz
[root@master kafkaEagle]# ls
kafka-eagle-bin-1.2.4  kafka-eagle-bin-1.2.4.tar.gz
[root@master kafkaEagle]# cd kafka-eagle-bin-1.2.4/
[root@master kafka-eagle-bin-1.2.4]# ls
kafka-eagle-web-1.2.4-bin.tar.gz

3、再解壓並重命名

[root@master kafka-eagle-bin-1.2.4]# tar -zxvf kafka-eagle-web-1.2.4-bin.tar.gz
[root@master kafka-eagle-bin-1.2.4]# mv kafka-eagle-web-1.2.4 kafka-eagle
[root@master kafka-eagle-bin-1.2.4]# ls
kafka-eagle  kafka-eagle-web-1.2.4-bin.tar.gz

4、配置環境變量

[root@master ~]# vim /etc/profile

#set java environment
export JAVA_HOME=/opt/softWare/jdk/jdk1.8.0_141
export JRE_HOME=/opt/softWare/jdk/jdk1.8.0_141/jre
export CLASSPATH=.:$JRE_HOME/lib/rt.jar:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin

#ADD kafka-Eagle path by yinzhengjie
export KE_HOME=/opt/softWare/kafkaEagle/kafka-eagle-bin-1.2.4/kafka-eagle
export PATH=$PATH:$KE_HOME/bin

[root@master ~]# source /etc/profile

5、編輯配置文件更改配置

注意：這裏使用的mysql，存儲kafka的信息。要先裝好mysql環境，並打開服務；

[root@master kafka-eagle-bin-1.2.4]# vim kafka-eagle/conf/system-config.properties

######################################
# multi zookeeper&kafka cluster list
######################################
kafka.eagle.zk.cluster.alias=cluster1
cluster1.zk.list=master:2181,slaves1:2181,slaves2:2181
#cluster2.zk.list=xdn10:2181,xdn11:2181,xdn12:2181

######################################
# zk client thread limit
######################################
kafka.zk.limit.size=25

######################################
# kafka eagle webui port
######################################
kafka.eagle.webui.port=8048

######################################
# kafka offset storage
######################################
cluster1.kafka.eagle.offset.storage=kafka
cluster2.kafka.eagle.offset.storage=zk

######################################
# enable kafka metrics
######################################
kafka.eagle.metrics.charts=false

######################################
# alarm email configure
######################################
kafka.eagle.mail.enable=true
kafka.eagle.mail.sa=alert_sa
[email protected]
kafka.eagle.mail.password=mqslimczkdqabbbh
kafka.eagle.mail.server.host=smtp.163.com
kafka.eagle.mail.server.port=25

######################################
# delete kafka topic token
######################################
kafka.eagle.topic.token=keadmin

######################################
# kafka sasl authenticate
######################################
kafka.eagle.sasl.enable=false
kafka.eagle.sasl.protocol=SASL_PLAINTEXT
kafka.eagle.sasl.mechanism=PLAIN

######################################
# kafka jdbc driver address
######################################
kafka.eagle.driver=com.mysql.jdbc.Driver
kafka.eagle.url=jdbc:mysql://192.168.230.21:3306/ke?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull
kafka.eagle.username=myuser
kafka.eagle.password=mypassword

配置文件主要配置：

# multi zookeeper&kafka cluster list
kafka.eagle.webui.port
# kafka jdbc driver address

6、給啓動文件附上執行權限

[root@master kafka-eagle-bin-1.2.4]# cd kafka-eagle/bin/
[root@master bin]# chmod a+x *
[root@master bin]# ll
total 16
-rwxr-xr-x. 1 root root 1848 Aug 22  2017 ke.bat
-rw-r--r--. 1 root root    5 Apr 28 13:45 ke.pid
-rwxr-xr-x. 1 root root 6018 Apr 18  2018 ke.sh

7、bin下啓動

[root@master bin]# ./ke.sh start

8、web訪問

默認用戶名爲admin,密碼爲123456

9、出現的坑

問題一描述

[2020-04-28 13:36:49] DruidDataSource.Druid-ConnectionPool-Create-445750050 - ERROR - create connection error, url: jdbc:mysql://master:3306/ke?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull, errorCode 1045, state 28000
 java.sql.SQLException: Access denied for user 'myuser'@'master' (using password: YES)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1084)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4232)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4164)
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:926)

解決辦法：

root賬戶登陸mysql，並開放權限：

[root@master ~]# mysql -u root -p 
Enter password: 

mysql> GRANT ALL PRIVILEGES ON *.* TO 'myuser'@'master'  IDENTIFIED BY  'mypassword'  WITH GRANT OPTION;
Query OK, 0 rows affected (0.01 sec)


mysql> SELECT host, user, password FROM mysql.user WHERE user='myuser';
+-----------+--------+-------------------------------------------+
| host      | user   | password                                  |
+-----------+--------+-------------------------------------------+
| localhost | myuser | *FABE5482D5AADF36D028AC443D117BE1180B9725 |
| %         | myuser | *FABE5482D5AADF36D028AC443D117BE1180B9725 |
| master    | myuser | *FABE5482D5AADF36D028AC443D117BE1180B9725 |
+-----------+--------+-------------------------------------------+

問題二描述：

[2020-04-28 16:32:23] DruidDataSource.Druid-ConnectionPool-Create-466506419 - ERROR - create connection error, url: jdbc:mysql://192.168.230.21:3306/ke?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull, errorCode 1049, state 42000
 com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown database 'ke'
	at sun.reflect.GeneratedConstructorAccessor31.newInstance(Unknown Source)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at com.mysql.jdbc.Util.handleNewInstance(Util.java:409)
	at com.mysql.jdbc.Util.getInstance(Util.java:384)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052)

解決辦法：

此報錯，是因爲再配置的mysql用戶下面缺少ke數據庫；登錄mysql的配置用戶並創建ke數據庫即可；

[root@master ~]# mysql -u myuser -p 
Enter password: 

mysql> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| hive               |
| mysql              |
| performance_schema |
| test               |
+--------------------+
5 rows in set (0.01 sec)

mysql> create database ke;
Query OK, 1 row affected (0.01 sec)

mysql> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| hive               |
| ke                 |
| mysql              |
| performance_schema |
| test               |
+--------------------+
6 rows in set (0.01 sec)