CDH環境下kylin的安裝教程
1.軟件版本介紹:
cdh5.10.1
Kylin: 2.1.0
2.環境檢查
環境中需要啓動的角色:
Hive Metastore Server
yarn的JobHistory Server
3.正式安裝
3.1 kylin2.1.0下載軟件
http://mirrors.hust.edu.cn/apache/kylin/apache-kylin-2.1.0/apache-kylin-2.1.0-bin-cdh57.tar.gz
3.2 正式安裝
1.移動軟件包到/usr/local/apps目錄下
mkdir /usr/local/apps
cd /usr/local/apps
mv ~/apache-kylin-2.1.0-bin-cdh57.tar.gz ./
2.解壓
[root@cdh01 apps]# tar -zxvf apache-kylin-2.1.0-bin-cdh57.tar.gz
3.建立軟連接
[root@cdh01 apps]# ln -s apache-kylin-2.1.0-bin-cdh57 kylin
4.添加環境變量到當前用戶的bashrc下: 命令: vi ~/.bashrc
export BASE_PATH=/opt/cloudera/parcels/CDH/lib
#added by hbase
export HBASE_HOME=$BASE_PATH/hbase
export PATH=$HBASE_HOME/bin:$PATH
#added by HCat
export HCAT_HOME=$BASE_PATH/hive-hcatalog
#added by kylin
export KYLIN_HOME=/usr/local/apps/kylin
#added by java
export JAVA_HOME=/usr/java/latest
5.生效環境配置
[root@cdh01 latest]# source ~/.bashrc
6.修改kylin.properties配置文件
[root@cdh01 conf]# pwd
/usr/local/apps/kylin/conf
[root@cdh01 conf]# vi kylin.properties
#修改
kylin.server.cluster-servers=192.168.1.201:7070
#添加配置
kylin.job.jar=/usr/local/apps/kylin/lib/kylin-job-2.1.0.jar
kylin.coprocessor.local.jar=/usr/local/apps/kylin/lib/kylin-coprocessor-2.1.0.jar
kylin.job.yarn.app.rest.check.status.url=http://192.168.1.202:8088/ws/v1/cluster/apps/${job_id}?anonymous=true
7.檢查
[root@cdh01 bin]# cd /usr/local/apps/kylin/bin
執行下面檢查命令 會創建kylin目錄在hdfs上
[root@cdh01 bin]# ./check-env.sh
Retrieving hadoop conf dir...
KYLIN_HOME is set to /usr/local/apps/kylin
[root@cdh01 bin]# hadoop fs -ls /
Found 8 items
drwxr-xr-x - hdfs supergroup 0 2017-06-02 17:55 /CONFIG
drwxr-xr-x - hbase hbase 0 2017-08-31 19:11 /hbase
drwxr-xr-x - root supergroup 0 2017-09-01 10:23 /kylin
[root@cdh01 bin]# ./find-hbase-dependency.sh
Retrieving hbase dependency...
[root@cdh01 bin]# ./find-hive-dependency.sh
Retrieving hive dependency...
8.啓動kylin
[root@cdh01 kylin]# bin/kylin.sh start
查看kylinUI日誌
[root@cdh01 kylin]# tailf logs/kylin.out
INFO: Starting ProtocolHandler ["http-bio-7070"] Sep 01, 2017 10:35:28 AM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["ajp-bio-9009"] Sep 01, 2017 10:35:28 AM org.apache.catalina.startup.Catalina start INFO: Server startup in 22057 ms |
啓動完成
查看kylin server日誌
[root@cdh01 kylin]# tailf logs/kylin.log
無報錯,啓動完成
9.登陸kylin
User: ADMIN
Pass: KYLIN
登陸完成
4.導入官方測試數據進行測試
4.1導入數據
查看Hive default庫中的表
hive> show tables; OK t1 Time taken: 0.034 seconds, Fetched: 1 row(s) hive>
|
執行命令
/usr/local/apps/kylin/bin
[root@cdh01 bin]# ./sample.sh
日誌倒數兩行
Sample cube is created successfully in project 'learn_kylin'. Restart Kylin Server or click Web UI => System Tab => Reload Metadata to take effect #這句話的意思是 例子cube已成成功創建在了 工程名稱叫'learn_kylin'裏面了 #重啓kylin或者通過webUI => System選項卡=> 重新導入元數據信息 |
查看Hive default庫中的表,多了五張表
hive> show tables; OK kylin_account kylin_cal_dt kylin_category_groupings kylin_country kylin_sales t1 Time taken: 0.015 seconds, Fetched: 6 row(s) hive> |
重新加載元數據操作圖
共3步
步驟1
步驟2
步驟3
4.2查看導入模型
查看導入的信息 => 點擊最上面選項卡 Model
4.3 開始cube的構建
1.點擊Cube的Actions現象---->再點擊Build
2.選擇數據分區範圍
3.查看正在構建的cube任務,點擊monitor
4.坐等構建完成吧
5.好了,終於完成了
4.4 查詢構建完成的cube信息
結果數據