一、Kylin簡介

Apache Kylin?是一個開源的分布式分析引擎，提供Hadoop/Spark之上的SQL查詢接口及多維分析（OLAP）能力以支持超大規(guī)模數(shù)據(jù)，最初由eBay Inc. 開發(fā)并貢獻(xiàn)至開源社區(qū)。它能在亞秒內(nèi)查詢巨大的Hive表。

二、安裝前準(zhǔn)備

軟件版本：

1.apache-kylin-2.5.2-bin-cdh60.tar.gz
2.CDH6.0.0
3.JDK_1.8.0_141

安裝機(jī)器：

172.17.194.17   dev_cdh_001v  all
172.17.194.18   dev_cdh_002v  query
172.17.194.19   dev_cdh_003v  query

三、集群模式安裝

1.在dev_cdh_001v上解壓部署apache-kylin-2.5.2-bin-cdh60.tar.gz

tar zxvf apache-kylin-2.5.2-bin-cdh60.tar.gz
cp apache-kylin-2.5.2-bin-cdh60 /usr/local

2.在dev_cdh_001v修改配置
(1)配置環(huán)境變量

vi /etc/profile

#for Kylin
export KYLIN_HOME=/usr/local/apache-kylin-2.5.2-bin-cdh60
export HBASE_HOME=/opt/cloudera/parcels/CDH/lib/hbase
export HADOOP_HOME=/opt/cloudera/parcels/CDH
export HIVE_HOME=/opt/cloudera/parcels/CDH/lib/hive
export HADOOP_CMD=/opt/cloudera/parcels/CDH/lib/hadoop/bin/hadoop
export HCAT_HOME=/opt/cloudera/parcels/CDH/lib/hive-hcatalog

使配置生效

source /etc/profile

(2)配置kylin

vi $KYLIN_HOME/conf/kylin.properties

kylin.metadata.url= kylin_metadata@hbase
kylin.server.mode=all    // 只能有一個節(jié)點(diǎn)是all，其他節(jié)點(diǎn)為query
kylin.server.cluster-servers=dev_cdh_001v:7070,dev_cdh_002v:7070,dev_cdh_003v:7070

(3)配置加載hbase common lib

vi /opt/cloudera/parcels/CDH/lib/hbase/bin/hbase

改
CLASSPATH=${CLASSPATH}:$JAVA_HOME/lib/tools.jar
成
CLASSPATH=${CLASSPATH}:$JAVA_HOME/lib/tools.jar:/opt/cloudera/parcels/CDH/lib/hbase/lib/*

3.將/usr/local/apache-kylin-2.5.2-bin-cdh60拷貝 dev_cdh_002v和 dev_cdh_003v

scp -r /usr/local/apache-kylin-2.5.2-bin-cdh60 root@dev_cdh_002v:/usr/local/
scp -r /usr/local/apache-kylin-2.5.2-bin-cdh60 root@dev_cdh_003v:/usr/local/

4.在dev_cdh_002v和dev_cdh_003v進(jìn)行以下操作
(1)修改 /opt/cloudera/parcels/CDH/lib/hbase/bin/hbase

vi /opt/cloudera/parcels/CDH/lib/hbase/bin/hbase

改
CLASSPATH=${CLASSPATH}:$JAVA_HOME/lib/tools.jar
成
CLASSPATH=${CLASSPATH}:$JAVA_HOME/lib/tools.jar:/opt/cloudera/parcels/CDH/lib/hbase/lib/*

(2)修改kylin的配置

vi $KYLIN_HOME/conf/kylin.properties
kylin.server.mode=query

5.在dev_cdh_001v上的nginx上添加一下配置
(1)upstream.conf

vi /usr/local/nginx/conf/upstream.conf

upstream kylin-cluster {
ip_hash;
server 172.17.194.17:7070 max_fails=2 fail_timeout=5s;
server 172.17.194.18:7070 max_fails=2 fail_timeout=5s;
server 172.17.194.19:7070 max_fails=2 fail_timeout=5s;
}

(2)nginx.conf

vi /usr/local/nginx/conf/nginx.conf
server {
       listen       7001;
       server_name  10.240.9.132;

       default_type 'text/html';
       charset utf-8;
       access_log  /data/logs/kylin/kylin_nginx.log  main;

       location ^~ / {
                        proxy_pass http://kylin-cluster;
                        proxy_connect_timeout 60s;
                        proxy_send_timeout 1800s;
                        proxy_read_timeout 1800s;
                        proxy_ignore_client_abort on;
         }
     }

(3)reload nginx

四、啟動kylin
1.檢查配置依賴是否正確

 $KYLIN_HOME/bin/check-env.sh

root@dev_cdh_001v:/usr/local/nginx/conf
#  $KYLIN_HOME/bin/check-env.sh
Retrieving hadoop conf dir...
KYLIN_HOME is set to /usr/local/apache-kylin-2.5.2-bin-cdh60

2.在dev_cdh_001v，dev_cdh_002v和dev_cdh_003v啟動kylin

$KYLIN_HOME/bin/kylin.sh start

3.登錄kylin

http://dev_cdh_001v:7001/kylin
ADMIN/KYLIN(默認(rèn)賬號密碼)

image.png