mysql表結構
自定義returner
fluent採集
客戶端配置
服務端配置
背景: salt自帶的有很多可選的returner,但是都需要在minion做配置,我感覺這點挺操蛋,而且正好我們平臺上在使用fluent做採集,於是就自定義一個reutren,然後用fluent採集,處理,入庫
具體操作過程如下：
mysql表結構
CREATE TABLE `fluent`;
CREATE TABLE `salt_returns` (
`id` mediumint(9) NOT NULL AUTO_INCREMENT,
`jid` char(20) DEFAULT NULL,
`host_id` varchar(48) DEFAULT NULL,
`time` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP,
`fun` varchar(30) DEFAULT NULL,
`return` text,
`success` char(5) DEFAULT NULL,
PRIMARY KEY (`id`),
KEY `idx_host_id` (`host_id`)
自定義returner
創建默認自定義return的目錄,這個目錄雖然是默認的,但是默認並沒有創建
# mkdir /srv/salt/_returners
自定義returner
主要就是returner(ret) 這個函數的定義
/srv/salt/_returners/lcoal_return.py
#coding=utf8
import json
def __virtual__():
return 'local_return'
def returner(ret):
'''
Return data to the local file
'''
result_file = '/var/local/salt/returner'
result = file(result_file,'a+')
result.write(str(json.dumps(ret.values()))[1:-1]+'\n')
result.close()
同步到所有節點：
salt '*' saltutil.sync_returners
執行命令
salt '*' cmd.run 'ls /var' --return local_return
查看結果：
# cat /var/log/salt/returner
"cmd.run", "20130524052158870765", "cache\ncvs\ndb\nempty\ngames\nlib\nlocal\nlock\nlog\nmail\nnis\nopt\npreserve\nrun\nspool\ntmp\nwww\nyp", "minion1", true
fluent採集
客戶端配置
<source>
type tail
path /var/log/salt/returner
pos_file /tmp/return_pos.log
tag os.salt
format /\"(?<fun>.*)\", \"(?<jid>\d+)\", (?<return>.*), \"(?<id>.*)\", (?<success>.*)/
</source>
<match os.*>
type forward
flush_interval 1s
<server>
host {{ pillar['host'] }}
port {{ pillar['port'] }}
</server>
</match>
服務端配置
<source>
type forward
port 24224
bind 0.0.0.0
</source>
<match host.os.salt>
type mysql
host localhost
database fluent
username fluent
password fluent
key_names jid,id,fun,return,success
sql INSERT INTO salt_returns (jid,host_id,fun,`return`,success) VALUES (?,?,?,?,?)
flush_interval 5s
</match>
結果查詢:
select * from salt_returns where success is not NULL and fun='cmd.run' limit 1;
+------+----------------------+-----------------------------------------+---------------------+---------+---------+---------+
| id | jid | host_id | time | fun | return | success |
+------+----------------------+-----------------------------------------+---------------------+---------+---------+---------+
| 2571 | 20130531184127393793 | test | 2013-05-31 10:38:29 | cmd.run | "/root" | true |
+------+----------------------+-----------------------------------------+---------------------+---------+---------+---------+