Flume學習遇到的問題

1.執行bin/flume-ng agent -c ./conf -f ./conf/spooldir.conf -n a1 -Dflume.root.logger=INFO,console後，上傳文件到dirfile報錯：[ERROR - org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:280)] FATAL: Spool Directory source r1: { spoolDir: /export/servers/dirfile }: Uncaught exception in SpoolDirectorySource thread. Restart or reconfigure Flume to continue processing.
java.nio.charset.MalformedInputException: Input length = 1

 原因：上傳的文件內容有中文

解決方案：刪除中文字符即可

2.運行級聯flume時報錯：

[ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:447)] process failed.

[ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. 

解決：

在配置文件/export/servers/apache-flume-1.8.0-bin/conf---collector.conf中添加以下語句：

a1.sinks.k1.hdfs.useLocalTimeStamp = true