kafka源碼環境搭建

kafka源碼環境搭建
基於
    JDK 1.8.0_161
    kafka-0.10.0.1
    scala-2.12.6
    zookeeper-3.4.12
    gradle-4.5
開發工具 IDEA 2018.1.5

1.首先需要依次配置環境變量
    JDK 1.8.0_161、kafka-0.10.0.1、scala-2.12.6、zookeeper-3.4.12、gradle-4.5
2.啓動zookeeper
    首先拷貝一份%ZOOKEEPER_HOME%\conf\zoo_sample.cfg 修改爲zoo.cfg,修改zoo.cfg裏面的dataDir=/tmp/zookeeper日誌存儲目錄
    執行 zkserver

C:\Users\chenjianfei>zkserver

C:\Users\chenjianfei>call "D:\jdk1.8.0_161"\bin\java "-Dzookeeper.log.dir=D:\zookeeper-3.4.12\bin\.." "-Dzookeeper.root.logger=INFO,CONSOLE" -cp "D:\zookeeper-3.4.12\bin\..\build\classes;D:\zookeeper-3.4.12\bin\..\build\lib\*;D:\zookeeper-3.4.12\bin\..\*;D:\zookeeper-3.4.12\bin\..\lib\*;D:\zookeeper-3.4.12\bin\..\conf" org.apache.zookeeper.server.quorum.QuorumPeerMain "D:\zookeeper-3.4.12\bin\..\conf\zoo.cfg"
2018-07-07 10:25:49,583 [myid:] - INFO  [main:QuorumPeerConfig@136] - Reading configuration from: D:\zookeeper-3.4.12\bin\..\conf\zoo.cfg
2018-07-07 10:25:49,583 [myid:] - INFO  [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
2018-07-07 10:25:49,583 [myid:] - INFO  [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
2018-07-07 10:25:49,583 [myid:] - INFO  [main:DatadirCleanupManager@101] - Purge task is not scheduled.
2018-07-07 10:25:49,583 [myid:] - WARN  [main:QuorumPeerMain@116] - Either no config or no quorum defined in config, running  in standalone mode
2018-07-07 10:25:49,645 [myid:] - INFO  [main:QuorumPeerConfig@136] - Reading configuration from: D:\zookeeper-3.4.12\bin\..\conf\zoo.cfg
2018-07-07 10:25:49,645 [myid:] - INFO  [main:ZooKeeperServerMain@98] - Starting server
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:zookeeper.version=3.4.12-e5259e437540f349646870ea94dc2658c4e44b3b, built on 03/27/2018 03:55 GMT
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:host.name=DESKTOP-6FVEB35
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:java.version=1.8.0_161
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:java.vendor=Oracle Corporation
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:java.home=D:\jdk1.8.0_161\jre
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:java.class.path=D:\zookeeper-3.4.12\bin\..\build\classes;D:\zookeeper-3.4.12\bin\..\build\lib\*;D:\zookeeper-3.4.12\bin\..\zookeeper-3.4.12.jar;D:\zookeeper-3.4.12\bin\..\lib\audience-annotations-0.5.0.jar;D:\zookeeper-3.4.12\bin\..\lib\jline-0.9.94.jar;D:\zookeeper-3.4.12\bin\..\lib\log4j-1.2.17.jar;D:\zookeeper-3.4.12\bin\..\lib\netty-3.10.6.Final.jar;D:\zookeeper-3.4.12\bin\..\lib\slf4j-api-1.7.25.jar;D:\zookeeper-3.4.12\bin\..\lib\slf4j-log4j12-1.7.25.jar;D:\zookeeper-3.4.12\bin\..\conf
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:java.library.path=D:\jdk1.8.0_161\bin;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;D:\app\chenjianfei\product\11.2.0\client_1\bin;C:\Program Files (x86)\Intel\iCLS Client\;C:\Program Files\Intel\iCLS Client\;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Program Files\Intel\WiFi\bin\;C:\Program Files\Common Files\Intel\WirelessCommon\;C:\Program Files (x86)\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files (x86)\Intel\Intel(R) Management Engine Components\IPT;C:\Program Files\Intel\Intel(R) Management Engine Components\IPT;D:\jdk1.8.0_161\bin;D:\apache-maven-3.5.2\bin;D:\Git\cmd;D:\gradle-4.5\bin;D:\scala-2.12.6\bin;D:\zookeeper-3.4.12\bin;C:\Program Files\Intel\WiFi\bin\;C:\Program Files\Common Files\Intel\WirelessCommon\;C:\Users\chenjianfei\AppData\Local\Microsoft\WindowsApps;;.
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:java.io.tmpdir=C:\Users\CHENJI~1\AppData\Local\Temp\
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:java.compiler=<NA>
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:os.name=Windows 10
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:os.arch=amd64
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:os.version=10.0
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:user.name=chenjianfei
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:user.home=C:\Users\chenjianfei
2018-07-07 10:25:58,833 [myid:] - INFO  [main:Environment@100] - Server environment:user.dir=C:\Users\chenjianfei
2018-07-07 10:25:58,833 [myid:] - INFO  [main:ZooKeeperServer@835] - tickTime set to 2000
2018-07-07 10:25:58,833 [myid:] - INFO  [main:ZooKeeperServer@844] - minSessionTimeout set to -1
2018-07-07 10:25:58,833 [myid:] - INFO  [main:ZooKeeperServer@853] - maxSessionTimeout set to -1
2018-07-07 10:25:59,067 [myid:] - INFO  [main:ServerCnxnFactory@117] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory
2018-07-07 10:25:59,067 [myid:] - INFO  [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:2181

3.IDEA 安裝scala插件


4.指定gradle插件位置

5.IDEA導入kafka源碼

    import 項目->選擇gradle 完成


6.kafka服務啓動準備

7.創建kafka producer啓動準備

8.創建kafka consumer啓動準備

9.依次啓動

    kafka->producer->consumer

10.在producer控制檯輸入hello kafka,可以在consumer接收到hello kafka




發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章