log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Using Spark's repl log4j profile: org/apache/spark/log4j-defaults-repl.properties
To adjust logging level use sc.setLogLevel("INFO")
...
解決方案1:
按照提示執行
scala> sc.setLogLevel("INFO")
解決方案2:
cp ${SPARK_HOME}/conf/log4j.properties.template ${SPARK_HOME}/conf/log4j.properties
# log4j.properties.template中已配置相關內容,將其修改爲properties後,配置自動生效
log4j.rootCategory=INFO, console
解決方案3:
# 根據Using Spark's repl log4j profile: org/apache/spark/log4j-defaults-repl.properties 提示,直接修改org/apache/spark/log4j-defaults-repl.properties
# org.apache.spark.Logging文件中有讀取log4j屬性文件相關程序邏輯以及輸出相關提示信息