參考：https://blog.csdn.net/SCGH_Fx/article/details/72529132
-------------------------------------------------------------------------------------------------------------------------------------------------------------
1、idea啓動出現無效的源發行版：10
解決：intellij：file->project structure->project，Project Language Level，下拉列表選和本機JDK版本一致的，我的JDK1.8，這裏選8，ok
2、java.lang.ClassNotFoundException: scala.Cloneable
解決：下載scala-sdk
3、java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStream
解決：將hadoop-common-0.23.9.jar複製到lib目錄下。
下載鏈接：http://www.java2s.com/Code/Jar/h/Downloadhadoopcommon0239jar.htm
4、java.lang.ClassNotFoundException: org.spark_project.guava.cache.CacheLoader
解決：將spark-network-common_2.11-2.4.4.jar複製到lib目錄下。
下載鏈接：https://www.mvnjar.com/org.apache.spark/spark-network-common_2.11/2.4.4/detail.html
5、java.lang.NoClassDefFoundError: org/apache/commons/lang3/SystemUtils
解決：將commons-lang3-3.9.jar複製到lib目錄下。
下載鏈接：https://archive.apache.org/dist/commons/lang/binaries/
6、java.lang.NoClassDefFoundError: scala/Product$class
原因：Spark是基於scala 2.11編譯的，而環境使用了最新的2.12的scala的編譯版本；
解決：重新安裝scala 2.11版本
下載鏈接：https://www.scala-lang.org/download/2.11.12.html
7、java.lang.NoClassDefFoundError: org/slf4j/impl/StaticLoggerBinder
解決：將slf4j-simple-1.7.25.jar和slf4j-api-1.7.25.jar複製到lib目錄下。
下載鏈接：https://mvnrepository.com/artifact/org.slf4j
8、java.lang.NoClassDefFoundError: org/apache/log4j/Level
解決：刪除slf4j-log4j12.jar依賴
9、java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration
解決：將commons-configuration-1.9.jar複製到lib目錄下。
10、java.lang.NoClassDefFoundError: com/google/common/collect/Maps
解決：將google-collections-1.0.jar複製到lib目錄下。
下載鏈接：http://www.java2s.com/Code/Jar/c/Downloadcommonsconfiguration19jar.htm
11、java.lang.NoClassDefFoundError: org/apache/hadoop/security/authentication/util/KerberosName
解決：我這裏是有jar包版本衝突，hadoop-common-0.23.9.jar和hadoop-common-2.9.2.jar，刪除了前者
12、java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
解決：將hadoop-auth-2.7.2.jar複製到lib目錄下。
下載鏈接：https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-auth/2.7.2
13、java.lang.NoClassDefFoundError: com/ctc/wstx/io/InputBootstrapper
解決：將woodstox-core-asl-4.4.1.jar 複製到lib目錄下
下載鏈接：https://mvnrepository.com/artifact/org.codehaus.woodstox/woodstox-core-asl/4.4.1
14、java.lang.NoClassDefFoundError: org/codehaus/stax2/XMLInputFactory2
解決：將stax2-2.1.jar 複製到lib目錄下
下載鏈接：http://www.java2s.com/Code/Jar/s/Downloadstax221jar.htm
15、java.lang.NoClassDefFoundError: org/codehaus/stax2/ri/evt/BaseEventImpl
解決：將stax2-api-3.0.1.jar複製到lib目錄下
下載鏈接：http://www.java2s.com/Code/Jar/s/Downloadstax2api301jar.htm
16、java.lang.NoClassDefFoundError: com/google/common/collect/Interners
解決：將guava-27.0.1-jre.jar複製到lib目錄下
下載鏈接：https://repo1.maven.org/maven2/com/google/guava/guava/27.0.1-jre/
17、java.lang.NoSuchMethodError: com.google.common.collect.MapMaker.keyEquivalence(Lcom/google/common/base/Equivalence;)Lcom/google/common/collect/MapMaker;
解決：刪除google-collections-xx.jar依賴
18、java.lang.NoSuchMethodError: org.apache.hadoop.security.authentication.util.KerberosUtil.hasKerberosTicket(Ljavax/security/auth/Subject
解決：版本衝突了，hadoop-common降低版本到2.7，添加hadoop-common-2.7.4.jar依賴
下載鏈接：https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-common/2.7.4
19、java.lang.NoClassDefFoundError: org/apache/spark/network/shuffle/ShuffleClient
解決：將spark-network-shuffle_2.11-2.1.2.jar複製到lib目錄下
下載鏈接：https://mvnrepository.com/artifact/org.apache.spark/spark-network-shuffle_2.11/2.1.2
20、java.lang.ClassNotFoundException: io.netty.channel.Channel
解決：將netty-all-4.1.42.Final.jar複製到lib目錄下
下載鏈接：https://mvnrepository.com/artifact/io.netty/netty-all/4.1.42.Final
21、java.lang.ClassNotFoundException: com.codahale.metrics.MetricSet
解決：將metrics-core-3.0.2.jar複製到lib目錄下
下載鏈接：https://repo1.maven.org/maven2/com/codahale/metrics/metrics-core/3.0.2/
22、java.lang.ClassNotFoundException: com.esotericsoftware.kryo.Serializer
解決：將kryo-4.0.0.jar複製到lib目錄下
下載鏈接：https://repo1.maven.org/maven2/com/esotericsoftware/kryo/4.0.0/
23、java.lang.ClassNotFoundException: com.twitter.chill.KryoBase
解決：將chill_2.12-0.9.2.jar複製到lib目錄下
下載鏈接：https://mvnrepository.com/artifact/com.twitter/chill_2.12/0.9.2
24、java.lang.ClassNotFoundException: org.apache.spark.unsafe.array.ByteArrayMethods
解決：將spark-unsafe_2.12-2.4.0.jar複製到lib目錄下
下載鏈接：https://mvnrepository.com/artifact/org.apache.spark/spark-unsafe_2.12/2.4.0
25、java.lang.ClassNotFoundException: javax.ws.rs.WebApplicationException
解決：將javax.ws.rs-api-2.0.1.jar複製到lib目錄下
下載鏈接：https://mvnrepository.com/artifact/javax.ws.rs/javax.ws.rs-api/2.0.1
26、java.lang.ClassNotFoundException: org.json4s.JsonAST$JValue
解決：將json4s-ast_2.12-3.2.11.jar複製到lib目錄下
下載鏈接：https://mvnrepository.com/artifact/org.json4s/json4s-ast_2.12/3.2.11
27、java.lang.ClassNotFoundException: scala.xml.MetaData
解決：將scala-xml-2.11.0-M4.jar複製到lib目錄下
下載鏈接：https://mvnrepository.com/artifact/org.scala-lang/scala-xml/2.11.0-M4
28、java.lang.ClassNotFoundException: javax.servlet.Servlet
解決：將javax.servlet-api-3.1.0.jar複製到lib目錄下
下載鏈接：https://mvnrepository.com/artifact/javax.servlet/javax.servlet-api/3.1.0
29、java.lang.ClassNotFoundException: org.glassfish.jersey.servlet.ServletContainer
解決：將jersey-container-servlet-core-2.25.1.jar複製到lib目錄下
30、java.lang.ClassNotFoundException: org.glassfish.jersey.server.spi.Container
解決：將jersey-server-2.25.1.jar複製到lib目錄下
下載鏈接：https://mvnrepository.com/artifact/org.glassfish.jersey.core/jersey-server/2.25.1
31、java.lang.ClassNotFoundException: org.apache.spark.launcher.LauncherProtocol$Message
解決：將spark-launcher_2.11-2.2.0.jar複製到lib下
下載鏈接：https://mvnrepository.com/artifact/org.apache.spark/spark-launcher_2.11/2.2.0
32、java.lang.ClassNotFoundException: com.fasterxml.jackson.databind.Module
解決：將jackson-databind-2.9.8.jar複製到lib下
下載鏈接：https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.9.8/
33、java.lang.ClassNotFoundException: com.fasterxml.jackson.core.Versioned
解決：將jackson-core-2.9.8.jar複製到lib下
下載鏈接：https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-core/2.9.8/
34、java.lang.ClassNotFoundException: com.codahale.metrics.json.MetricsModule
解決：將metrics-json-3.0.2.jar複製到lib下
下載鏈接：https://repo1.maven.org/maven2/com/codahale/metrics/metrics-json/3.0.2/
35、java.lang.ClassNotFoundException: com.fasterxml.jackson.annotation.JsonView
解決：將jackson-annotations-2.9.8.jar複製到lib下
下載鏈接：https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.9.8/