启动Spark有时成功有时报错

环境：spark-2.4.8 CDH-6.3.2 scala-1.11.12

报错信息：

1.  
   Application application_1669708409043_0014 failed 2 times due to AM Container for appattempt_1669708409043_0014_000002 exited with exitCode: 1
2.  
    
3.  
   Failing this attempt.Diagnostics: [2022-11-29 18:01:11.661]Exception from container-launch.
4.  
    
5.  
   Container id: container_1669708409043_0014_02_000001
6.  
    
7.  
   Exit code: 1
8.  
    
9.  
   [2022-11-29 18:01:11.663]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
10.  
     
11.  
    Last 4096 bytes of prelaunch.err :
12.  
     
13.  
    Last 4096 bytes of stderr :
14.  
     
15.  
    Error: Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher
16.  
     
17.  
    [2022-11-29 18:01:11.663]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
18.  
     
19.  
    Last 4096 bytes of prelaunch.err :
20.  
     
21.  
    Last 4096 bytes of stderr :
22.  
     
23.  
    Error: Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher

原因：路径jar包没有识别读取到

解决办法：spark配置文件：spark-default.conf 中的spark.yarn.jars=路径找不到，检查hdfs或本地路径是否正确。注意：路径结尾加*。

这篇好文章是转载于：学新通技术网