Where Are the Execution Logs of Spark Jobs Stored?
- Logs of unfinished Spark jobs are stored in the /srv/BigData/hadoop/data1/nm/containerlogs/ directory on the Core node.
- Logs of finished Spark jobs are stored in the /tmp/logs/username/logs directory of HDFS.