Skip to content

Instantly share code, notes, and snippets.

@Neeraj9697
Neeraj9697 / gist:f7aa1c6951bd3021eb48ccb919cbfd57
Created March 6, 2021 18:02
java.io.IOException: Cannot run program "python3": CreateProcess error=2, The system cannot find the file specified
Hello,
I am using Python 3.9 and spark 3.1.1
when i am using iris1.collect() it is working fine and i am getting desired output(iris1 is my RDD), but when i am using iris1.take(10) i am getting below error, Similarly many functions are not working and giving same error
1/03/06 23:04:59 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
21/03/06 23:05:01 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
21/03/06 23:05:04 ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)