This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Hello, | |
| I am using Python 3.9 and spark 3.1.1 | |
| when i am using iris1.collect() it is working fine and i am getting desired output(iris1 is my RDD), but when i am using iris1.take(10) i am getting below error, Similarly many functions are not working and giving same error | |
| 1/03/06 23:04:59 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable | |
| Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties | |
| Setting default log level to "WARN". | |
| To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). | |
| 21/03/06 23:05:01 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041. | |
| 21/03/06 23:05:04 ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0) |