Skip to content

Instantly share code, notes, and snippets.

@vansika
Created September 26, 2020 00:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save vansika/cf1d7439c7c57deeaf726a77566803ee to your computer and use it in GitHub Desktop.
Save vansika/cf1d7439c7c57deeaf726a77566803ee to your computer and use it in GitHub Desktop.
20/09/26 00:06:29 ERROR TaskSetManager: Task 5 in stage 4022.0 failed 4 times; aborting job
Exception in thread "serve toLocalIterator" org.apache.spark.SparkException: Job aborted due to stage failure: Task 5 in stage 4022.0 failed 4 times, most recent failure: Lost task 5.3 in stage 4022.0 (TID 23237, 10.0.1.24, executor 2): org.apache.spark.api.python.PythonException: Traceback (most recent call last):
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/worker.py", line 366, in main
func, profiler, deserializer, serializer = read_udfs(pickleSer, infile, eval_type)
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/worker.py", line 241, in read_udfs
arg_offsets, udf = read_single_udf(pickleSer, infile, eval_type, runner_conf)
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/worker.py", line 168, in read_single_udf
f, return_type = read_command(pickleSer, infile)
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/worker.py", line 69, in read_command
command = serializer._read_with_length(file)
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/serializers.py", line 172, in _read_with_length
return self.loads(obj)
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/serializers.py", line 580, in loads
return pickle.loads(obj, encoding=encoding)
File "./listenbrainz_spark_request_consumer.zip/listenbrainz_spark/recommendations/recommend.py", line 19, in <module>
from data.model.user_cf_recommendations_recording_message import (UserRecommendationsRecord,
ModuleNotFoundError: No module named 'data'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment