| 20/07/23 22:47:34 DEBUG scheduler.OutputCommitCoordinator: Ignoring task completion for completed stage | |
| : An error occurred while calling o72.showString. | |
| : org.apache.spark.SparkException: Job aborted due to stage failure: Task 10 in stage 0.0 failed 4 times, most recent failure: Lost task 10.3 in stage 0.0 (TID 33, ip-10-128-4-146.ec2.internal, executor 3): java.lang.NullPointerException | |
| at org.apache.spark.rdd.NewHadoopRDD$$anon$1.liftedTree1$1(NewHadoopRDD.scala:216) | |
| at org.apache.spark.rdd.NewHadoopRDD$$anon$1.<init>(NewHadoopRDD.scala:213) | |
| at org.apache.spark.rdd.NewHadoopRDD.compute(NewHadoopRDD.scala:168) | |
| at org.apache.spark.rdd.NewHadoopRDD.compute(NewHadoopRDD.scala:71) | |
| at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:349) | |
| at org.apache.spark.rdd.RDD.iterator(RDD.scala:313) | |
| at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) |
Disclaimer: This piece is written anonymously. The names of a few particular companies are mentioned, but as common examples only.
This is a short write-up on things that I wish I'd known and considered before joining a private company (aka startup, aka unicorn in some cases). I'm not trying to make the case that you should never join a private company, but the power imbalance between founder and employee is extreme, and that potential candidates would