Skip to content

Instantly share code, notes, and snippets.

@ianmilligan1

ianmilligan1/errordump-cpp-pagerank.log

Last active March 25, 2016 18:26
Show Gist options
  • Save ianmilligan1/a4693819aed8b8eee259 to your computer and use it in GitHub Desktop.
Save ianmilligan1/a4693819aed8b8eee259 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
errordump-cpp-pagerank.log
i2millig@camalon00:~/spark-1.5.1-bin-hadoop2.6/bin$ spark-shell --jars ~/warcbase/target/warcbase-0.1.0-SNAPSHOT-fatjar.jar --num-executors 75 --executor-cores 5 --executor-memory 15G --driver-memory 30G
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.3.0
/_/
Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_71)
Type in expressions to have them evaluated.
Type :help for more information.
Spark context available as sc.
SQL context available as sqlContext.
scala> :paste
// Entering paste mode (ctrl-D to finish)
import org.warcbase.spark.rdd.RecordRDD._
import org.warcbase.spark.matchbox.RecordLoader
import org.warcbase.spark.matchbox.ExtractGraph
val a=RecordLoader.loadArchives("/collections/webarchives/CanadianPoliticalParties/arc", sc)
var b=RecordLoader.loadArchives("/collections/webarchives/CanadianPoliticalParties/warc", sc)
var recs=a.union(b)
val graph = ExtractGraph(recs)
graph.writeAsJson("nodes-cpp-all", "links-cpp-all")
// Exiting paste mode, now interpreting.
[Stage 2227:=====> (577 + 374) / 3569][Stage 2272:> (0 + 1) / 3569]WARN DFSClient - DFSOutputStream ResponseProcessor exception for block BP-1487733066-192.168.74.139-1432156431449:blk_1084878595_11139916
java.io.EOFException: Premature EOF: no length prefix available
at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2214)
at org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:176)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:879)
WARN DFSClient - Error Recovery for block BP-1487733066-192.168.74.139-1432156431449:blk_1084878595_11139916 in pipeline DatanodeInfoWithStorage[192.168.74.205:50010,DS-f0aee742-3798-47ef-84aa-73745a5c0626,DISK], DatanodeInfoWithStorage[192.168.74.218:50010,DS-11fe56c8-f34b-45d3-adb0-069afd748960,DISK], DatanodeInfoWithStorage[192.168.74.210:50010,DS-67e8dab1-fbed-41e6-a72e-6e656f7bfbd8,DISK]: bad datanode DatanodeInfoWithStorage[192.168.74.205:50010,DS-f0aee742-3798-47ef-84aa-73745a5c0626,DISK]
[Stage 2272:=====================> (840 + 278) / 3569]
i2millig@camalon00:~/spark-1.5.1-bin-hadoop2.6/bin$ spark-shell --jars ~/warcbase/target/warcbase-0.1.0-SNAPSHOT-fatjar.jar --num-executors 75 --executor-cores 5 --executor-memory 25G --driver-memory 30G
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.3.0
/_/
Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_71)
Type in expressions to have them evaluated.
Type :help for more information.
Spark context available as sc.
SQL context available as sqlContext.
scala>
scala> :paste
// Entering paste mode (ctrl-D to finish)
import org.warcbase.spark.rdd.RecordRDD._
import org.warcbase.spark.matchbox.RecordLoader
import org.warcbase.spark.matchbox.ExtractGraph
val a=RecordLoader.loadArchives("/collections/webarchives/CanadianPoliticalParties/arc", sc)
var b=RecordLoader.loadArchives("/collections/webarchives/CanadianPoliticalParties/warc", sc)
var recs=a.union(b)
val graph = ExtractGraph(recs)
graph.writeAsJson("nodes-cpp-all", "links-cpp-all")
// Exiting paste mode, now interpreting.
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(5, trantor11.umiacs.umd.edu, 38228) with no recent heart beats: 159775ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(23, trantor02.umiacs.umd.edu, 39343) with no recent heart beats: 162016ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(71, trantor22.umiacs.umd.edu, 40304) with no recent heart beats: 158702ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(50, trantor18.umiacs.umd.edu, 58586) with no recent heart beats: 159558ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(30, trantor01.umiacs.umd.edu, 53226) with no recent heart beats: 160305ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(7, trantor11.umiacs.umd.edu, 52630) with no recent heart beats: 161461ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(4, trantor04.umiacs.umd.edu, 40743) with no recent heart beats: 161014ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(9, trantor03.umiacs.umd.edu, 46914) with no recent heart beats: 159937ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(70, trantor22.umiacs.umd.edu, 52799) with no recent heart beats: 160869ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(44, trantor17.umiacs.umd.edu, 58396) with no recent heart beats: 161997ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(1, trantor04.umiacs.umd.edu, 48119) with no recent heart beats: 165571ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(68, trantor19.umiacs.umd.edu, 54930) with no recent heart beats: 160346ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(14, trantor07.umiacs.umd.edu, 35118) with no recent heart beats: 159677ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(48, trantor24.umiacs.umd.edu, 47413) with no recent heart beats: 159985ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(41, trantor17.umiacs.umd.edu, 35674) with no recent heart beats: 161964ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(54, trantor16.umiacs.umd.edu, 43251) with no recent heart beats: 165572ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(34, trantor09.umiacs.umd.edu, 37861) with no recent heart beats: 158800ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(40, trantor00.umiacs.umd.edu, 52789) with no recent heart beats: 165573ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(57, trantor23.umiacs.umd.edu, 44626) with no recent heart beats: 165573ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(11, trantor03.umiacs.umd.edu, 41472) with no recent heart beats: 158451ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(16, trantor07.umiacs.umd.edu, 51834) with no recent heart beats: 165572ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(10, trantor03.umiacs.umd.edu, 54227) with no recent heart beats: 160788ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(52, trantor18.umiacs.umd.edu, 54661) with no recent heart beats: 161989ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(73, trantor14.umiacs.umd.edu, 48144) with no recent heart beats: 165572ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(28, trantor08.umiacs.umd.edu, 37958) with no recent heart beats: 161661ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(8, trantor11.umiacs.umd.edu, 40233) with no recent heart beats: 162003ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(18, trantor10.umiacs.umd.edu, 44849) with no recent heart beats: 161946ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(17, trantor10.umiacs.umd.edu, 50983) with no recent heart beats: 162020ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(58, trantor23.umiacs.umd.edu, 39831) with no recent heart beats: 161994ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(60, trantor23.umiacs.umd.edu, 44852) with no recent heart beats: 161014ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(56, trantor16.umiacs.umd.edu, 34012) with no recent heart beats: 165571ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(66, trantor19.umiacs.umd.edu, 49433) with no recent heart beats: 159266ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(25, trantor08.umiacs.umd.edu, 59470) with no recent heart beats: 161995ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(67, trantor19.umiacs.umd.edu, 57893) with no recent heart beats: 165573ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(62, trantor15.umiacs.umd.edu, 40760) with no recent heart beats: 162003ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(43, trantor17.umiacs.umd.edu, 55913) with no recent heart beats: 162002ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(26, trantor08.umiacs.umd.edu, 33792) with no recent heart beats: 161845ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(22, trantor02.umiacs.umd.edu, 46032) with no recent heart beats: 158926ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(45, trantor24.umiacs.umd.edu, 39697) with no recent heart beats: 165572ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(65, trantor19.umiacs.umd.edu, 57738) with no recent heart beats: 159887ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(63, trantor15.umiacs.umd.edu, 40544) with no recent heart beats: 165573ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(31, trantor01.umiacs.umd.edu, 56816) with no recent heart beats: 161149ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(24, trantor02.umiacs.umd.edu, 50131) with no recent heart beats: 162010ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(35, trantor09.umiacs.umd.edu, 58761) with no recent heart beats: 162008ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(3, trantor04.umiacs.umd.edu, 60731) with no recent heart beats: 160921ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(36, trantor09.umiacs.umd.edu, 52639) with no recent heart beats: 160171ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(6, trantor11.umiacs.umd.edu, 38788) with no recent heart beats: 161970ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(69, trantor22.umiacs.umd.edu, 38323) with no recent heart beats: 158453ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(21, trantor02.umiacs.umd.edu, 34063) with no recent heart beats: 161917ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(38, trantor00.umiacs.umd.edu, 52489) with no recent heart beats: 160840ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(19, trantor10.umiacs.umd.edu, 52665) with no recent heart beats: 161953ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(15, trantor07.umiacs.umd.edu, 56995) with no recent heart beats: 159500ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(39, trantor00.umiacs.umd.edu, 46914) with no recent heart beats: 165607ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(27, trantor08.umiacs.umd.edu, 56415) with no recent heart beats: 161083ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(55, trantor16.umiacs.umd.edu, 55526) with no recent heart beats: 160502ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(2, trantor04.umiacs.umd.edu, 56227) with no recent heart beats: 158435ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(72, trantor22.umiacs.umd.edu, 46971) with no recent heart beats: 165571ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(12, trantor03.umiacs.umd.edu, 45872) with no recent heart beats: 161329ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(47, trantor24.umiacs.umd.edu, 50354) with no recent heart beats: 162034ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(75, trantor14.umiacs.umd.edu, 39583) with no recent heart beats: 158545ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(20, trantor10.umiacs.umd.edu, 59902) with no recent heart beats: 162040ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(29, trantor01.umiacs.umd.edu, 47195) with no recent heart beats: 159498ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(42, trantor17.umiacs.umd.edu, 54638) with no recent heart beats: 161973ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(49, trantor18.umiacs.umd.edu, 51912) with no recent heart beats: 160288ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(51, trantor18.umiacs.umd.edu, 59023) with no recent heart beats: 159403ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(53, trantor16.umiacs.umd.edu, 43713) with no recent heart beats: 158765ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(64, trantor15.umiacs.umd.edu, 49024) with no recent heart beats: 162002ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(37, trantor00.umiacs.umd.edu, 49471) with no recent heart beats: 165573ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(33, trantor09.umiacs.umd.edu, 36397) with no recent heart beats: 161965ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(74, trantor14.umiacs.umd.edu, 35886) with no recent heart beats: 162041ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(59, trantor23.umiacs.umd.edu, 43370) with no recent heart beats: 161136ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(13, trantor07.umiacs.umd.edu, 39359) with no recent heart beats: 161772ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(61, trantor15.umiacs.umd.edu, 42436) with no recent heart beats: 159672ms exceeds 120000ms
WARN BlockManagerMasterActor - Removing BlockManager BlockManagerId(32, trantor01.umiacs.umd.edu, 47107) with no recent heart beats: 165572ms exceeds 120000ms
WARN DFSClient - DataStreamer Exception
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:656)
WARN DFSClient - Slow ReadProcessor read fields took 166364ms (threshold=30000ms); ack: seqno: -2 status: SUCCESS status: SUCCESS status: ERROR downstreamAckTimeNanos: 0, targets: [DatanodeInfoWithStorage[192.168.74.217:50010,DS-1025e55c-d171-4a50-b8a7-a5540438f833,DISK], DatanodeInfoWithStorage[192.168.74.221:50010,DS-50ccfe99-d11b-43c7-974b-ca77751a0084,DISK], DatanodeInfoWithStorage[192.168.74.214:50010,DS-0e6dd361-5836-4f12-b5fd-8f743a826314,DISK]]
WARN DFSClient - Error Recovery for block BP-1487733066-192.168.74.139-1432156431449:blk_1084878907_11140230 in pipeline DatanodeInfoWithStorage[192.168.74.217:50010,DS-1025e55c-d171-4a50-b8a7-a5540438f833,DISK], DatanodeInfoWithStorage[192.168.74.221:50010,DS-50ccfe99-d11b-43c7-974b-ca77751a0084,DISK], DatanodeInfoWithStorage[192.168.74.214:50010,DS-0e6dd361-5836-4f12-b5fd-8f743a826314,DISK]: bad datanode DatanodeInfoWithStorage[192.168.74.214:50010,DS-0e6dd361-5836-4f12-b5fd-8f743a826314,DISK]
[Stage 2664:================> (1277 + 374) / 3569][Stage 2712:> (0 + 1) / 3569]
i2millig@camalon00:~/spark-1.5.1-bin-hadoop2.6/bin$ spark-shell --jars ~/warcbase/target/warcbase-0.1.0-SNAPSHOT-fatjar.jar --num-executors 75 --executor-cores 5 --executor-memory 25G --driver-memory 30G
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.3.0
/_/
Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_71)
Type in expressions to have them evaluated.
Type :help for more information.
Spark context available as sc.
SQL context available as sqlContext.
scala> :paste
// Entering paste mode (ctrl-D to finish)
import org.warcbase.spark.rdd.RecordRDD._
import org.warcbase.spark.matchbox.RecordLoader
import org.warcbase.spark.matchbox.ExtractGraph
val a=RecordLoader.loadArchives("/collections/webarchives/CanadianPoliticalParties/arc", sc)
var b=RecordLoader.loadArchives("/collections/webarchives/CanadianPoliticalParties/warc", sc)
var recs=a.union(b)
val graph = ExtractGraph(recs)
graph.writeAsJson("nodes-cpp-all", "links-cpp-all")
// Exiting paste mode, now interpreting.
WARN DFSClient - Slow ReadProcessor read fields took 60828ms (threshold=30000ms); ack: seqno: -2 status: SUCCESS status: ERROR downstreamAckTimeNanos: 0, targets: [DatanodeInfoWithStorage[192.168.74.212:50010,DS-b7463506-b431-4d53-9259-9cd450f109fc,DISK], DatanodeInfoWithStorage[192.168.74.203:50010,DS-12b38a90-c236-4394-8fe9-fc22ea57e61f,DISK], DatanodeInfoWithStorage[192.168.74.222:50010,DS-12bd03fe-4763-4110-b8d7-bd9873d15c65,DISK]]
WARN DFSClient - DFSOutputStream ResponseProcessor exception for block BP-1487733066-192.168.74.139-1432156431449:blk_1084879111_11140436
java.io.IOException: Bad response ERROR for block BP-1487733066-192.168.74.139-1432156431449:blk_1084879111_11140436 from datanode DatanodeInfoWithStorage[192.168.74.203:50010,DS-12b38a90-c236-4394-8fe9-fc22ea57e61f,DISK]
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:909)
WARN DFSClient - Error Recovery for block BP-1487733066-192.168.74.139-1432156431449:blk_1084879111_11140436 in pipeline DatanodeInfoWithStorage[192.168.74.212:50010,DS-b7463506-b431-4d53-9259-9cd450f109fc,DISK], DatanodeInfoWithStorage[192.168.74.203:50010,DS-12b38a90-c236-4394-8fe9-fc22ea57e61f,DISK], DatanodeInfoWithStorage[192.168.74.222:50010,DS-12bd03fe-4763-4110-b8d7-bd9873d15c65,DISK]: bad datanode DatanodeInfoWithStorage[192.168.74.203:50010,DS-12b38a90-c236-4394-8fe9-fc22ea57e61f,DISK]
[Stage 1500:===================================> (2789 + 276) / 3569][Stage 1539:> (0 + 99) / 3569]WARN DFSClient - DFSOutputStream ResponseProcessor exception for block BP-1487733066-192.168.74.139-1432156431449:blk_1084879111_11140504
java.io.EOFException: Premature EOF: no length prefix available
at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2214)
at org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:176)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:879)
WARN DFSClient - Error Recovery for block BP-1487733066-192.168.74.139-1432156431449:blk_1084879111_11140504 in pipeline DatanodeInfoWithStorage[192.168.74.212:50010,DS-b7463506-b431-4d53-9259-9cd450f109fc,DISK], DatanodeInfoWithStorage[192.168.74.222:50010,DS-12bd03fe-4763-4110-b8d7-bd9873d15c65,DISK], DatanodeInfoWithStorage[192.168.74.207:50010,DS-45d29e90-b75e-4335-9a93-33577e7b7a71,DISK]: bad datanode DatanodeInfoWithStorage[192.168.74.212:50010,DS-b7463506-b431-4d53-9259-9cd450f109fc,DISK]
[Stage 1540:=> (31 + 375) / 3569]i2millig@camalon00:~/spark-1.5.1-bin-hadoop2.6/bin$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment