Skip to content

Instantly share code, notes, and snippets.

@ryan-williams

ryan-williams/YARN mode, cached RDD, dies Secret

Last active August 9, 2017 16:47
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ryan-williams/a3d02ea49d2b5021b53e1680f8fedc37 to your computer and use it in GitHub Desktop.
Save ryan-williams/a3d02ea49d2b5021b53e1680f8fedc37 to your computer and use it in GitHub Desktop.
Download ZIP
Spark 2.2.0 large-RDD-caching driver-GC-death
Raw
local mode, rdd cached, crashes
scala> rdd.cache
res1: rdd.type = ParallelCollectionRDD[0] at parallelize at <console>:24
scala> rdd.count
78.788: [GC (Allocation Failure) [PSYoungGen: 324768K->21994K(300544K)] 586186K->318057K(597504K), 0.0948005 secs] [Times: user=0.23 sys=0.02, real=0.09 secs]
78.883: [Full GC (Ergonomics) [PSYoungGen: 21994K->0K(300544K)] [ParOldGen: 296062K->206914K(361984K)] 318057K->206914K(662528K), [Metaspace: 98793K->98775K(1136640K)], 0.8616315 secs] [Times: user=1.94 sys=0.03, real=0.86 secs]
[Stage 1:> (1154 + 4) / 100000]80.404: [GC (Allocation Failure) [PSYoungGen: 278528K->5888K(284672K)] 485442K->212810K(646656K), 0.0079790 secs] [Times: user=0.02 sys=0.00, real=0.01 secs]
[Stage 1:> (1931 + 4) / 100000]80.876: [GC (Allocation Failure) [PSYoungGen: 284416K->14880K(312320K)] 491338K->221810K(674304K), 0.0117714 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
[Stage 1:=> (2829 + 5) / 100000]81.301: [GC (Allocation Failure) [PSYoungGen: 289824K->28336K(303616K)] 496754K->235266K(665600K), 0.0203044 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 1:=> (3728 + 5) / 100000]81.686: [GC (Allocation Failure) [PSYoungGen: 303280K->37872K(296960K)] 510210K->251696K(658944K), 0.0353922 secs] [Times: user=0.10 sys=0.00, real=0.03 secs]
[Stage 1:==> (4654 + 4) / 100000]82.046: [GC (Allocation Failure) [PSYoungGen: 296944K->45040K(304128K)] 510768K->267128K(666112K), 0.0459816 secs] [Times: user=0.14 sys=0.00, real=0.04 secs]
[Stage 1:==> (5525 + 6) / 100000]82.455: [GC (Allocation Failure) [PSYoungGen: 304112K->45049K(265216K)] 526200K->285340K(627200K), 0.0553350 secs] [Times: user=0.19 sys=0.00, real=0.06 secs]
[Stage 1:==> (5860 + 5) / 100000]82.779: [GC (Allocation Failure) [PSYoungGen: 265209K->62814K(283136K)] 505500K->303106K(645120K), 0.0641414 secs] [Times: user=0.21 sys=0.00, real=0.06 secs]
[Stage 1:===> (6873 + 4) / 100000]83.118: [GC (Allocation Failure) [PSYoungGen: 282974K->66031K(241152K)] 523266K->321880K(603136K), 0.0845851 secs] [Times: user=0.26 sys=0.00, real=0.08 secs]
[Stage 1:===> (7149 + 4) / 100000]83.415: [GC (Allocation Failure) [PSYoungGen: 241135K->82050K(257536K)] 496984K->337900K(619520K), 0.0999176 secs] [Times: user=0.35 sys=0.00, real=0.10 secs]
[Stage 1:===> (7587 + 4) / 100000]83.692: [GC (Allocation Failure) [PSYoungGen: 257154K->91635K(213504K)] 513004K->354647K(575488K), 0.1089324 secs] [Times: user=0.35 sys=0.00, real=0.11 secs]
[Stage 1:====> (8113 + 4) / 100000]83.974: [GC (Allocation Failure) [PSYoungGen: 213491K->91074K(212992K)] 476503K->365275K(574976K), 0.0898479 secs] [Times: user=0.29 sys=0.01, real=0.09 secs]
[Stage 1:====> (8472 + 4) / 100000]84.199: [GC (Allocation Failure) [PSYoungGen: 212930K->87940K(232960K)] 487131K->376490K(594944K), 0.0740012 secs] [Times: user=0.26 sys=0.00, real=0.07 secs]
[Stage 1:====> (8829 + 4) / 100000]84.398: [GC (Allocation Failure) [PSYoungGen: 204676K->84129K(232960K)] 493226K->388063K(594944K), 0.0621309 secs] [Times: user=0.20 sys=0.01, real=0.06 secs]
[Stage 1:====> (9209 + 4) / 100000]84.599: [GC (Allocation Failure) [PSYoungGen: 200865K->67689K(232960K)] 504799K->401956K(594944K), 0.0732375 secs] [Times: user=0.17 sys=0.01, real=0.07 secs]
84.672: [Full GC (Ergonomics) [PSYoungGen: 67689K->36812K(232960K)] [ParOldGen: 334266K->361813K(553984K)] 401956K->398626K(786944K), [Metaspace: 99203K->99203K(1136640K)], 3.5550402 secs] [Times: user=11.18 sys=0.08, real=3.56 secs]
[Stage 1:====> (9504 + 4) / 100000]88.390: [GC (Allocation Failure) [PSYoungGen: 153548K->27370K(232960K)] 515362K->412365K(786944K), 0.1001566 secs] [Times: user=0.30 sys=0.01, real=0.10 secs]
[Stage 1:=====> (9840 + 4) / 100000]88.638: [GC (Allocation Failure) [PSYoungGen: 144106K->27291K(232960K)] 529101K->425917K(786944K), 0.0314967 secs] [Times: user=0.09 sys=0.00, real=0.03 secs]
[Stage 1:=====> (10241 + 4) / 100000]88.800: [GC (Allocation Failure) [PSYoungGen: 144027K->27804K(232960K)] 542653K->439962K(786944K), 0.0321496 secs] [Times: user=0.09 sys=0.01, real=0.03 secs]
[Stage 1:=====> (10579 + 4) / 100000]89.000: [GC (Allocation Failure) [PSYoungGen: 144540K->14473K(232960K)] 556698K->454162K(786944K), 0.0348107 secs] [Times: user=0.10 sys=0.02, real=0.03 secs]
[Stage 1:=====> (10991 + 4) / 100000]89.154: [GC (Allocation Failure) [PSYoungGen: 131209K->14880K(232960K)] 570898K->468777K(786944K), 0.0301174 secs] [Times: user=0.09 sys=0.01, real=0.03 secs]
[Stage 1:=====> (11355 + 4) / 100000]89.360: [GC (Allocation Failure) [PSYoungGen: 131616K->15181K(232960K)] 585513K->483675K(786944K), 0.0298024 secs] [Times: user=0.07 sys=0.01, real=0.03 secs]
[Stage 1:=====> (11767 + 5) / 100000]89.518: [GC (Allocation Failure) [PSYoungGen: 131917K->15570K(132608K)] 600411K->499016K(686592K), 0.0316168 secs] [Times: user=0.08 sys=0.01, real=0.03 secs]
89.697: [GC (Allocation Failure) [PSYoungGen: 132297K->15646K(233984K)] 615744K->514360K(787968K), 0.0372304 secs] [Times: user=0.09 sys=0.02, real=0.03 secs]
[Stage 1:======> (12119 + 4) / 100000]89.884: [GC (Allocation Failure) [PSYoungGen: 135949K->16436K(230400K)] 634663K->530589K(784384K), 0.0452317 secs] [Times: user=0.10 sys=0.01, real=0.05 secs]
[Stage 1:======> (12455 + 4) / 100000]90.062: [GC (Allocation Failure) [PSYoungGen: 136756K->16919K(235008K)] 650909K->547244K(788992K), 0.0411438 secs] [Times: user=0.08 sys=0.01, real=0.04 secs]
90.103: [Full GC (Ergonomics) [PSYoungGen: 16919K->0K(235008K)] [ParOldGen: 530324K->546104K(699392K)] 547244K->546104K(934400K), [Metaspace: 99204K->99204K(1136640K)], 3.5972605 secs] [Times: user=11.85 sys=0.10, real=3.60 secs]
[Stage 1:======> (12752 + 4) / 100000]93.848: [GC (Allocation Failure) [PSYoungGen: 129513K->18640K(231424K)] 675617K->564745K(930816K), 0.0309081 secs] [Times: user=0.03 sys=0.00, real=0.03 secs]
[Stage 1:======> (13162 + 4) / 100000]94.022: [GC (Allocation Failure) [PSYoungGen: 148176K->37112K(226816K)] 694281K->583217K(926208K), 0.0152415 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
[Stage 1:======> (13604 + 4) / 100000]94.198: [GC (Allocation Failure) [PSYoungGen: 175352K->57160K(231424K)] 721457K->603265K(930816K), 0.0235274 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 1:=======> (14010 + 4) / 100000]94.371: [GC (Allocation Failure) [PSYoungGen: 195399K->77732K(233472K)] 741504K->623837K(932864K), 0.0260517 secs] [Times: user=0.09 sys=0.00, real=0.03 secs]
[Stage 1:=======> (14427 + 4) / 100000]94.555: [GC (Allocation Failure) [PSYoungGen: 214930K->98402K(236032K)] 761034K->644507K(935424K), 0.0329536 secs] [Times: user=0.11 sys=0.00, real=0.03 secs]
[Stage 1:=======> (14820 + 4) / 100000]94.736: [GC (Allocation Failure) [PSYoungGen: 235618K->82014K(229888K)] 781723K->664970K(929280K), 0.0756529 secs] [Times: user=0.14 sys=0.03, real=0.07 secs]
[Stage 1:=======> (15043 + 5) / 100000]94.963: [GC (Allocation Failure) [PSYoungGen: 198750K->59552K(232960K)] 781706K->683165K(932352K), 0.1079234 secs] [Times: user=0.14 sys=0.03, real=0.11 secs]
[Stage 1:=======> (15217 + 4) / 100000]95.270: [GC (Allocation Failure) [PSYoungGen: 176256K->36726K(232960K)] 799869K->701447K(932352K), 0.0945063 secs] [Times: user=0.12 sys=0.05, real=0.09 secs]
95.365: [Full GC (Ergonomics) [PSYoungGen: 36726K->1861K(232960K)] [ParOldGen: 664720K->698919K(699392K)] 701447K->700780K(932352K), [Metaspace: 99204K->99204K(1136640K)], 6.2380988 secs] [Times: user=19.06 sys=0.43, real=6.24 secs]
[Stage 1:=======> (15470 + 4) / 100000]101.731: [Full GC (Ergonomics) [PSYoungGen: 118597K->19976K(232960K)] [ParOldGen: 698919K->699367K(699392K)] 817516K->719343K(932352K), [Metaspace: 99205K->99205K(1136640K)], 1.7315721 secs] [Times: user=5.51 sys=0.07, real=1.73 secs]
[Stage 1:=======> (15765 + 4) / 100000]103.579: [Full GC (Ergonomics) [PSYoungGen: 116736K->35443K(232960K)] [ParOldGen: 699367K->699362K(699392K)] 816103K->734805K(932352K), [Metaspace: 99205K->99205K(1136640K)], 1.7665122 secs] [Times: user=5.50 sys=0.07, real=1.77 secs]
[Stage 1:========> (16008 + 4) / 100000]105.440: [Full GC (Ergonomics) [PSYoungGen: 116736K->48689K(232960K)] [ParOldGen: 699362K->699358K(699392K)] 816098K->748047K(932352K), [Metaspace: 99205K->99205K(1136640K)], 1.7982144 secs] [Times: user=5.64 sys=0.06, real=1.80 secs]
[Stage 1:========> (16212 + 4) / 100000]107.322: [Full GC (Ergonomics) [PSYoungGen: 116736K->59869K(232960K)] [ParOldGen: 699358K->699355K(699392K)] 816094K->759225K(932352K), [Metaspace: 99205K->99205K(1136640K)], 1.7191117 secs] [Times: user=5.61 sys=0.06, real=1.72 secs]
[Stage 1:========> (16383 + 4) / 100000]109.154: [Full GC (Ergonomics) [PSYoungGen: 116736K->69267K(232960K)] [ParOldGen: 699355K->699353K(699392K)] 816091K->768620K(932352K), [Metaspace: 99205K->99205K(1136640K)], 1.8910002 secs] [Times: user=5.45 sys=0.06, real=1.90 secs]
[Stage 1:========> (16525 + 4) / 100000]111.150: [Full GC (Ergonomics) [PSYoungGen: 116736K->76950K(232960K)] [ParOldGen: 699353K->699350K(699392K)] 816089K->776301K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.7884646 secs] [Times: user=5.91 sys=0.05, real=1.79 secs]
[Stage 1:========> (16642 + 7) / 100000]112.999: [Full GC (Ergonomics) [PSYoungGen: 116736K->83678K(232960K)] [ParOldGen: 699350K->699349K(699392K)] 816086K->783027K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.7372197 secs] [Times: user=5.73 sys=0.06, real=1.74 secs]
[Stage 1:========> (16742 + 6) / 100000]114.781: [Full GC (Ergonomics) [PSYoungGen: 116736K->89375K(232960K)] [ParOldGen: 699349K->699347K(699392K)] 816085K->788723K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.9858331 secs] [Times: user=6.13 sys=0.08, real=1.99 secs]
[Stage 1:========> (16825 + 4) / 100000]116.808: [Full GC (Ergonomics) [PSYoungGen: 116736K->93776K(232960K)] [ParOldGen: 699347K->699346K(699392K)] 816083K->793122K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.7361219 secs] [Times: user=5.59 sys=0.06, real=1.74 secs]
[Stage 1:========> (16892 + 5) / 100000]118.597: [Full GC (Ergonomics) [PSYoungGen: 116736K->97853K(232960K)] [ParOldGen: 699346K->699345K(699392K)] 816082K->797198K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.9575472 secs] [Times: user=6.43 sys=0.05, real=1.96 secs]
[Stage 1:========> (16950 + 5) / 100000]120.605: [Full GC (Ergonomics) [PSYoungGen: 116736K->100989K(232960K)] [ParOldGen: 699345K->699345K(699392K)] 816081K->800334K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.7164228 secs] [Times: user=5.66 sys=0.06, real=1.71 secs]
[Stage 1:========> (16997 + 4) / 100000]122.337: [Full GC (Ergonomics) [PSYoungGen: 116736K->103541K(232960K)] [ParOldGen: 699345K->699344K(699392K)] 816081K->802886K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.7157422 secs] [Times: user=5.60 sys=0.06, real=1.71 secs]
[Stage 1:========> (17035 + 5) / 100000]124.080: [Full GC (Ergonomics) [PSYoungGen: 116736K->105839K(232960K)] [ParOldGen: 699344K->699344K(699392K)] 816080K->805183K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.6984478 secs] [Times: user=5.51 sys=0.06, real=1.70 secs]
[Stage 1:========> (17068 + 4) / 100000]125.795: [Full GC (Ergonomics) [PSYoungGen: 116736K->107612K(232960K)] [ParOldGen: 699344K->699343K(699392K)] 816080K->806956K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.8366039 secs] [Times: user=5.90 sys=0.05, real=1.83 secs]
[Stage 1:========> (17094 + 4) / 100000]127.645: [Full GC (Ergonomics) [PSYoungGen: 116736K->109178K(232960K)] [ParOldGen: 699343K->699342K(699392K)] 816079K->808521K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.8208202 secs] [Times: user=5.75 sys=0.07, real=1.82 secs]
[Stage 1:========> (17117 + 4) / 100000]129.480: [Full GC (Ergonomics) [PSYoungGen: 116736K->110470K(232960K)] [ParOldGen: 699342K->699342K(699392K)] 816078K->809812K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.7057271 secs] [Times: user=5.57 sys=0.06, real=1.71 secs]
[Stage 1:========> (17135 + 5) / 100000]131.192: [Full GC (Ergonomics) [PSYoungGen: 116736K->111563K(232960K)] [ParOldGen: 699342K->699342K(699392K)] 816078K->810905K(932352K), [Metaspace: 99211K->99211K(1136640K)], 2.0943043 secs] [Times: user=6.83 sys=0.07, real=2.10 secs]
[Stage 1:========> (17151 + 5) / 100000]133.292: [Full GC (Ergonomics) [PSYoungGen: 116736K->112364K(232960K)] [ParOldGen: 699342K->699341K(699392K)] 816078K->811706K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.7910127 secs] [Times: user=5.66 sys=0.07, real=1.79 secs]
[Stage 1:========> (17163 + 4) / 100000]135.087: [Full GC (Ergonomics) [PSYoungGen: 116736K->113082K(232960K)] [ParOldGen: 699341K->699341K(699392K)] 816077K->812424K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.8015113 secs] [Times: user=5.56 sys=0.06, real=1.80 secs]
[Stage 1:========> (17174 + 7) / 100000]136.893: [Full GC (Ergonomics) [PSYoungGen: 116736K->113704K(232960K)] [ParOldGen: 699341K->699340K(699392K)] 816077K->813045K(932352K), [Metaspace: 99211K->99211K(1136640K)], 2.2839628 secs] [Times: user=7.49 sys=0.08, real=2.29 secs]
[Stage 1:========> (17183 + 5) / 100000]139.182: [Full GC (Ergonomics) [PSYoungGen: 116736K->114358K(232960K)] [ParOldGen: 699340K->699340K(699392K)] 816076K->813699K(932352K), [Metaspace: 99211K->99211K(1136640K)], 2.3825640 secs] [Times: user=5.84 sys=0.11, real=2.39 secs]
[Stage 1:========> (17191 + 4) / 100000]141.573: [Full GC (Ergonomics) [PSYoungGen: 116736K->114595K(232960K)] [ParOldGen: 699340K->699336K(699392K)] 816076K->813931K(932352K), [Metaspace: 99211K->99211K(1136640K)], 1.7259434 secs] [Times: user=5.54 sys=0.06, real=1.73 secs]
[Stage 1:========> (17199 + 4) / 100000]143.302: [Full GC (Ergonomics) [PSYoungGen: 116736K->114916K(232960K)] [ParOldGen: 699336K->699336K(699392K)] 816072K->814252K(932352K), [Metaspace: 99211K->99211K(1136640K)], 2.2280486 secs] [Times: user=5.80 sys=0.09, real=2.23 secs]
[Stage 1:========> (17201 + 6) / 100000]145.533: [Full GC (Ergonomics) [PSYoungGen: 116736K->115353K(232960K)] [ParOldGen: 699336K->699335K(699392K)] 816072K->814688K(932352K), [Metaspace: 99211K->99211K(1136640K)], 3.0769665 secs] [Times: user=4.60 sys=0.07, real=3.07 secs]
[Stage 1:========> (17206 + 4) / 100000]148.617: [Full GC (Ergonomics) [PSYoungGen: 116736K->115604K(232960K)] [ParOldGen: 699335K->699335K(699392K)] 816071K->814939K(932352K), [Metaspace: 99211K->99211K(1136640K)], 5.1047058 secs] [Times: user=3.78 sys=0.05, real=5.10 secs]
[Stage 1:========> (17210 + 4) / 100000]153.723: [Full GC (Ergonomics) [PSYoungGen: 116736K->115879K(232960K)] [ParOldGen: 699335K->699335K(699392K)] 816071K->815214K(932352K), [Metaspace: 99211K->99211K(1136640K)], 3.6402733 secs] [Times: user=3.82 sys=0.06, real=3.64 secs]
[Stage 1:========> (17213 + 4) / 100000]157.367: [Full GC (Ergonomics) [PSYoungGen: 116736K->115903K(232960K)] [ParOldGen: 699335K->699334K(699392K)] 816071K->815238K(932352K), [Metaspace: 99211K->99211K(1136640K)], 3.7300383 secs] [Times: user=4.41 sys=0.09, real=3.73 secs]
[Stage 1:========> (17216 + 4) / 100000]161.100: [Full GC (Ergonomics) [PSYoungGen: 116736K->116114K(232960K)] [ParOldGen: 699334K->699334K(699392K)] 816070K->815449K(932352K), [Metaspace: 99211K->99211K(1136640K)], 2.8068111 secs] [Times: user=4.09 sys=0.06, real=2.81 secs]
163.913: [Full GC (Ergonomics) [PSYoungGen: 116735K->116075K(232960K)] [ParOldGen: 699334K->699333K(699392K)] 816070K->815409K(932352K), [Metaspace: 99213K->99213K(1136640K)], 2.6733317 secs] [Times: user=5.12 sys=0.08, real=2.67 secs]
[Stage 1:========> (17217 + 5) / 100000]166.588: [Full GC (Ergonomics) [PSYoungGen: 116736K->116225K(232960K)] [ParOldGen: 699333K->699333K(699392K)] 816069K->815559K(932352K), [Metaspace: 99213K->99213K(1136640K)], 2.5347543 secs] [Times: user=5.28 sys=0.09, real=2.54 secs]
[Stage 1:========> (17219 + 6) / 100000]169.124: [Full GC (Ergonomics) [PSYoungGen: 116736K->116431K(232960K)] [ParOldGen: 699333K->699333K(699392K)] 816069K->815764K(932352K), [Metaspace: 99213K->99213K(1136640K)], 2.2105255 secs] [Times: user=3.47 sys=0.04, real=2.21 secs]
[Stage 1:========> (17221 + 4) / 100000]171.337: [Full GC (Ergonomics) [PSYoungGen: 116736K->116365K(232960K)] [ParOldGen: 699333K->699332K(699392K)] 816069K->815698K(932352K), [Metaspace: 99213K->99213K(1136640K)], 3.1715539 secs] [Times: user=5.59 sys=0.10, real=3.17 secs]
174.509: [Full GC (Ergonomics) [PSYoungGen: 116735K->116448K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->815781K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.8182382 secs] [Times: user=4.02 sys=0.06, real=1.82 secs]
176.329: [Full GC (Ergonomics) [PSYoungGen: 116723K->116514K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816056K->815847K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.5866664 secs] [Times: user=4.20 sys=0.08, real=1.59 secs]
177.916: [Full GC (Ergonomics) [PSYoungGen: 116736K->116459K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->815791K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.8177159 secs] [Times: user=5.46 sys=0.07, real=1.82 secs]
[Stage 1:========> (17223 + 5) / 100000]179.735: [Full GC (Ergonomics) [PSYoungGen: 116736K->116500K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->815832K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.9762655 secs] [Times: user=5.37 sys=0.09, real=1.97 secs]
181.713: [Full GC (Ergonomics) [PSYoungGen: 116736K->116585K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->815918K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.2955016 secs] [Times: user=3.62 sys=0.03, real=1.29 secs]
183.009: [Full GC (Ergonomics) [PSYoungGen: 116730K->116579K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816062K->815911K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.1897627 secs] [Times: user=3.63 sys=0.03, real=1.19 secs]
[Stage 1:========> (17225 + 5) / 100000]184.200: [Full GC (Ergonomics) [PSYoungGen: 116736K->116606K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->815939K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.7657518 secs] [Times: user=5.50 sys=0.07, real=1.77 secs]
185.967: [Full GC (Ergonomics) [PSYoungGen: 116682K->116606K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816014K->815939K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.1646645 secs] [Times: user=3.54 sys=0.02, real=1.17 secs]
187.133: [Full GC (Ergonomics) [PSYoungGen: 116736K->116673K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->816005K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.0711736 secs] [Times: user=3.59 sys=0.03, real=1.07 secs]
188.205: [Full GC (Ergonomics) [PSYoungGen: 116736K->116684K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->816017K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.2276602 secs] [Times: user=3.59 sys=0.03, real=1.23 secs]
189.433: [Full GC (Ergonomics) [PSYoungGen: 116736K->116684K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->816017K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.0800265 secs] [Times: user=3.56 sys=0.02, real=1.08 secs]
190.514: [Full GC (Ergonomics) [PSYoungGen: 116736K->116691K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->816024K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.0915711 secs] [Times: user=3.61 sys=0.03, real=1.09 secs]
191.607: [Full GC (Ergonomics) [PSYoungGen: 116736K->116710K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->816043K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.7919598 secs] [Times: user=5.52 sys=0.06, real=1.79 secs]
193.399: [Full GC (Ergonomics) [PSYoungGen: 116736K->116717K(232960K)] [ParOldGen: 699332K->699332K(699392K)] 816068K->816050K(932352K), [Metaspace: 99213K->99213K(1136640K)], 1.3388540 secs] [Times: user=3.51 sys=0.03, real=1.34 secs]
194.738: [Full GC (Allocation Failure) [PSYoungGen: 116717K->114662K(232960K)] [ParOldGen: 699332K->699378K(699392K)] 816050K->814041K(932352K), [Metaspace: 99213K->98929K(1136640K)], 1.9746523 secs] [Times: user=5.58 sys=0.07, real=1.98 secs]
[Stage 1:========> (17226 + 5) / 100000]196.725: [Full GC (Ergonomics) [PSYoungGen: 116736K->115004K(232960K)] [ParOldGen: 699382K->699367K(699392K)] 816118K->814371K(932352K), [Metaspace: 99036K->99032K(1136640K)], 2.7034733 secs] [Times: user=7.71 sys=0.12, real=2.70 secs]
[Stage 1:========> (17227 + 4) / 100000]199.438: [Full GC (Ergonomics) [PSYoungGen: 116736K->115141K(232960K)] [ParOldGen: 699367K->699362K(699392K)] 816103K->814504K(932352K), [Metaspace: 99058K->98937K(1136640K)], 2.4738239 secs] [Times: user=6.67 sys=0.10, real=2.48 secs]
[Stage 1:========> (17230 + 4) / 100000]201.922: [Full GC (Ergonomics) [PSYoungGen: 116736K->115063K(232960K)] [ParOldGen: 699362K->699361K(699392K)] 816098K->814425K(932352K), [Metaspace: 98971K->98971K(1136640K)], 2.1542781 secs] [Times: user=6.74 sys=0.09, real=2.15 secs]
17/08/09 16:04:37 ERROR Executor: Exception in task 17230.0 in stage 1.0 (TID 117230)
java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.util.Arrays.copyOfRange(Arrays.java:3664)
at java.lang.String.<init>(String.java:207)
at java.lang.StringBuilder.toString(StringBuilder.java:407)
at java.io.ObjectStreamClass.getMethodSignature(ObjectStreamClass.java:1568)
at java.io.ObjectStreamClass.access$2500(ObjectStreamClass.java:72)
at java.io.ObjectStreamClass$MemberSignature.<init>(ObjectStreamClass.java:1892)
at java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1819)
at java.io.ObjectStreamClass.access$100(ObjectStreamClass.java:72)
at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:253)
at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:251)
at java.security.AccessController.doPrivileged(Native Method)
at java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:250)
at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:611)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1630)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1521)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1630)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1521)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1781)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2018)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1942)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1808)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:373)
at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:75)
at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:114)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:80)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:335)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
204.105: [Full GC (Ergonomics) [PSYoungGen: 116736K->114949K(232960K)] [ParOldGen: 699361K->699357K(699392K)] 816097K->814307K(932352K), [Metaspace: 99071K->98976K(1136640K)], 2.0730954 secs] [Times: user=6.48 sys=0.09, real=2.07 secs]
206.186: [Full GC (Ergonomics) [PSYoungGen: 116736K->115085K(232960K)] [ParOldGen: 699357K->699357K(699392K)] 816093K->814442K(932352K), [Metaspace: 99113K->99110K(1136640K)], 2.3725683 secs] [Times: user=7.25 sys=0.10, real=2.37 secs]
208.570: [Full GC (Ergonomics) [PSYoungGen: 116736K->115182K(232960K)] [ParOldGen: 699357K->699356K(699392K)] 816093K->814539K(932352K), [Metaspace: 99156K->99092K(1136640K)], 2.3520362 secs] [Times: user=6.86 sys=0.10, real=2.36 secs]
[Stage 1:========> (17231 + 6) / 100000]17/08/09 16:04:44 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[Executor task launch worker for task 117230,5,main]
java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.util.Arrays.copyOfRange(Arrays.java:3664)
at java.lang.String.<init>(String.java:207)
at java.lang.StringBuilder.toString(StringBuilder.java:407)
at java.io.ObjectStreamClass.getMethodSignature(ObjectStreamClass.java:1568)
at java.io.ObjectStreamClass.access$2500(ObjectStreamClass.java:72)
at java.io.ObjectStreamClass$MemberSignature.<init>(ObjectStreamClass.java:1892)
at java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1819)
at java.io.ObjectStreamClass.access$100(ObjectStreamClass.java:72)
at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:253)
at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:251)
at java.security.AccessController.doPrivileged(Native Method)
at java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:250)
at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:611)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1630)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1521)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1630)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1521)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1781)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2018)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1942)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1808)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:373)
at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:75)
at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:114)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:80)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:335)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
210.931: [Full GC (Ergonomics) [PSYoungGen: 116736K->115330K(232960K)] [ParOldGen: 699356K->699356K(699392K)] 816092K->814687K(932352K), [Metaspace: 99155K->99106K(1136640K)], 2.5186417 secs] [Times: user=7.54 sys=0.11, real=2.51 secs]
[Stage 1:========> (17233 + 4) / 100000]17/08/09 16:04:47 ERROR Executor: Exception in task 17236.0 in stage 1.0 (TID 117236)
java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.util.Arrays.copyOf(Arrays.java:3332)
at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:124)
at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:448)
at java.lang.StringBuilder.append(StringBuilder.java:136)
at java.io.ObjectStreamClass.getClassSignature(ObjectStreamClass.java:1550)
at java.io.ObjectStreamClass.getMethodSignature(ObjectStreamClass.java:1567)
at java.io.ObjectStreamClass.access$2500(ObjectStreamClass.java:72)
at java.io.ObjectStreamClass$MemberSignature.<init>(ObjectStreamClass.java:1892)
at java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1819)
at java.io.ObjectStreamClass.access$100(ObjectStreamClass.java:72)
at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:253)
at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:251)
at java.security.AccessController.doPrivileged(Native Method)
at java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:250)
at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:611)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1630)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1521)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1781)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2018)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1942)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1808)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:373)
at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:75)
at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:108)
at org.apache.spark.scheduler.Task.metrics$lzycompute(Task.scala:66)
at org.apache.spark.scheduler.Task.metrics(Task.scala:65)
at org.apache.spark.scheduler.Task.run(Task.scala:88)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:335)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
213.459: [Full GC (Ergonomics) [PSYoungGen: 116736K->115351K(232960K)] [ParOldGen: 699356K->699354K(699392K)] 816092K->814705K(932352K), [Metaspace: 99146K->99146K(1136640K)], 2.1165280 secs] [Times: user=6.24 sys=0.09, real=2.12 secs]
215.589: [Full GC (Ergonomics) [PSYoungGen: 116736K->115363K(232960K)] [ParOldGen: 699354K->699354K(699392K)] 816090K->814718K(932352K), [Metaspace: 99224K->99135K(1136640K)], 2.3609841 secs] [Times: user=6.40 sys=0.10, real=2.36 secs]
17/08/09 16:04:49 ERROR SparkUncaughtExceptionHandler: [Container in shutdown] Uncaught exception in thread Thread[Executor task launch worker for task 117236,5,main]
java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.util.Arrays.copyOf(Arrays.java:3332)
at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:124)
at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:448)
at java.lang.StringBuilder.append(StringBuilder.java:136)
at java.io.ObjectStreamClass.getClassSignature(ObjectStreamClass.java:1550)
at java.io.ObjectStreamClass.getMethodSignature(ObjectStreamClass.java:1567)
at java.io.ObjectStreamClass.access$2500(ObjectStreamClass.java:72)
at java.io.ObjectStreamClass$MemberSignature.<init>(ObjectStreamClass.java:1892)
at java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1819)
at java.io.ObjectStreamClass.access$100(ObjectStreamClass.java:72)
at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:253)
at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:251)
at java.security.AccessController.doPrivileged(Native Method)
at java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:250)
at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:611)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1630)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1521)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1781)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2018)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1942)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1808)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:373)
at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:75)
at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:108)
at org.apache.spark.scheduler.Task.metrics$lzycompute(Task.scala:66)
at org.apache.spark.scheduler.Task.metrics(Task.scala:65)
at org.apache.spark.scheduler.Task.run(Task.scala:88)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:335)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
217.957: [Full GC (Ergonomics) [PSYoungGen: 116736K->115311K(232960K)] [ParOldGen: 699354K->699353K(699392K)] 816090K->814665K(932352K), [Metaspace: 99170K->99170K(1136640K)], 2.2773882 secs] [Times: user=6.10 sys=0.11, real=2.28 secs]
220.240: [Full GC (Ergonomics) [PSYoungGen: 116736K->115334K(232960K)] [ParOldGen: 699353K->699353K(699392K)] 816089K->814688K(932352K), [Metaspace: 99212K->99208K(1136640K)], 2.0375220 secs] [Times: user=6.36 sys=0.08, real=2.04 secs]
222.285: [Full GC (Ergonom
Raw
local mode, rdd not cached, works fine
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.2.0
/_/
Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_111)
Type in expressions to have them evaluated.
Type :help for more information.
scala> val rdd = sc.parallelize(1 to 100000, 100000)
rdd: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[0] at parallelize at <console>:24
scala> rdd.count
38.033: [GC (Allocation Failure) [PSYoungGen: 260550K->29745K(292352K)] 384379K->153582K(557056K), 0.0248230 secs] [Times: user=0.08 sys=0.00, real=0.03 secs]
[Stage 0:> (0 + 0) / 100000]39.119: [GC (Allocation Failure) [PSYoungGen: 272433K->49633K(276992K)] 396270K->184214K(541696K), 0.0875573 secs] [Times: user=0.20 sys=0.02, real=0.08 secs]
[Stage 0:> (972 + 4) / 100000]40.229: [GC (Allocation Failure) [PSYoungGen: 276961K->50675K(278016K)] 411542K->185265K(542720K), 0.0454915 secs] [Times: user=0.14 sys=0.00, real=0.04 secs]
[Stage 0:=> (1982 + 4) / 100000]40.963: [GC (Allocation Failure) [PSYoungGen: 277976K->51593K(273408K)] 412565K->186190K(538112K), 0.0463910 secs] [Times: user=0.16 sys=0.00, real=0.05 secs]
[Stage 0:=> (2644 + 5) / 100000]41.479: [GC (Allocation Failure) [PSYoungGen: 258441K->52392K(259584K)] 393038K->186990K(524288K), 0.0534275 secs] [Times: user=0.17 sys=0.00, real=0.05 secs]
[Stage 0:=> (3706 + 4) / 100000]42.007: [GC (Allocation Failure) [PSYoungGen: 259240K->53241K(267776K)] 393838K->187846K(532480K), 0.0442496 secs] [Times: user=0.15 sys=0.01, real=0.05 secs]
[Stage 0:==> (4411 + 4) / 100000]42.463: [GC (Allocation Failure) [PSYoungGen: 245753K->54025K(246784K)] 380358K->188638K(511488K), 0.0458110 secs] [Times: user=0.15 sys=0.00, real=0.05 secs]
[Stage 0:==> (5441 + 4) / 100000]42.977: [GC (Allocation Failure) [PSYoungGen: 246537K->54857K(263168K)] 381150K->189478K(527872K), 0.0450182 secs] [Times: user=0.15 sys=0.00, real=0.05 secs]
[Stage 0:===> (6193 + 4) / 100000]43.389: [GC (Allocation Failure) [PSYoungGen: 237129K->55545K(238080K)] 371750K->190166K(502784K), 0.0462308 secs] [Times: user=0.16 sys=0.00, real=0.04 secs]
[Stage 0:===> (6970 + 4) / 100000]43.779: [GC (Allocation Failure) [PSYoungGen: 237793K->56249K(261120K)] 372415K->190878K(525824K), 0.0455815 secs] [Times: user=0.16 sys=0.00, real=0.04 secs]
[Stage 0:===> (7365 + 4) / 100000]44.108: [GC (Allocation Failure) [PSYoungGen: 232377K->56994K(233472K)] 367006K->191631K(498176K), 0.0468671 secs] [Times: user=0.17 sys=0.00, real=0.04 secs]
[Stage 0:====> (8348 + 4) / 100000]44.441: [GC (Allocation Failure) [PSYoungGen: 233122K->57625K(260608K)] 367759K->192262K(525312K), 0.0474143 secs] [Times: user=0.16 sys=0.01, real=0.05 secs]
[Stage 0:====> (9277 + 6) / 100000]44.780: [GC (Allocation Failure) [PSYoungGen: 230681K->58274K(231424K)] 365318K->192919K(496128K), 0.0529060 secs] [Times: user=0.16 sys=0.01, real=0.05 secs]
[Stage 0:====> (9711 + 4) / 100000]45.141: [GC (Allocation Failure) [PSYoungGen: 231330K->52635K(262144K)] 365975K->193678K(526848K), 0.0705833 secs] [Times: user=0.18 sys=0.01, real=0.07 secs]
[Stage 0:=====> (10548 + 4) / 100000]45.503: [GC (Allocation Failure) [PSYoungGen: 225691K->50055K(223232K)] 366734K->194185K(487936K), 0.0461130 secs] [Times: user=0.16 sys=0.01, real=0.05 secs]
[Stage 0:=====> (10958 + 4) / 100000]45.802: [GC (Allocation Failure) [PSYoungGen: 223111K->36682K(258560K)] 367241K->195076K(523264K), 0.0560309 secs] [Times: user=0.15 sys=0.01, real=0.06 secs]
[Stage 0:======> (12103 + 4) / 100000]46.121: [GC (Allocation Failure) [PSYoungGen: 211274K->10912K(257024K)] 369668K->195754K(521728K), 0.0757333 secs] [Times: user=0.12 sys=0.01, real=0.07 secs]
[Stage 0:======> (12484 + 4) / 100000]46.449: [GC (Allocation Failure) [PSYoungGen: 185504K->9984K(261632K)] 370346K->196634K(526336K), 0.0139333 secs] [Times: user=0.04 sys=0.00, real=0.01 secs]
[Stage 0:======> (13553 + 6) / 100000]46.755: [GC (Allocation Failure) [PSYoungGen: 187136K->9792K(187392K)] 373786K->197298K(452096K), 0.0196242 secs] [Times: user=0.04 sys=0.00, real=0.02 secs]
[Stage 0:=======> (14519 + 6) / 100000]47.092: [GC (Allocation Failure) [PSYoungGen: 186944K->9824K(263168K)] 374450K->198138K(527872K), 0.0115082 secs] [Times: user=0.04 sys=0.00, real=0.01 secs]
[Stage 0:=======> (15051 + 4) / 100000]47.369: [GC (Allocation Failure) [PSYoungGen: 186464K->10368K(187392K)] 374778K->198682K(452096K), 0.0115688 secs] [Times: user=0.04 sys=0.00, real=0.01 secs]
[Stage 0:=======> (15621 + 4) / 100000]47.635: [GC (Allocation Failure) [PSYoungGen: 187008K->11136K(263680K)] 375322K->199450K(528384K), 0.0131268 secs] [Times: user=0.04 sys=0.00, real=0.02 secs]
[Stage 0:========> (16828 + 5) / 100000]47.910: [GC (Allocation Failure) [PSYoungGen: 189824K->10944K(261632K)] 378138K->200058K(526336K), 0.0139301 secs] [Times: user=0.04 sys=0.00, real=0.01 secs]
[Stage 0:========> (17526 + 4) / 100000]48.154: [GC (Allocation Failure) [PSYoungGen: 189632K->10944K(263680K)] 378746K->200818K(528384K), 0.0129321 secs] [Times: user=0.05 sys=0.00, real=0.01 secs]
[Stage 0:=========> (18006 + 4) / 100000]48.432: [GC (Allocation Failure) [PSYoungGen: 194752K->10976K(262144K)] 384626K->201602K(526848K), 0.0130087 secs] [Times: user=0.04 sys=0.00, real=0.01 secs]
[Stage 0:=========> (18606 + 4) / 100000]48.684: [GC (Allocation Failure) [PSYoungGen: 194784K->11072K(267776K)] 385410K->202410K(532480K), 0.0133273 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
[Stage 0:=========> (19795 + 4) / 100000]48.982: [GC (Allocation Failure) [PSYoungGen: 205120K->11104K(266752K)] 396458K->203154K(531456K), 0.0127360 secs] [Times: user=0.04 sys=0.00, real=0.01 secs]
[Stage 0:==========> (20404 + 6) / 100000]49.243: [GC (Allocation Failure) [PSYoungGen: 205152K->11232K(273408K)] 397202K->203978K(538112K), 0.0126533 secs] [Times: user=0.04 sys=0.01, real=0.01 secs]
[Stage 0:==========> (21712 + 4) / 100000]49.535: [GC (Allocation Failure) [PSYoungGen: 217056K->11264K(272896K)] 409802K->204722K(537600K), 0.0135657 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
[Stage 0:===========> (22403 + 4) / 100000]49.827: [GC (Allocation Failure) [PSYoungGen: 217088K->11392K(279040K)] 410546K->205546K(543744K), 0.0130261 secs] [Times: user=0.05 sys=0.00, real=0.01 secs]
[Stage 0:===========> (22904 + 4) / 100000]50.103: [GC (Allocation Failure) [PSYoungGen: 228992K->11648K(278528K)] 423146K->206498K(543232K), 0.0130014 secs] [Times: user=0.05 sys=0.00, real=0.01 secs]
[Stage 0:============> (24331 + 4) / 100000]50.396: [GC (Allocation Failure) [PSYoungGen: 229248K->12160K(285696K)] 424098K->207722K(550400K), 0.0155345 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
[Stage 0:============> (24917 + 4) / 100000]50.687: [GC (Allocation Failure) [PSYoungGen: 241536K->12288K(284672K)] 437098K->208562K(549376K), 0.0144088 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
[Stage 0:=============> (26241 + 4) / 100000]51.009: [GC (Allocation Failure) [PSYoungGen: 241664K->12448K(291328K)] 437938K->209442K(556032K), 0.0150213 secs] [Times: user=0.05 sys=0.00, real=0.01 secs]
[Stage 0:=============> (27542 + 4) / 100000]51.352: [GC (Allocation Failure) [PSYoungGen: 252576K->12864K(289792K)] 449570K->210586K(554496K), 0.0140337 secs] [Times: user=0.05 sys=0.00, real=0.01 secs]
[Stage 0:==============> (28225 + 5) / 100000]51.644: [GC (Allocation Failure) [PSYoungGen: 252992K->12992K(296960K)] 450714K->211426K(561664K), 0.0151146 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
[Stage 0:==============> (29709 + 4) / 100000]51.952: [GC (Allocation Failure) [PSYoungGen: 263872K->13248K(295424K)] 462306K->212394K(560128K), 0.0139322 secs] [Times: user=0.05 sys=0.00, real=0.01 secs]
[Stage 0:===============> (30319 + 4) / 100000]52.289: [GC (Allocation Failure) [PSYoungGen: 264128K->13600K(302592K)] 463274K->213474K(567296K), 0.0154859 secs] [Times: user=0.06 sys=0.00, real=0.01 secs]
[Stage 0:===============> (31747 + 4) / 100000]52.603: [GC (Allocation Failure) [PSYoungGen: 274208K->13952K(300544K)] 474082K->214554K(565248K), 0.0154349 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
[Stage 0:================> (33121 + 4) / 100000]52.956: [GC (Allocation Failure) [PSYoungGen: 274560K->14080K(307200K)] 475162K->215426K(571904K), 0.0157145 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
[Stage 0:================> (33808 + 4) / 100000]53.284: [GC (Allocation Failure) [PSYoungGen: 283392K->14464K(305152K)] 484738K->216554K(569856K), 0.0160999 secs] [Times: user=0.06 sys=0.00, real=0.02 secs]
[Stage 0:=================> (35221 + 4) / 100000]53.629: [GC (Allocation Failure) [PSYoungGen: 283776K->14784K(310784K)] 485866K->217650K(575488K), 0.0189330 secs] [Times: user=0.06 sys=0.00, real=0.02 secs]
[Stage 0:==================> (36568 + 4) / 100000]54.000: [GC (Allocation Failure) [PSYoungGen: 291776K->15136K(309248K)] 494642K->218778K(573952K), 0.0175812 secs] [Times: user=0.06 sys=0.01, real=0.02 secs]
[Stage 0:==================> (37229 + 4) / 100000]54.336: [GC (Allocation Failure) [PSYoungGen: 292128K->15424K(314368K)] 495770K->219890K(579072K), 0.0232519 secs] [Times: user=0.07 sys=0.00, real=0.03 secs]
[Stage 0:===================> (38690 + 4) / 100000]54.720: [GC (Allocation Failure) [PSYoungGen: 299584K->15744K(313344K)] 504050K->221034K(578048K), 0.0170351 secs] [Times: user=0.06 sys=0.00, real=0.02 secs]
[Stage 0:====================> (40018 + 4) / 100000]55.091: [GC (Allocation Failure) [PSYoungGen: 299904K->15680K(318464K)] 505194K->222098K(583168K), 0.0180890 secs] [Times: user=0.06 sys=0.00, real=0.02 secs]
[Stage 0:====================> (41404 + 4) / 100000]55.449: [GC (Allocation Failure) [PSYoungGen: 306496K->15520K(317440K)] 512914K->223322K(582144K), 0.0176939 secs] [Times: user=0.06 sys=0.00, real=0.01 secs]
[Stage 0:=====================> (42848 + 4) / 100000]55.801: [GC (Allocation Failure) [PSYoungGen: 306336K->15840K(321024K)] 514138K->224546K(585728K), 0.0213562 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:=====================> (43457 + 4) / 100000]56.175: [GC (Allocation Failure) [PSYoungGen: 311264K->16096K(320512K)] 519970K->225714K(585216K), 0.0222219 secs] [Times: user=0.07 sys=0.00, real=0.03 secs]
[Stage 0:======================> (44960 + 6) / 100000]56.536: [GC (Allocation Failure) [PSYoungGen: 311520K->16224K(323072K)] 521138K->226802K(587776K), 0.0198525 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:=======================> (46464 + 5) / 100000]56.898: [GC (Allocation Failure) [PSYoungGen: 315744K->16992K(323072K)] 526322K->228530K(587776K), 0.0208538 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:=======================> (47190 + 4) / 100000]57.183: [GC (Allocation Failure) [PSYoungGen: 316512K->17152K(325632K)] 528050K->229698K(590336K), 0.0200760 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:========================> (49148 + 4) / 100000]57.473: [GC (Allocation Failure) [PSYoungGen: 319232K->18384K(325632K)] 531778K->231930K(590336K), 0.0287291 secs] [Times: user=0.09 sys=0.00, real=0.03 secs]
[Stage 0:=========================> (50718 + 4) / 100000]57.833: [GC (Allocation Failure) [PSYoungGen: 320464K->18656K(325632K)] 534010K->233242K(590336K), 0.0256883 secs] [Times: user=0.09 sys=0.00, real=0.03 secs]
[Stage 0:=========================> (51444 + 4) / 100000]58.139: [GC (Allocation Failure) [PSYoungGen: 320736K->18720K(321024K)] 535322K->234354K(585728K), 0.0228633 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:==========================> (53400 + 4) / 100000]58.425: [GC (Allocation Failure) [PSYoungGen: 320800K->18928K(325120K)] 536434K->235642K(589824K), 0.0239108 secs] [Times: user=0.08 sys=0.00, real=0.03 secs]
[Stage 0:===========================> (54325 + 8) / 100000]58.718: [GC (Allocation Failure) [PSYoungGen: 319984K->19088K(325120K)] 536698K->236882K(589824K), 0.0209621 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:============================> (56032 + 4) / 100000]59.034: [GC (Allocation Failure) [PSYoungGen: 320144K->19072K(324096K)] 537938K->237970K(588800K), 0.0220194 secs] [Times: user=0.08 sys=0.01, real=0.02 secs]
[Stage 0:============================> (56806 + 4) / 100000]59.335: [GC (Allocation Failure) [PSYoungGen: 319104K->19232K(324608K)] 538002K->239234K(589312K), 0.0239618 secs] [Times: user=0.08 sys=0.00, real=0.03 secs]
[Stage 0:============================> (57705 + 5) / 100000]59.617: [GC (Allocation Failure) [PSYoungGen: 319264K->19168K(324608K)] 539266K->240290K(589312K), 0.0214472 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:=============================> (59638 + 4) / 100000]59.935: [GC (Allocation Failure) [PSYoungGen: 319200K->19264K(324608K)] 540322K->241514K(589312K), 0.0225856 secs] [Times: user=0.08 sys=0.00, real=0.03 secs]
[Stage 0:==============================> (60321 + 4) / 100000]60.229: [GC (Allocation Failure) [PSYoungGen: 319296K->19392K(323584K)] 541546K->242794K(588288K), 0.0225344 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:===============================> (62248 + 5) / 100000]60.518: [GC (Allocation Failure) [PSYoungGen: 319424K->19408K(324096K)] 542826K->243978K(588800K), 0.0213390 secs] [Times: user=0.07 sys=0.01, real=0.02 secs]
[Stage 0:===============================> (63870 + 4) / 100000]60.883: [GC (Allocation Failure) [PSYoungGen: 319440K->19376K(325120K)] 544010K->245122K(589824K), 0.0236497 secs] [Times: user=0.08 sys=0.00, real=0.03 secs]
[Stage 0:================================> (64354 + 4) / 100000]61.237: [GC (Allocation Failure) [PSYoungGen: 320432K->19312K(325120K)] 546178K->246234K(589824K), 0.0222821 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:=================================> (66316 + 5) / 100000]61.522: [GC (Allocation Failure) [PSYoungGen: 320368K->18944K(324096K)] 547290K->247578K(588800K), 0.0216726 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:=================================> (67092 + 4) / 100000]61.822: [GC (Allocation Failure) [PSYoungGen: 320000K->18912K(324608K)] 548634K->248746K(589312K), 0.0218325 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:==================================> (68586 + 4) / 100000]62.195: [GC (Allocation Failure) [PSYoungGen: 319968K->17824K(324608K)] 549802K->249882K(589312K), 0.0225640 secs] [Times: user=0.07 sys=0.01, real=0.03 secs]
[Stage 0:===================================> (70459 + 4) / 100000]62.497: [GC (Allocation Failure) [PSYoungGen: 319904K->17856K(325120K)] 551962K->251114K(589824K), 0.0260672 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:===================================> (71186 + 4) / 100000]62.797: [GC (Allocation Failure) [PSYoungGen: 319936K->17888K(326144K)] 553194K->252346K(590848K), 0.0230049 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:====================================> (72880 + 4) / 100000]63.138: [GC (Allocation Failure) [PSYoungGen: 321504K->17920K(326144K)] 555962K->253578K(590848K), 0.0207852 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:====================================> (73787 + 4) / 100000]63.422: [GC (Allocation Failure) [PSYoungGen: 321536K->17920K(326144K)] 557194K->254770K(590848K), 0.0205678 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:=====================================> (75738 + 5) / 100000]63.711: [GC (Allocation Failure) [PSYoungGen: 322560K->17952K(326144K)] 559410K->255994K(590848K), 0.0217940 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:======================================> (76568 + 4) / 100000]64.013: [GC (Allocation Failure) [PSYoungGen: 322592K->17952K(326656K)] 560634K->257170K(591360K), 0.0250967 secs] [Times: user=0.07 sys=0.00, real=0.03 secs]
[Stage 0:======================================> (77422 + 5) / 100000]64.297: [GC (Allocation Failure) [PSYoungGen: 324128K->18016K(327168K)] 563346K->258418K(591872K), 0.0224137 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:=======================================> (79572 + 4) / 100000]64.579: [GC (Allocation Failure) [PSYoungGen: 324192K->17920K(327168K)] 564594K->259514K(591872K), 0.0260482 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:========================================> (80323 + 5) / 100000]64.924: [GC (Allocation Failure) [PSYoungGen: 325120K->18112K(327680K)] 566714K->260890K(592384K), 0.0221721 secs] [Times: user=0.07 sys=0.00, real=0.03 secs]
[Stage 0:=========================================> (82173 + 4) / 100000]65.218: [GC (Allocation Failure) [PSYoungGen: 325312K->17984K(328704K)] 568090K->261970K(593408K), 0.0214094 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:=========================================> (83091 + 4) / 100000]65.511: [GC (Allocation Failure) [PSYoungGen: 326208K->18112K(326656K)] 570194K->263298K(591360K), 0.0222410 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:==========================================> (85046 + 4) / 100000]65.793: [GC (Allocation Failure) [PSYoungGen: 326336K->18080K(328192K)] 571522K->264474K(592896K), 0.0215289 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:==========================================> (85903 + 4) / 100000]66.087: [GC (Allocation Failure) [PSYoungGen: 326304K->18080K(328192K)] 572698K->265674K(592896K), 0.0222217 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:===========================================> (87818 + 4) / 100000]66.387: [GC (Allocation Failure) [PSYoungGen: 326304K->18176K(328192K)] 573898K->266970K(592896K), 0.0227400 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:============================================> (88727 + 4) / 100000]66.672: [GC (Allocation Failure) [PSYoungGen: 327424K->18112K(328704K)] 576218K->268114K(593408K), 0.0239864 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:=============================================> (90524 + 5) / 100000]66.995: [GC (Allocation Failure) [PSYoungGen: 327360K->18176K(329728K)] 577362K->269378K(594432K), 0.0220178 secs] [Times: user=0.08 sys=0.01, real=0.03 secs]
[Stage 0:=============================================> (91412 + 4) / 100000]67.315: [GC (Allocation Failure) [PSYoungGen: 328448K->19296K(329728K)] 579650K->271690K(594432K), 0.0252980 secs] [Times: user=0.07 sys=0.00, real=0.03 secs]
[Stage 0:==============================================> (93160 + 4) / 100000]67.621: [GC (Allocation Failure) [PSYoungGen: 329568K->19296K(328704K)] 581962K->272890K(593408K), 0.0252851 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
[Stage 0:===============================================> (94069 + 7) / 100000]67.911: [GC (Allocation Failure) [PSYoungGen: 328544K->19360K(328704K)] 582138K->274170K(593408K), 0.0231529 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:================================================> (96019 + 5) / 100000]68.204: [GC (Allocation Failure) [PSYoungGen: 328608K->19392K(328704K)] 583418K->275418K(593408K), 0.0239212 secs] [Times: user=0.08 sys=0.00, real=0.03 secs]
[Stage 0:================================================> (96950 + 4) / 100000]68.479: [GC (Allocation Failure) [PSYoungGen: 327616K->19296K(328704K)] 583642K->276538K(593408K), 0.0230985 secs] [Times: user=0.08 sys=0.00, real=0.02 secs]
[Stage 0:================================================> (97839 + 5) / 100000]68.777: [GC (Allocation Failure) [PSYoungGen: 327520K->20448K(325632K)] 584762K->279842K(590336K), 0.0368167 secs] [Times: user=0.12 sys=0.00, real=0.03 secs]
res0: Long = 100000
Raw
YARN mode, cached RDD, dies
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.2.0
/_/
Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_45)
Type in expressions to have them evaluated.
Type :help for more information.
scala> val rdd = sc.parallelize(1 to 100000, 100000)
rdd: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[0] at parallelize at <console>:24
scala> rdd.cache
res0: rdd.type = ParallelCollectionRDD[0] at parallelize at <console>:24
scala> rdd.count
[Stage 0:> (36 + 9) / 100000]98.312: [GC (Allocation Failure) [PSYoungGen: 696832K->94766K(1110528K)] 904280K->302222K(1857024K), 0.0351381 secs] [Times: user=0.39 sys=0.08, real=0.04 secs]
[Stage 0:=> (3876 + 8) / 100000]100.698: [GC (Allocation Failure) [PSYoungGen: 1096750K->118755K(1120768K)] 1304206K->338820K(1867264K), 0.0485589 secs] [Times: user=0.61 sys=0.15, real=0.05 secs]
[Stage 0:===> (7185 + 8) / 100000]102.008: [GC (Allocation Failure) [PSYoungGen: 1120739K->140793K(1513472K)] 1340804K->427027K(2259968K), 0.0559940 secs] [Times: user=0.81 sys=0.17, real=0.05 secs]
[Stage 0:=====> (11688 + 8) / 100000]103.429: [GC (Allocation Failure) [PSYoungGen: 1513465K->186353K(1559040K)] 1799699K->610842K(2305536K), 0.0944835 secs] [Times: user=1.36 sys=0.27, real=0.09 secs]
[Stage 0:========> (16103 + 8) / 100000]104.824: [GC (Allocation Failure) [PSYoungGen: 1559025K->266739K(2078208K)] 1983514K->839403K(2824704K), 0.1214922 secs] [Times: user=1.81 sys=0.32, real=0.12 secs]
[Stage 0:==========> (20698 + 9) / 100000]106.275: [GC (Allocation Failure) [PSYoungGen: 2078195K->364169K(2177536K)] 2650859K->1203431K(3017216K), 0.1360555 secs] [Times: user=1.65 sys=0.66, real=0.14 secs]
106.412: [Full GC (Ergonomics) [PSYoungGen: 364169K->358750K(2177536K)] [ParOldGen: 839261K->839518K(1619456K)] 1203431K->1198269K(3796992K), [Metaspace: 111279K->111266K(1146880K)], 9.0190660 secs] [Times: user=105.59 sys=1.34, real=9.02 secs]
[Stage 0:============> (24922 + 10) / 100000]116.816: [GC (Allocation Failure) [PSYoungGen: 2170206K->410753K(2804736K)] 3009725K->1609102K(4424192K), 0.1865718 secs] [Times: user=1.70 sys=1.60, real=0.18 secs]
[Stage 0:===============> (30367 + 8) / 100000]118.554: [GC (Allocation Failure) [PSYoungGen: 2804353K->495610K(2889216K)] 4002702K->2205796K(4600832K), 0.1631015 secs] [Times: user=1.87 sys=0.93, real=0.17 secs]
118.717: [Full GC (Ergonomics) [PSYoungGen: 495610K->492486K(2889216K)] [ParOldGen: 1710186K->1711522K(2891776K)] 2205796K->2204008K(5780992K), [Metaspace: 111286K->111286K(1146880K)], 9.8091174 secs] [Times: user=122.05 sys=0.66, real=9.81 secs]
[Stage 0:=================> (35154 + 9) / 100000]130.113: [GC (Allocation Failure) [PSYoungGen: 2886086K->605669K(2017792K)] 4597608K->2847354K(4909568K), 0.2842907 secs] [Times: user=2.55 sys=2.53, real=0.29 secs]
[Stage 0:==================> (37869 + 8) / 100000]131.164: [GC (Allocation Failure) [PSYoungGen: 2017765K->398995K(2453504K)] 4259450K->3246223K(5345280K), 0.1565733 secs] [Times: user=2.18 sys=0.60, real=0.16 secs]
131.320: [Full GC (Ergonomics) [PSYoungGen: 398995K->353501K(2453504K)] [ParOldGen: 2847227K->2891428K(4490240K)] 3246223K->3244929K(6943744K), [Metaspace: 111296K->111296K(1146880K)], 21.5734429 secs] [Times: user=296.46 sys=2.39, real=21.57 secs]
[Stage 0:====================> (40813 + 8) / 100000]153.785: [GC (Allocation Failure) [PSYoungGen: 1765597K->765922K(2328576K)] 4657025K->3657350K(6818816K), 0.3211489 secs] [Times: user=3.18 sys=2.54, real=0.33 secs]
[Stage 0:=====================> (43055 + 8) / 100000]154.827: [GC (Allocation Failure) [PSYoungGen: 2104290K->1078260K(2416640K)] 4995718K->4057183K(6906880K), 0.2294957 secs] [Times: user=3.14 sys=0.94, real=0.23 secs]
[Stage 0:======================> (45527 + 9) / 100000]155.727: [GC (Allocation Failure) [PSYoungGen: 2416628K->753296K(2243584K)] 5395551K->4463362K(6733824K), 0.2596768 secs] [Times: user=3.58 sys=1.06, real=0.26 secs]
155.986: [Full GC (Ergonomics) [PSYoungGen: 753296K->0K(2243584K)] [ParOldGen: 3710065K->4462418K(6383616K)] 4463362K->4462418K(8627200K), [Metaspace: 111306K->111306K(1146880K)], 33.6543443 secs] [Times: user=430.72 sys=3.18, real=33.65 secs]
[Stage 0:=======================> (47519 + 8) / 100000]190.314: [GC (Allocation Failure) [PSYoungGen: 1165144K->362941K(2330112K)] 5627563K->4825359K(8713728K), 0.0597862 secs] [Times: user=0.62 sys=0.42, real=0.06 secs]
[Stage 0:========================> (49297 + 9) / 100000]190.951: [GC (Allocation Failure) [PSYoungGen: 1528253K->365834K(2330112K)] 5990671K->5190801K(8713728K), 0.1046488 secs] [Times: user=1.17 sys=0.67, real=0.11 secs]
[Stage 0:=========================> (50930 + 8) / 100000]191.623: [GC (Allocation Failure) [PSYoungGen: 1531146K->373040K(1538560K)] 6356113K->5563367K(7922176K), 0.0834596 secs] [Times: user=1.08 sys=0.30, real=0.09 secs]
[Stage 0:==========================> (52829 + 8) / 100000]192.238: [GC (Allocation Failure) [PSYoungGen: 1538352K->748983K(2294272K)] 6728679K->5939310K(8677888K), 0.0900862 secs] [Times: user=1.23 sys=0.35, real=0.09 secs]
[Stage 0:===========================> (54766 + 8) / 100000]192.813: [GC (Allocation Failure) [PSYoungGen: 1896375K->376624K(2312192K)] 7086702K->6315486K(8695808K), 0.1215282 secs] [Times: user=1.43 sys=0.70, real=0.12 secs]
192.934: [Full GC (Ergonomics) [PSYoungGen: 376624K->0K(2312192K)] [ParOldGen: 5938862K->6312595K(6990848K)] 6315486K->6312595K(9303040K), [Metaspace: 111312K->111312K(1146880K)], 47.0897527 secs] [Times: user=418.93 sys=3.07, real=47.09 secs]
[Stage 0:============================> (56395 + 9) / 100000]240.590: [Full GC (Ergonomics) [PSYoungGen: 1147392K->0K(2312192K)] [ParOldGen: 6312595K->6687880K(6990848K)] 7459987K->6687880K(9303040K), [Metaspace: 111323K->111323K(1146880K)], 6.0587942 secs] [Times: user=66.79 sys=0.89, real=6.06 secs]
[Stage 0:=============================> (58128 + 9) / 100000]247.141: [Full GC (Ergonomics) [PSYoungGen: 1147392K->76255K(2312192K)] [ParOldGen: 6687880K->6990790K(6990848K)] 7835272K->7067045K(9303040K), [Metaspace: 111341K->111341K(1146880K)], 75.9227689 secs] [Times: user=983.07 sys=4.56, real=75.92 secs]
[Stage 0:=============================> (58461 + 8) / 100000]17/08/09 16:36:35 WARN Signaling: Cancelling all active jobs, this can take a while. Press Ctrl+C again to exit now.
17/08/09 16:36:35 WARN JobProgressListener: Task start for unknown stage 0
org.apache.spark.SparkException: Job 0 cancelled as part of cancellation of all jobs
at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1499)
at org.apache.spark.scheduler.DAGScheduler.handleJobCancellation(DAGScheduler.scala:1439)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$doCancelAllJobs$1.apply$mcVI$sp(DAGScheduler.scala:723)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$doCancelAllJobs$1.apply(DAGScheduler.scala:723)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$doCancelAllJobs$1.apply(DAGScheduler.scala:723)
at scala.collection.mutable.HashSet.foreach(HashSet.scala:78)
at org.apache.spark.scheduler.DAGScheduler.doCancelAllJobs(DAGScheduler.scala:723)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1692)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1669)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1658)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:630)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2022)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2043)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2062)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2087)
at org.apache.spark.rdd.RDD.count(RDD.scala:1158)
... 48 elided
scala>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment