Skip to content

Instantly share code, notes, and snippets.

@dmarce1
Created October 8, 2015 20:05
Show Gist options
  • Save dmarce1/b665632ad0ab1939ebb6 to your computer and use it in GitHub Desktop.
Save dmarce1/b665632ad0ab1939ebb6 to your computer and use it in GitHub Desktop.
assertion failure - full output
--------------------------------------
Running PBS prologue script
--------------------------------------
User and Job Data:
--------------------------------------
Job ID: 54362.smic3
Username: dmarce1
Group: hpcusers
Date: 08-Oct-2015 13:52
Node: smic165 (57167)
--------------------------------------
PBS has allocated the following nodes:
smic165
smic200
smic240
smic241
smic242
smic244
smic245
smic246
smic247
smic248
smic252
smic259
smic260
smic261
smic262
smic263
smic264
smic265
smic266
smic267
smic268
smic269
smic270
smic271
smic272
smic273
smic274
smic275
smic276
smic277
smic278
smic279
smic280
smic281
smic282
smic283
smic284
smic285
smic286
smic287
smic288
smic289
smic290
smic291
smic292
smic293
smic294
smic295
smic296
smic297
smic298
smic299
smic300
smic303
smic304
smic305
smic306
smic307
smic308
smic309
smic310
smic311
smic312
smic313
A total of 1280 processors on 64 nodes allocated
---------------------------------------------
Check nodes and clean them of stray processes
---------------------------------------------
Checking node smic165 13:52:48
Checking node smic200 13:52:50
Checking node smic240 13:52:52
Checking node smic241 13:52:55
Checking node smic242 13:52:57
Checking node smic244 13:52:59
Checking node smic245 13:53:01
Checking node smic246 13:53:04
Checking node smic247 13:53:06
Checking node smic248 13:53:08
Checking node smic252 13:53:10
Checking node smic259 13:53:13
Checking node smic260 13:53:16
Checking node smic261 13:53:18
Checking node smic262 13:53:20
Checking node smic263 13:53:22
Checking node smic264 13:53:24
Checking node smic265 13:53:27
Checking node smic266 13:53:29
Checking node smic267 13:53:31
Checking node smic268 13:53:34
Checking node smic269 13:53:36
Checking node smic270 13:53:38
Checking node smic271 13:53:40
Checking node smic272 13:53:43
Checking node smic273 13:53:45
Checking node smic274 13:53:47
Checking node smic275 13:53:49
Checking node smic276 13:53:52
Checking node smic277 13:53:54
Checking node smic278 13:53:56
Checking node smic279 13:53:58
Checking node smic280 13:54:01
Checking node smic281 13:54:03
Checking node smic282 13:54:05
Checking node smic283 13:54:07
Checking node smic284 13:54:10
Checking node smic285 13:54:12
Checking node smic286 13:54:14
Checking node smic287 13:54:16
Checking node smic288 13:54:19
Checking node smic289 13:54:21
Checking node smic290 13:54:23
Checking node smic291 13:54:26
Checking node smic292 13:54:28
Checking node smic293 13:54:30
Checking node smic294 13:54:32
Checking node smic295 13:54:35
Checking node smic296 13:54:37
Checking node smic297 13:54:39
Checking node smic298 13:54:42
Checking node smic299 13:54:44
Checking node smic300 13:54:46
Checking node smic303 13:54:48
Checking node smic304 13:54:51
Checking node smic305 13:54:53
Checking node smic306 13:54:55
Checking node smic307 13:54:58
Checking node smic308 13:55:00
Checking node smic309 13:55:02
Checking node smic310 13:55:04
Checking node smic311 13:55:07
Checking node smic312 13:55:09
Checking node smic313 13:55:11
Done clearing all the allocated nodes
------------------------------------------------------
Concluding PBS prologue script - 08-Oct-2015 13:55:11
------------------------------------------------------
+ cd /work/dmarce1/octotiger/release
+ make -k all -j21
make: Nothing to be done for `all'.
+ uniq /var/spool/torque/aux//54362.smic3
+ export HPX_NODEFILE=actual.nodes
+ HPX_NODEFILE=actual.nodes
+ unset PBS_NODEFILE
+ export I_MPI_FABRICS=shm:ofa
+ I_MPI_FABRICS=shm:ofa
+ export I_MPI_DAPL_PROVIDER=ofa-v2-mlx4_0-1u
+ I_MPI_DAPL_PROVIDER=ofa-v2-mlx4_0-1u
+ export I_MPI_OFA_ADAPTER_NAME=mlx4_0
+ I_MPI_OFA_ADAPTER_NAME=mlx4_0
+ mpirun -np 64 --machinefile actual.nodes ./octotiger -t20 -Ihpx.stacks.use_guard_pages=0
Regrid gather
Regrid scatter
Regrid done
---------------Created Level 1---------------
Regrid gather
Regrid scatter
Regrid done
---------------Created Level 2---------------
Regrid gather
Regrid scatter
Regrid done
---------------Created Level 3---------------
Regrid gather
Regrid scatter
Regrid done
---------------Created Level 4---------------
Regrid gather
Regrid scatter
Regrid done
---------------Created Level 5---------------
Forming tree connections------------
...done
Waiting 3 seconds...
Starting...
--- begin checkpoint ---
Saved 37449 sub-grids with 7257091954 bytes written
--- end checkpoint ---
--- begin output ---
--- end output ---
0 0.000000e+00 3.925815e-03 3.410012e+01
1 3.925815e-03 3.447514e-03 2.191334e+00
2 7.373329e-03 2.902203e-03 2.220164e+00
3 1.027553e-02 2.458141e-03 2.205320e+00
4 1.273367e-02 1.345696e-03 2.148618e+00
5 1.407937e-02 1.051144e-03 2.173047e+00
6 1.513051e-02 1.024402e-03 2.201050e+00
7 1.615491e-02 1.063114e-03 2.192235e+00
8 1.721803e-02 1.037138e-03 2.173330e+00
9 1.825517e-02 9.735356e-04 2.181747e+00
10 1.922870e-02 9.290693e-04 2.255066e+00
11 2.015777e-02 8.585951e-04 2.319578e+00
12 2.101637e-02 8.053023e-04 2.211540e+00
13 2.182167e-02 7.526007e-04 2.058812e+00
14 2.257427e-02 7.207075e-04 2.066934e+00
15 2.329498e-02 6.714507e-04 2.098080e+00
16 2.396643e-02 6.520328e-04 2.020209e+00
17 2.461846e-02 6.444903e-04 2.062942e+00
18 2.526295e-02 6.413216e-04 2.088858e+00
19 2.590427e-02 6.408076e-04 2.059100e+00
20 2.654508e-02 6.193441e-04 2.118753e+00
21 2.716442e-02 6.032205e-04 2.119880e+00
22 2.776764e-02 5.914084e-04 2.023162e+00
23 2.835905e-02 5.830675e-04 2.120203e+00
24 2.894212e-02 5.781249e-04 2.102403e+00
25 2.952024e-02 5.769109e-04 2.084636e+00
26 3.009716e-02 5.779666e-04 2.054510e+00
27 3.067512e-02 5.755488e-04 2.036399e+00
28 3.125067e-02 5.734603e-04 2.048027e+00
29 3.182413e-02 5.721371e-04 2.056054e+00
30 3.239627e-02 5.713588e-04 2.051141e+00
31 3.296763e-02 5.708617e-04 2.129239e+00
32 3.353849e-02 5.707230e-04 2.070672e+00
33 3.410921e-02 5.710389e-04 2.096610e+00
34 3.468025e-02 5.718873e-04 2.031950e+00
35 3.525214e-02 5.669258e-04 2.060553e+00
36 3.581906e-02 5.562908e-04 2.036874e+00
37 3.637535e-02 5.482621e-04 2.058757e+00
38 3.692362e-02 5.425094e-04 2.089744e+00
39 3.746613e-02 5.386844e-04 2.008643e+00
40 3.800481e-02 5.364423e-04 2.022687e+00
41 3.854125e-02 5.357344e-04 2.059413e+00
42 3.907699e-02 5.369213e-04 2.121737e+00
43 3.961391e-02 5.401177e-04 2.064685e+00
44 4.015403e-02 5.427603e-04 2.043676e+00
45 4.069679e-02 5.441183e-04 2.025815e+00
46 4.124091e-02 5.465711e-04 2.061744e+00
47 4.178748e-02 5.499329e-04 2.050518e+00
48 4.233741e-02 5.540555e-04 2.017082e+00
49 4.289146e-02 5.588330e-04 2.016230e+00
50 4.345030e-02 5.641970e-04 2.093828e+00
51 4.401449e-02 5.700987e-04 2.080952e+00
52 4.458459e-02 5.764998e-04 2.097970e+00
53 4.516109e-02 5.833675e-04 2.037845e+00
54 4.574446e-02 5.906749e-04 2.030198e+00
55 4.633514e-02 5.984019e-04 2.069646e+00
56 4.693354e-02 6.065651e-04 2.095228e+00
57 4.754010e-02 6.152482e-04 2.045467e+00
58 4.815535e-02 6.244712e-04 2.073938e+00
59 4.877982e-02 6.341997e-04 2.045806e+00
60 4.941402e-02 6.444229e-04 2.117930e+00
61 5.005844e-02 6.551358e-04 2.016716e+00
62 5.071358e-02 6.663371e-04 2.067003e+00
63 5.137992e-02 6.780141e-04 2.079514e+00
64 5.205793e-02 6.901734e-04 2.106274e+00
65 5.274810e-02 7.028359e-04 2.069045e+00
66 5.345094e-02 7.160335e-04 2.046376e+00
67 5.416697e-02 7.298045e-04 2.052289e+00
68 5.489678e-02 7.441842e-04 2.016034e+00
69 5.564096e-02 7.592001e-04 2.160938e+00
70 5.640016e-02 7.748756e-04 2.063252e+00
71 5.717504e-02 7.912313e-04 2.045365e+00
72 5.796627e-02 8.083035e-04 2.037977e+00
73 5.877457e-02 8.261602e-04 2.155029e+00
74 5.960073e-02 8.448279e-04 2.071394e+00
75 6.044556e-02 8.595889e-04 2.032935e+00
76 6.130515e-02 8.660858e-04 2.029074e+00
77 6.217124e-02 8.727840e-04 2.052338e+00
78 6.304402e-02 8.797267e-04 2.138270e+00
79 6.392375e-02 8.869673e-04 2.044432e+00
80 6.481071e-02 8.943255e-04 2.068929e+00
81 6.570504e-02 9.020014e-04 2.035346e+00
82 6.660704e-02 9.101357e-04 2.178558e+00
83 6.751718e-02 9.187552e-04 2.085534e+00
84 6.843593e-02 9.279063e-04 2.031088e+00
85 6.936384e-02 9.382092e-04 2.043639e+00
86 7.030205e-02 9.499165e-04 2.136699e+00
87 7.125196e-02 9.628699e-04 2.090825e+00
88 7.221483e-02 9.769726e-04 2.044249e+00
89 7.319181e-02 9.841816e-04 2.062059e+00
90 7.417599e-02 9.835743e-04 2.046022e+00
91 7.515956e-02 9.832527e-04 2.046657e+00
92 7.614282e-02 9.832078e-04 2.031438e+00
93 7.712602e-02 9.834341e-04 2.009791e+00
94 7.810946e-02 9.839270e-04 2.031843e+00
95 7.909338e-02 9.846816e-04 2.059989e+00
96 8.007807e-02 9.857030e-04 2.064268e+00
97 8.106377e-02 9.869997e-04 2.078494e+00
98 8.205077e-02 9.886173e-04 2.049787e+00
99 8.303939e-02 9.905209e-04 2.026541e+00
100 8.402991e-02 9.915140e-04 2.179722e+00
101 8.502142e-02 9.926066e-04 2.037561e+00
102 8.601403e-02 9.938585e-04 2.063223e+00
103 8.700789e-02 9.952876e-04 2.115426e+00
104 8.800317e-02 9.969124e-04 2.150697e+00
105 8.900009e-02 9.987511e-04 2.049188e+00
106 8.999884e-02 1.000820e-03 2.030172e+00
107 9.099966e-02 1.003134e-03 2.043508e+00
108 9.200279e-02 1.005707e-03 2.101817e+00
109 9.300850e-02 1.008569e-03 2.077922e+00
110 9.401707e-02 1.010987e-03 2.082839e+00
111 9.502805e-02 1.012872e-03 2.029141e+00
112 9.604093e-02 1.014991e-03 2.065952e+00
113 9.705592e-02 1.017258e-03 2.108653e+00
114 9.807317e-02 1.019686e-03 2.044563e+00
115 9.909286e-02 1.022296e-03 2.042583e+00
116 1.001152e-01 1.025105e-03 2.026410e+00
117 1.011403e-01 1.028126e-03 2.066603e+00
118 1.021684e-01 1.031383e-03 2.042038e+00
119 1.031998e-01 1.034169e-03 2.075383e+00
120 1.042339e-01 1.036286e-03 2.101464e+00
121 1.052702e-01 1.038624e-03 2.061518e+00
122 1.063088e-01 1.041060e-03 2.038521e+00
123 1.073499e-01 1.043618e-03 2.050862e+00
124 1.083935e-01 1.046337e-03 2.055637e+00
125 1.094399e-01 1.046336e-03 2.050803e+00
126 1.104862e-01 1.045996e-03 2.242566e+00
127 1.115322e-01 1.046161e-03 2.057353e+00
128 1.125784e-01 1.046772e-03 2.105309e+00
129 1.136251e-01 1.047843e-03 2.054737e+00
130 1.146730e-01 1.049318e-03 2.020525e+00
131 1.157223e-01 1.048988e-03 2.101585e+00
132 1.167713e-01 1.048914e-03 2.066310e+00
133 1.178202e-01 1.049117e-03 2.045075e+00
134 1.188693e-01 1.049637e-03 2.042810e+00
135 1.199189e-01 1.050513e-03 2.166130e+00
136 1.209695e-01 1.051714e-03 2.141651e+00
137 1.220212e-01 1.053221e-03 2.030663e+00
138 1.230744e-01 1.055028e-03 2.024476e+00
139 1.241294e-01 1.057127e-03 2.044502e+00
140 1.251865e-01 1.058428e-03 2.072805e+00
141 1.262450e-01 1.058526e-03 2.081273e+00
142 1.273035e-01 1.059215e-03 2.051133e+00
143 1.283627e-01 1.060074e-03 2.080128e+00
144 1.294228e-01 1.061136e-03 2.172298e+00
145 1.304839e-01 1.062428e-03 2.107848e+00
146 1.315464e-01 1.063969e-03 2.045928e+00
147 1.326103e-01 1.065810e-03 2.080634e+00
148 1.336761e-01 1.067951e-03 2.082604e+00
149 1.347441e-01 1.070403e-03 2.152658e+00
150 1.358145e-01 1.073178e-03 2.117296e+00
151 1.368877e-01 1.074569e-03 2.059615e+00
152 1.379622e-01 1.075792e-03 2.071910e+00
153 1.390380e-01 1.077235e-03 2.056270e+00
154 1.401153e-01 1.078837e-03 2.069456e+00
155 1.411941e-01 1.080632e-03 2.049092e+00
156 1.422747e-01 1.082645e-03 2.047298e+00
157 1.433574e-01 1.084902e-03 2.003497e+00
158 1.444423e-01 1.087426e-03 2.154065e+00
159 1.455297e-01 1.090258e-03 2.048002e+00
160 1.466200e-01 1.091337e-03 2.062457e+00
161 1.477113e-01 1.092838e-03 2.008669e+00
162 1.488041e-01 1.094487e-03 2.049789e+00
163 1.498986e-01 1.096301e-03 2.058764e+00
164 1.509949e-01 1.098301e-03 2.075756e+00
165 1.520932e-01 1.100511e-03 2.081075e+00
166 1.531937e-01 1.102955e-03 2.099657e+00
167 1.542967e-01 1.105588e-03 2.142944e+00
168 1.554023e-01 1.105179e-03 2.056242e+00
169 1.565075e-01 1.106103e-03 2.026459e+00
170 1.576136e-01 1.107180e-03 2.054796e+00
171 1.587207e-01 1.108443e-03 2.082841e+00
172 1.598292e-01 1.109917e-03 2.037104e+00
173 1.609391e-01 1.111653e-03 2.062975e+00
174 1.620508e-01 1.113675e-03 2.061683e+00
175 1.631644e-01 1.115997e-03 2.054145e+00
176 1.642804e-01 1.118087e-03 2.166214e+00
177 1.653985e-01 1.119280e-03 2.062438e+00
178 1.665178e-01 1.119711e-03 2.084122e+00
179 1.676375e-01 1.120705e-03 2.028480e+00
180 1.687582e-01 1.121887e-03 2.061085e+00
181 1.698801e-01 1.123280e-03 2.044518e+00
182 1.710034e-01 1.124912e-03 2.067475e+00
183 1.721283e-01 1.126805e-03 2.076496e+00
184 1.732551e-01 1.128561e-03 2.035594e+00
185 1.743837e-01 1.129897e-03 2.031919e+00
186 1.755136e-01 1.131479e-03 2.079316e+00
187 1.766450e-01 1.133324e-03 2.061058e+00
188 1.777784e-01 1.135436e-03 2.086807e+00
189 1.789138e-01 1.136778e-03 2.119209e+00
190 1.800506e-01 1.138110e-03 2.034191e+00
191 1.811887e-01 1.138755e-03 2.054238e+00
192 1.823274e-01 1.139775e-03 2.108637e+00
193 1.834672e-01 1.140993e-03 2.121815e+00
194 1.846082e-01 1.142438e-03 2.045106e+00
195 1.857506e-01 1.144129e-03 2.123324e+00
196 1.868948e-01 1.146083e-03 2.043658e+00
197 1.880409e-01 1.148316e-03 2.044621e+00
198 1.891892e-01 1.150837e-03 2.078039e+00
199 1.903400e-01 1.152090e-03 2.023182e+00
200 1.914921e-01 1.151809e-03 2.066299e+00
201 1.926439e-01 1.152862e-03 2.072391e+00
202 1.937968e-01 1.154064e-03 2.049542e+00
203 1.949508e-01 1.155446e-03 2.063218e+00
204 1.961063e-01 1.157034e-03 2.029252e+00
205 1.972633e-01 1.158865e-03 2.106815e+00
206 1.984222e-01 1.160974e-03 2.093666e+00
207 1.995831e-01 1.163388e-03 2.047904e+00
208 2.007465e-01 1.166135e-03 2.040610e+00
209 2.019127e-01 1.165497e-03 2.085226e+00
210 2.030782e-01 1.166063e-03 2.103706e+00
211 2.042442e-01 1.167227e-03 2.112514e+00
212 2.054115e-01 1.168551e-03 2.095106e+00
213 2.065800e-01 1.170063e-03 2.060618e+00
214 2.077501e-01 1.171796e-03 2.032560e+00
215 2.089219e-01 1.173788e-03 2.076631e+00
216 2.100957e-01 1.176089e-03 2.111457e+00
217 2.112717e-01 1.178736e-03 2.019097e+00
218 2.124505e-01 1.180854e-03 2.135772e+00
219 2.136313e-01 1.179998e-03 2.067922e+00
220 2.148113e-01 1.181091e-03 2.156090e+00
221 2.159924e-01 1.182348e-03 2.088984e+00
222 2.171748e-01 1.183811e-03 2.049058e+00
223 2.183586e-01 1.185519e-03 2.038733e+00
224 2.195441e-01 1.187511e-03 2.153708e+00
225 2.207316e-01 1.189820e-03 2.055320e+00
226 2.219214e-01 1.192480e-03 2.038358e+00
227 2.231139e-01 1.195078e-03 2.081828e+00
228 2.243090e-01 1.196453e-03 2.088112e+00
229 2.255054e-01 1.196284e-03 2.142527e+00
230 2.267017e-01 1.197583e-03 2.070242e+00
231 2.278993e-01 1.199042e-03 2.069999e+00
232 2.290984e-01 1.200720e-03 2.068355e+00
233 2.302991e-01 1.202420e-03 2.053868e+00
234 2.315015e-01 1.203848e-03 2.084827e+00
235 2.327053e-01 1.205479e-03 2.047863e+00
236 2.339108e-01 1.207339e-03 2.097943e+00
237 2.351182e-01 1.209464e-03 2.053902e+00
238 2.363276e-01 1.211887e-03 2.075677e+00
239 2.375395e-01 1.213901e-03 2.068339e+00
240 2.387534e-01 1.213450e-03 2.092218e+00
241 2.399669e-01 1.213868e-03 2.039781e+00
242 2.411807e-01 1.215170e-03 2.053308e+00
243 2.423959e-01 1.216635e-03 2.324599e+00
244 2.436125e-01 1.218270e-03 2.042939e+00
245 2.448308e-01 1.220106e-03 2.068906e+00
246 2.460509e-01 1.222198e-03 2.028424e+00
247 2.472731e-01 1.224591e-03 2.051441e+00
248 2.484977e-01 1.227315e-03 2.046930e+00
249 2.497250e-01 1.227694e-03 2.075489e+00
250 2.509527e-01 1.227270e-03 2.090468e+00
251 2.521800e-01 1.228536e-03 2.048275e+00
252 2.534085e-01 1.229949e-03 2.141603e+00
253 2.546385e-01 1.231539e-03 2.016784e+00
254 2.558700e-01 1.233348e-03 2.065825e+00
255 2.571034e-01 1.235414e-03 2.080935e+00
256 2.583388e-01 1.237769e-03 2.041852e+00
257 2.595765e-01 1.240445e-03 2.046142e+00
258 2.608170e-01 1.243052e-03 2.059415e+00
259 2.620600e-01 1.242183e-03 2.042986e+00
260 2.633022e-01 1.242545e-03 2.076786e+00
261 2.645448e-01 1.243909e-03 2.145294e+00
262 2.657887e-01 1.245436e-03 2.037870e+00
263 2.670341e-01 1.247185e-03 2.092900e+00
264 2.682813e-01 1.249192e-03 2.057356e+00
265 2.695305e-01 1.251485e-03 2.041081e+00
266 2.707820e-01 1.254093e-03 2.025775e+00
267 2.720361e-01 1.257059e-03 2.082301e+00
268 2.732931e-01 1.258164e-03 2.105146e+00
269 2.745513e-01 1.257534e-03 2.259204e+00
270 2.758088e-01 1.258710e-03 2.099726e+00
271 2.770675e-01 1.260223e-03 2.065492e+00
272 2.783277e-01 1.261924e-03 2.176552e+00
273 2.795897e-01 1.263871e-03 2.039007e+00
274 2.808535e-01 1.266092e-03 2.189978e+00
275 2.821196e-01 1.268623e-03 2.090602e+00
276 2.833883e-01 1.271469e-03 2.033387e+00
277 2.846597e-01 1.273641e-03 2.035360e+00
278 2.859334e-01 1.273950e-03 2.042041e+00
279 2.872073e-01 1.274021e-03 2.092241e+00
280 2.884813e-01 1.275487e-03 2.090116e+00
281 2.897568e-01 1.277094e-03 2.164409e+00
282 2.910339e-01 1.278711e-03 2.062279e+00
283 2.923126e-01 1.280232e-03 2.074424e+00
284 2.935929e-01 1.281916e-03 2.065848e+00
285 2.948748e-01 1.283801e-03 2.036101e+00
286 2.961586e-01 1.285915e-03 2.088830e+00
287 2.974445e-01 1.288288e-03 2.049629e+00
288 2.987328e-01 1.289999e-03 2.036806e+00
289 3.000228e-01 1.290572e-03 2.092533e+00
290 3.013134e-01 1.291014e-03 2.114116e+00
291 3.026044e-01 1.291747e-03 2.115428e+00
292 3.038961e-01 1.293214e-03 2.144596e+00
293 3.051893e-01 1.294841e-03 2.056788e+00
294 3.064842e-01 1.296664e-03 2.034274e+00
295 3.077808e-01 1.298711e-03 2.022767e+00
296 3.090795e-01 1.301009e-03 2.130835e+00
297 3.103806e-01 1.303586e-03 2.061697e+00
298 3.116841e-01 1.305732e-03 2.083028e+00
299 3.129899e-01 1.306064e-03 2.096916e+00
300 3.142959e-01 1.305714e-03 2.072167e+00
301 3.156016e-01 1.307067e-03 2.107847e+00
302 3.169087e-01 1.308675e-03 2.070678e+00
303 3.182174e-01 1.310451e-03 2.053906e+00
304 3.195278e-01 1.312427e-03 2.105527e+00
305 3.208403e-01 1.314625e-03 2.087073e+00
306 3.221549e-01 1.317089e-03 2.064097e+00
307 3.234720e-01 1.319868e-03 2.028911e+00
308 3.247918e-01 1.320717e-03 2.055874e+00
309 3.261126e-01 1.321072e-03 2.056674e+00
310 3.274336e-01 1.321248e-03 2.063765e+00
311 3.287549e-01 1.322796e-03 2.070381e+00
312 3.300777e-01 1.324465e-03 2.103863e+00
313 3.314021e-01 1.326289e-03 2.073344e+00
314 3.327284e-01 1.328302e-03 2.099492e+00
315 3.340567e-01 1.330552e-03 2.035998e+00
316 3.353873e-01 1.333097e-03 2.064194e+00
317 3.367204e-01 1.335299e-03 2.061097e+00
318 3.380557e-01 1.334787e-03 2.066413e+00
319 3.393905e-01 1.335055e-03 2.120975e+00
320 3.407255e-01 1.336436e-03 2.071289e+00
321 3.420620e-01 1.337896e-03 2.091771e+00
322 3.433999e-01 1.339489e-03 2.141749e+00
323 3.447394e-01 1.341272e-03 2.076427e+00
324 3.460806e-01 1.343293e-03 2.085439e+00
325 3.474239e-01 1.345586e-03 2.061934e+00
326 3.487695e-01 1.348167e-03 2.064338e+00
327 3.501177e-01 1.348520e-03 2.057056e+00
328 3.514662e-01 1.348085e-03 2.135547e+00
329 3.528143e-01 1.348438e-03 2.125681e+00
330 3.541627e-01 1.349859e-03 2.097149e+00
331 3.555126e-01 1.351353e-03 2.168172e+00
332 3.568639e-01 1.352973e-03 2.124401e+00
333 3.582169e-01 1.354781e-03 2.117609e+00
334 3.595717e-01 1.356825e-03 2.128832e+00
335 3.609285e-01 1.359138e-03 2.081106e+00
336 3.622876e-01 1.361736e-03 2.079222e+00
337 3.636494e-01 1.361286e-03 2.119801e+00
338 3.650107e-01 1.360980e-03 2.110654e+00
339 3.663716e-01 1.361623e-03 2.145538e+00
340 3.677333e-01 1.363101e-03 2.114995e+00
341 3.690964e-01 1.364659e-03 2.203630e+00
342 3.704610e-01 1.366343e-03 2.087108e+00
343 3.718274e-01 1.368209e-03 2.084641e+00
344 3.731956e-01 1.370302e-03 2.157428e+00
345 3.745659e-01 1.372662e-03 2.055710e+00
346 3.759385e-01 1.374462e-03 2.197863e+00
347 3.773130e-01 1.373867e-03 2.079540e+00
348 3.786869e-01 1.373716e-03 2.096360e+00
349 3.800606e-01 1.374714e-03 2.118888e+00
350 3.814353e-01 1.376238e-03 2.129518e+00
351 3.828115e-01 1.377850e-03 2.089712e+00
352 3.841894e-01 1.379589e-03 2.134784e+00
353 3.855690e-01 1.381505e-03 2.102670e+00
354 3.869505e-01 1.383642e-03 2.122914e+00
355 3.883341e-01 1.385804e-03 2.125232e+00
356 3.897199e-01 1.386800e-03 2.110872e+00
357 3.911067e-01 1.386373e-03 2.080393e+00
358 3.924931e-01 1.386376e-03 2.160199e+00
359 3.938795e-01 1.387708e-03 2.232696e+00
360 3.952672e-01 1.389275e-03 2.226980e+00
361 3.966565e-01 1.390938e-03 2.199015e+00
362 3.980474e-01 1.392732e-03 2.151376e+00
363 3.994401e-01 1.394700e-03 2.174000e+00
364 4.008348e-01 1.396646e-03 2.074693e+00
365 4.022315e-01 1.398773e-03 2.162352e+00
366 4.036302e-01 1.399060e-03 2.076441e+00
367 4.050293e-01 1.398806e-03 2.130188e+00
368 4.064281e-01 1.399065e-03 2.114724e+00
369 4.078272e-01 1.400599e-03 2.125980e+00
370 4.092278e-01 1.402215e-03 2.182606e+00
371 4.106300e-01 1.403934e-03 2.163996e+00
372 4.120339e-01 1.405791e-03 2.129336e+00
373 4.134397e-01 1.407664e-03 2.102032e+00
374 4.148474e-01 1.409617e-03 2.142954e+00
375 4.162570e-01 1.410964e-03 2.196955e+00
376 4.176680e-01 1.410769e-03 2.197427e+00
377 4.190787e-01 1.411183e-03 2.107391e+00
378 4.204899e-01 1.411847e-03 2.146686e+00
379 4.219018e-01 1.413433e-03 2.086219e+00
380 4.233152e-01 1.415108e-03 2.141878e+00
381 4.247303e-01 1.416893e-03 2.090466e+00
382 4.261472e-01 1.418820e-03 2.118131e+00
383 4.275660e-01 1.420653e-03 2.094739e+00
384 4.289867e-01 1.422668e-03 2.085103e+00
385 4.304093e-01 1.422336e-03 2.200445e+00
386 4.318317e-01 1.422310e-03 2.067447e+00
387 4.332540e-01 1.423210e-03 2.118897e+00
388 4.346772e-01 1.424656e-03 2.120280e+00
389 4.361018e-01 1.426207e-03 2.143361e+00
390 4.375281e-01 1.427885e-03 2.135703e+00
391 4.389559e-01 1.429714e-03 2.168310e+00
392 4.403857e-01 1.431730e-03 2.099289e+00
393 4.418174e-01 1.433806e-03 2.097454e+00
--- begin checkpoint ---
Saved 37449 sub-grids with 7257091954 bytes written
--- end checkpoint ---
--- begin output ---
--- end output ---
394 4.432512e-01 1.433884e-03 3.685314e+01
395 4.446851e-01 1.433658e-03 2.076773e+00
396 4.461187e-01 1.433799e-03 2.084090e+00
397 4.475525e-01 1.435113e-03 2.061125e+00
398 4.489876e-01 1.436611e-03 2.123185e+00
399 4.504243e-01 1.438218e-03 2.114318e+00
400 4.518625e-01 1.439955e-03 2.053277e+00
401 4.533024e-01 1.441843e-03 2.099724e+00
402 4.547443e-01 1.443919e-03 2.075370e+00
403 4.561882e-01 1.445436e-03 2.054079e+00
404 4.576336e-01 1.445011e-03 2.115071e+00
405 4.590786e-01 1.444962e-03 2.074474e+00
406 4.605236e-01 1.445484e-03 2.109894e+00
407 4.619691e-01 1.446946e-03 2.094029e+00
408 4.634160e-01 1.448505e-03 2.112195e+00
409 4.648645e-01 1.450178e-03 2.101018e+00
410 4.663147e-01 1.451986e-03 2.127512e+00
411 4.677667e-01 1.453949e-03 2.155509e+00
412 4.692206e-01 1.456099e-03 2.099515e+00
413 4.706767e-01 1.456412e-03 2.142600e+00
414 4.721332e-01 1.456170e-03 2.127829e+00
415 4.735893e-01 1.456290e-03 2.119882e+00
416 4.750456e-01 1.457270e-03 2.152717e+00
417 4.765029e-01 1.458782e-03 2.116910e+00
418 4.779617e-01 1.460400e-03 2.119831e+00
419 4.794221e-01 1.462140e-03 2.118931e+00
420 4.808842e-01 1.464021e-03 2.110713e+00
421 4.823482e-01 1.466062e-03 2.193454e+00
422 4.838143e-01 1.467868e-03 2.162914e+00
423 4.852822e-01 1.467443e-03 2.132194e+00
424 4.867496e-01 1.467385e-03 2.164604e+00
425 4.882170e-01 1.467665e-03 2.119564e+00
426 4.896847e-01 1.469106e-03 2.201319e+00
427 4.911538e-01 1.470665e-03 2.122210e+00
428 4.926244e-01 1.472339e-03 2.146550e+00
429 4.940968e-01 1.474146e-03 2.171322e+00
430 4.955709e-01 1.476103e-03 2.208355e+00
431 4.970470e-01 1.478228e-03 2.155927e+00
432 4.985252e-01 1.478821e-03 2.161031e+00
433 5.000041e-01 1.478594e-03 2.116335e+00
434 5.014827e-01 1.478721e-03 2.127742e+00
435 5.029614e-01 1.479466e-03 2.136531e+00
436 5.044408e-01 1.480981e-03 2.120321e+00
437 5.059218e-01 1.482596e-03 2.168898e+00
438 5.074044e-01 1.484332e-03 2.209559e+00
439 5.088887e-01 1.486207e-03 2.103707e+00
440 5.103750e-01 1.488240e-03 2.120026e+00
441 5.118632e-01 1.490270e-03 2.081018e+00
442 5.133535e-01 1.489876e-03 2.103378e+00
443 5.148433e-01 1.489849e-03 2.138045e+00
444 5.163332e-01 1.490164e-03 2.134004e+00
445 5.178234e-01 1.491377e-03 2.161700e+00
446 5.193147e-01 1.492950e-03 2.188148e+00
447 5.208077e-01 1.494629e-03 2.114933e+00
448 5.223023e-01 1.496432e-03 2.110983e+00
449 5.237987e-01 1.498379e-03 2.102595e+00
450 5.252971e-01 1.500486e-03 2.130041e+00
451 5.267976e-01 1.501259e-03 2.132531e+00
452 5.282989e-01 1.501087e-03 2.239507e+00
453 5.298000e-01 1.501263e-03 2.151739e+00
454 5.313012e-01 1.501840e-03 2.113962e+00
455 5.328031e-01 1.503394e-03 2.182170e+00
456 5.343065e-01 1.505031e-03 2.291961e+00
457 5.358115e-01 1.506777e-03 2.140724e+00
458 5.373183e-01 1.508652e-03 2.116911e+00
459 5.388269e-01 1.510674e-03 2.263346e+00
460 5.403376e-01 1.512756e-03 2.137130e+00
461 5.418503e-01 1.512441e-03 2.177613e+00
462 5.433628e-01 1.512484e-03 2.126499e+00
463 5.448753e-01 1.512859e-03 2.181631e+00
464 5.463881e-01 1.513918e-03 2.170704e+00
465 5.479020e-01 1.515536e-03 2.112480e+00
466 5.494176e-01 1.517241e-03 2.103169e+00
467 5.509348e-01 1.519058e-03 2.150356e+00
468 5.524539e-01 1.521009e-03 2.120872e+00
469 5.539749e-01 1.523109e-03 2.154501e+00
470 5.554980e-01 1.523892e-03 2.099922e+00
471 5.570219e-01 1.523803e-03 2.147091e+00
472 5.585457e-01 1.524053e-03 2.103134e+00
473 5.600697e-01 1.524622e-03 2.094888e+00
474 5.615944e-01 1.526149e-03 2.149110e+00
475 5.631205e-01 1.527830e-03 2.246940e+00
476 5.646483e-01 1.529604e-03 2.150339e+00
477 5.661779e-01 1.531492e-03 2.110671e+00
478 5.677094e-01 1.533516e-03 2.152478e+00
479 5.692430e-01 1.535429e-03 2.156735e+00
480 5.707784e-01 1.535221e-03 2.127597e+00
481 5.723136e-01 1.535358e-03 2.131878e+00
482 5.738490e-01 1.535814e-03 2.158489e+00
483 5.753848e-01 1.536815e-03 2.201555e+00
484 5.769216e-01 1.538475e-03 2.155658e+00
485 5.784601e-01 1.540217e-03 2.132543e+00
486 5.800003e-01 1.542060e-03 2.173994e+00
487 5.815423e-01 1.544019e-03 2.136501e+00
488 5.830864e-01 1.546115e-03 2.156299e+00
489 5.846325e-01 1.546543e-03 2.104289e+00
490 5.861790e-01 1.546674e-03 2.129818e+00
491 5.877257e-01 1.547029e-03 2.144466e+00
492 5.892727e-01 1.547685e-03 2.158039e+00
493 5.908204e-01 1.549173e-03 2.143423e+00
494 5.923696e-01 1.550887e-03 2.125918e+00
495 5.939205e-01 1.552686e-03 2.150266e+00
496 5.954732e-01 1.554589e-03 2.132734e+00
497 5.970277e-01 1.556612e-03 2.168955e+00
498 5.985844e-01 1.557098e-03 2.185408e+00
499 6.001415e-01 1.557209e-03 2.093102e+00
500 6.016987e-01 1.557600e-03 2.309645e+00
501 6.032563e-01 1.558409e-03 2.115593e+00
502 6.048147e-01 1.559821e-03 2.105386e+00
503 6.063745e-01 1.561431e-03 2.093386e+00
504 6.079359e-01 1.563059e-03 2.094249e+00
505 6.094990e-01 1.564788e-03 2.117941e+00
506 6.110638e-01 1.566632e-03 2.112130e+00
507 6.126304e-01 1.567650e-03 2.122263e+00
508 6.141981e-01 1.567662e-03 2.107395e+00
509 6.157657e-01 1.567963e-03 2.132850e+00
510 6.173337e-01 1.568530e-03 2.117918e+00
511 6.189022e-01 1.569851e-03 2.253994e+00
512 6.204721e-01 1.571363e-03 2.128537e+00
513 6.220434e-01 1.572950e-03 2.113141e+00
514 6.236164e-01 1.574628e-03 2.154983e+00
515 6.251910e-01 1.576414e-03 2.127372e+00
516 6.267674e-01 1.578162e-03 2.124977e+00
517 6.283456e-01 1.578067e-03 2.109353e+00
518 6.299236e-01 1.578272e-03 2.124642e+00
519 6.315019e-01 1.578748e-03 2.122578e+00
520 6.330807e-01 1.579722e-03 2.145205e+00
521 6.346604e-01 1.581208e-03 2.146712e+00
522 6.362416e-01 1.582759e-03 2.158958e+00
523 6.378244e-01 1.584392e-03 2.195554e+00
524 6.394087e-01 1.586124e-03 2.079757e+00
525 6.409949e-01 1.587968e-03 2.119618e+00
526 6.425828e-01 1.588424e-03 2.093523e+00
527 6.441713e-01 1.588525e-03 2.103435e+00
528 6.457598e-01 1.588905e-03 2.181016e+00
529 6.473487e-01 1.589537e-03 2.170361e+00
530 6.489382e-01 1.590992e-03 2.155013e+00
531 6.505292e-01 1.592505e-03 2.133283e+00
532 6.521217e-01 1.594092e-03 2.125950e+00
533 6.537158e-01 1.595770e-03 2.125922e+00
534 6.553116e-01 1.597552e-03 2.107759e+00
535 6.569091e-01 1.598707e-03 2.136199e+00
536 6.585078e-01 1.598701e-03 2.115683e+00
537 6.601065e-01 1.598985e-03 2.152548e+00
538 6.617055e-01 1.599530e-03 2.190957e+00
539 6.633051e-01 1.600655e-03 2.121576e+00
540 6.649057e-01 1.602134e-03 2.169928e+00
541 6.665078e-01 1.603678e-03 2.148099e+00
542 6.681115e-01 1.605305e-03 2.148596e+00
543 6.697168e-01 1.607029e-03 2.138825e+00
544 6.713239e-01 1.608863e-03 2.131073e+00
545 6.729327e-01 1.608793e-03 2.212629e+00
546 6.745415e-01 1.608972e-03 2.153026e+00
547 6.761505e-01 1.609422e-03 2.326234e+00
548 6.777599e-01 1.610230e-03 2.164649e+00
549 6.793701e-01 1.611676e-03 2.181925e+00
550 6.809818e-01 1.613180e-03 2.308816e+00
551 6.825950e-01 1.614756e-03 2.150880e+00
552 6.842098e-01 1.616422e-03 2.136566e+00
553 6.858262e-01 1.618190e-03 2.166926e+00
554 6.874444e-01 1.618797e-03 2.148896e+00
555 6.890632e-01 1.618866e-03 2.148487e+00
556 6.906820e-01 1.619214e-03 2.145702e+00
557 6.923012e-01 1.619816e-03 2.230608e+00
558 6.939211e-01 1.621099e-03 2.198979e+00
559 6.955422e-01 1.622562e-03 2.136614e+00
560 6.971647e-01 1.624091e-03 2.142721e+00
561 6.987888e-01 1.625700e-03 2.232517e+00
562 7.004145e-01 1.627405e-03 2.160766e+00
563 7.020419e-01 1.628730e-03 2.147765e+00
564 7.036706e-01 1.628672e-03 2.261221e+00
565 7.052993e-01 1.628907e-03 2.164665e+00
566 7.069282e-01 1.629405e-03 2.150623e+00
567 7.085576e-01 1.630380e-03 2.180544e+00
568 7.101880e-01 1.631802e-03 2.178793e+00
569 7.118198e-01 1.633283e-03 2.170398e+00
570 7.134531e-01 1.634838e-03 2.183145e+00
571 7.150879e-01 1.636481e-03 2.220153e+00
572 7.167244e-01 1.638226e-03 2.152115e+00
573 7.183626e-01 1.638388e-03 2.284086e+00
574 7.200010e-01 1.638496e-03 2.151018e+00
575 7.216395e-01 1.638877e-03 2.181824e+00
576 7.232784e-01 1.639534e-03 2.228123e+00
577 7.249179e-01 1.640914e-03 2.199005e+00
578 7.265589e-01 1.642346e-03 2.234833e+00
579 7.282012e-01 1.643844e-03 2.176312e+00
580 7.298450e-01 1.645423e-03 2.227696e+00
581 7.314905e-01 1.647098e-03 2.266759e+00
582 7.331376e-01 1.648046e-03 2.291071e+00
583 7.347856e-01 1.648008e-03 2.156818e+00
584 7.364336e-01 1.648258e-03 2.241920e+00
585 7.380819e-01 1.648766e-03 2.208900e+00
586 7.397306e-01 1.649862e-03 2.184048e+00
587 7.413805e-01 1.651244e-03 2.232988e+00
588 7.430317e-01 1.652686e-03 2.152811e+00
589 7.446844e-01 1.654203e-03 2.178556e+00
590 7.463386e-01 1.655809e-03 2.217582e+00
591 7.479944e-01 1.657516e-03 2.183408e+00
592 7.496520e-01 1.657404e-03 2.213714e+00
593 7.513094e-01 1.657510e-03 2.234760e+00
594 7.529669e-01 1.657888e-03 2.260483e+00
595 7.546248e-01 1.658649e-03 2.213653e+00
596 7.562834e-01 1.659982e-03 2.189258e+00
597 7.579434e-01 1.661369e-03 2.199624e+00
598 7.596048e-01 1.662825e-03 2.316129e+00
599 7.612676e-01 1.664364e-03 2.217315e+00
600 7.629320e-01 1.665998e-03 2.314102e+00
601 7.645979e-01 1.666729e-03 4.109684e+00
602 7.662647e-01 1.666672e-03 2.783217e+00
603 7.679314e-01 1.666905e-03 2.192052e+00
604 7.695983e-01 1.667398e-03 2.175805e+00
605 7.712657e-01 1.668573e-03 2.224875e+00
606 7.729342e-01 1.669904e-03 2.234165e+00
607 7.746041e-01 1.671297e-03 2.287897e+00
608 7.762754e-01 1.672767e-03 2.254361e+00
609 7.779482e-01 1.674327e-03 2.201713e+00
610 7.796225e-01 1.675953e-03 2.217296e+00
611 7.812985e-01 1.675722e-03 2.235372e+00
612 7.829742e-01 1.675800e-03 2.235671e+00
613 7.846500e-01 1.676151e-03 2.188988e+00
614 7.863261e-01 1.676974e-03 2.164524e+00
615 7.880031e-01 1.678253e-03 2.352306e+00
616 7.896814e-01 1.679587e-03 2.244748e+00
617 7.913610e-01 1.680992e-03 2.213903e+00
618 7.930420e-01 1.682481e-03 2.246608e+00
619 7.947244e-01 1.684066e-03 2.206262e+00
620 7.964085e-01 1.684719e-03 2.260872e+00
621 7.980932e-01 1.684622e-03 2.256353e+00
622 7.997778e-01 1.684816e-03 2.209365e+00
623 8.014627e-01 1.685265e-03 2.236357e+00
624 8.031479e-01 1.686478e-03 2.278557e+00
625 8.048344e-01 1.687749e-03 2.241684e+00
626 8.065221e-01 1.689085e-03 2.214623e+00
627 8.082112e-01 1.690498e-03 2.212049e+00
628 8.099017e-01 1.692002e-03 2.216065e+00
629 8.115937e-01 1.693608e-03 2.250500e+00
630 8.132873e-01 1.693402e-03 2.487919e+00
631 8.149807e-01 1.693421e-03 2.271739e+00
632 8.166742e-01 1.693715e-03 2.240058e+00
633 8.183679e-01 1.694533e-03 2.312070e+00
634 8.200624e-01 1.695744e-03 2.277884e+00
635 8.217582e-01 1.697012e-03 2.234459e+00
636 8.234552e-01 1.698352e-03 2.247475e+00
637 8.251535e-01 1.699777e-03 2.224366e+00
638 8.268533e-01 1.701298e-03 2.243014e+00
639 8.285546e-01 1.702105e-03 2.258962e+00
640 8.302567e-01 1.701933e-03 2.212348e+00
641 8.319586e-01 1.702056e-03 2.200493e+00
642 8.336607e-01 1.702447e-03 2.248321e+00
643 8.353631e-01 1.703601e-03 2.199639e+00
644 8.370667e-01 1.704803e-03 2.230004e+00
645 8.387715e-01 1.706069e-03 2.258600e+00
646 8.404776e-01 1.707415e-03 2.319363e+00
647 8.421850e-01 1.708851e-03 2.201017e+00
648 8.438939e-01 1.710393e-03 2.242240e+00
649 8.456043e-01 1.710408e-03 2.270705e+00
650 8.473147e-01 1.710342e-03 2.223378e+00
651 8.490250e-01 1.710556e-03 2.220351e+00
652 8.507356e-01 1.711279e-03 2.253199e+00
653 8.524469e-01 1.712423e-03 2.225352e+00
654 8.541593e-01 1.713623e-03 2.252557e+00
655 8.558729e-01 1.714893e-03 2.220693e+00
656 8.575878e-01 1.716248e-03 2.239006e+00
657 8.593040e-01 1.717699e-03 2.372498e+00
658 8.610217e-01 1.718814e-03 2.216281e+00
659 8.627406e-01 1.718547e-03 2.237767e+00
660 8.644591e-01 1.718577e-03 2.238556e+00
661 8.661777e-01 1.718874e-03 2.282446e+00
662 8.678965e-01 1.719898e-03 2.262893e+00
663 8.696164e-01 1.721034e-03 2.242142e+00
664 8.713375e-01 1.722231e-03 2.336365e+00
665 8.730597e-01 1.723504e-03 2.293397e+00
666 8.747832e-01 1.724866e-03 2.241332e+00
667 8.765081e-01 1.726334e-03 2.282211e+00
668 8.782344e-01 1.726712e-03 2.321134e+00
669 8.799611e-01 1.726543e-03 2.259146e+00
670 8.816877e-01 1.726656e-03 2.242618e+00
671 8.834143e-01 1.727191e-03 2.262293e+00
--- begin checkpoint ---
Saved 37449 sub-grids with 7257091954 bytes written
--- end checkpoint ---
--- begin output ---
--- end output ---
672 8.851415e-01 1.728270e-03 4.535049e+01
673 8.868698e-01 1.729402e-03 2.229933e+00
674 8.885992e-01 1.730599e-03 2.316322e+00
675 8.903298e-01 1.731876e-03 2.213937e+00
676 8.920617e-01 1.733249e-03 2.226704e+00
677 8.937949e-01 1.734733e-03 2.269092e+00
678 8.955296e-01 1.710428e-03 2.244253e+00
679 8.972401e-01 1.684683e-03 2.284406e+00
680 8.989248e-01 1.663721e-03 2.259791e+00
681 9.005885e-01 1.648062e-03 2.241500e+00
682 9.022365e-01 1.634732e-03 2.261114e+00
683 9.038713e-01 1.624805e-03 2.276371e+00
684 9.054961e-01 1.617098e-03 2.266873e+00
685 9.071132e-01 1.589093e-03 2.270640e+00
686 9.087023e-01 1.566504e-03 2.291145e+00
687 9.102688e-01 1.548910e-03 2.283356e+00
688 9.118177e-01 1.535463e-03 2.241103e+00
689 9.133531e-01 1.525112e-03 2.263395e+00
690 9.148783e-01 1.517170e-03 2.326104e+00
691 9.163954e-01 1.511205e-03 2.310409e+00
692 9.179066e-01 1.506882e-03 2.359317e+00
693 9.194135e-01 1.503977e-03 2.262388e+00
694 9.209175e-01 1.502334e-03 2.218472e+00
695 9.224198e-01 1.501846e-03 2.385209e+00
696 9.239217e-01 1.502430e-03 2.245616e+00
697 9.254241e-01 1.504058e-03 2.270045e+00
698 9.269282e-01 1.506823e-03 2.237736e+00
699 9.284350e-01 1.510730e-03 2.233483e+00
700 9.299457e-01 1.509341e-03 2.265181e+00
701 9.314551e-01 1.508026e-03 2.297161e+00
702 9.329631e-01 1.507851e-03 2.242036e+00
703 9.344709e-01 1.508739e-03 2.283561e+00
704 9.359797e-01 1.510614e-03 2.225427e+00
705 9.374903e-01 1.507766e-03 2.216687e+00
706 9.389981e-01 1.502521e-03 2.252613e+00
707 9.405006e-01 1.499841e-03 2.287820e+00
708 9.420004e-01 1.499045e-03 2.269105e+00
709 9.434995e-01 1.499747e-03 2.271416e+00
710 9.449992e-01 1.501325e-03 2.332408e+00
711 9.465005e-01 1.500252e-03 2.245317e+00
712 9.480008e-01 1.498601e-03 2.267024e+00
713 9.494994e-01 1.498762e-03 2.330902e+00
714 9.509981e-01 1.500519e-03 2.273114e+00
715 9.524987e-01 1.503011e-03 2.288819e+00
716 9.540017e-01 1.505729e-03 2.235903e+00
717 9.555074e-01 1.503910e-03 2.270205e+00
718 9.570113e-01 1.479330e-03 2.285660e+00
719 9.584906e-01 1.459376e-03 2.296206e+00
720 9.599500e-01 1.444619e-03 2.246129e+00
721 9.613946e-01 1.431361e-03 2.257110e+00
722 9.628260e-01 1.417690e-03 2.258861e+00
723 9.642437e-01 1.406853e-03 2.241799e+00
724 9.656505e-01 1.398136e-03 2.344317e+00
725 9.670487e-01 1.391002e-03 2.291843e+00
726 9.684397e-01 1.385080e-03 2.286875e+00
727 9.698248e-01 1.380208e-03 2.266589e+00
728 9.712050e-01 1.376376e-03 2.262990e+00
729 9.725813e-01 1.373623e-03 2.284920e+00
730 9.739550e-01 1.372140e-03 2.258706e+00
731 9.753271e-01 1.371961e-03 2.295305e+00
732 9.766991e-01 1.372989e-03 2.434399e+00
733 9.780721e-01 1.375126e-03 2.254344e+00
734 9.794472e-01 1.372944e-03 2.285499e+00
735 9.808201e-01 1.370880e-03 2.361422e+00
736 9.821910e-01 1.370132e-03 2.306799e+00
737 9.835611e-01 1.363280e-03 2.358165e+00
738 9.849244e-01 1.356320e-03 2.261615e+00
739 9.862807e-01 1.351074e-03 2.331451e+00
740 9.876318e-01 1.347329e-03 2.300055e+00
741 9.889791e-01 1.344543e-03 2.349661e+00
742 9.903237e-01 1.342454e-03 2.322795e+00
743 9.916661e-01 1.340983e-03 2.283320e+00
744 9.930071e-01 1.340158e-03 2.303726e+00
745 9.943473e-01 1.340104e-03 2.276304e+00
746 9.956874e-01 1.340861e-03 2.328701e+00
747 9.970282e-01 1.342633e-03 2.344667e+00
748 9.983709e-01 1.342697e-03 2.357898e+00
749 9.997136e-01 1.340993e-03 2.296737e+00
750 1.001055e+00 1.339905e-03 2.296617e+00
751 1.002394e+00 1.339480e-03 2.296989e+00
752 1.003734e+00 1.339828e-03 2.264263e+00
753 1.005074e+00 1.340975e-03 2.302247e+00
754 1.006415e+00 1.342204e-03 2.298424e+00
755 1.007757e+00 1.338228e-03 2.366548e+00
756 1.009095e+00 1.335242e-03 2.272546e+00
757 1.010430e+00 1.333683e-03 2.288935e+00
758 1.011764e+00 1.333681e-03 2.371215e+00
759 1.013098e+00 1.335078e-03 2.317372e+00
760 1.014433e+00 1.337874e-03 2.451147e+00
761 1.015771e+00 1.336951e-03 2.315976e+00
762 1.017108e+00 1.333559e-03 2.296173e+00
763 1.018441e+00 1.330984e-03 2.332192e+00
764 1.019772e+00 1.329352e-03 2.342047e+00
765 1.021102e+00 1.329068e-03 2.311420e+00
766 1.022431e+00 1.330297e-03 2.375783e+00
767 1.023761e+00 1.333042e-03 2.354661e+00
768 1.025094e+00 1.323692e-03 2.373273e+00
769 1.026418e+00 1.313103e-03 2.385808e+00
770 1.027731e+00 1.305490e-03 2.348570e+00
771 1.029036e+00 1.300119e-03 2.395751e+00
772 1.030336e+00 1.296409e-03 2.373171e+00
773 1.031633e+00 1.293925e-03 2.312369e+00
774 1.032927e+00 1.292378e-03 2.305307e+00
775 1.034219e+00 1.291603e-03 2.338610e+00
776 1.035511e+00 1.291652e-03 2.331488e+00
777 1.036802e+00 1.292491e-03 2.337251e+00
778 1.038095e+00 1.294094e-03 2.396470e+00
779 1.039389e+00 1.295569e-03 2.360614e+00
780 1.040685e+00 1.293335e-03 2.338770e+00
781 1.041978e+00 1.292072e-03 2.325247e+00
782 1.043270e+00 1.291852e-03 2.443282e+00
783 1.044562e+00 1.292459e-03 2.372775e+00
784 1.045854e+00 1.293818e-03 2.321412e+00
785 1.047148e+00 1.289999e-03 2.337726e+00
786 1.048438e+00 1.285584e-03 2.396328e+00
787 1.049724e+00 1.281869e-03 2.392724e+00
788 1.051006e+00 1.278624e-03 2.337486e+00
789 1.052284e+00 1.275657e-03 2.333880e+00
790 1.053560e+00 1.273152e-03 2.355864e+00
791 1.054833e+00 1.271573e-03 2.419533e+00
792 1.056105e+00 1.270944e-03 2.352935e+00
793 1.057375e+00 1.271124e-03 2.371979e+00
794 1.058647e+00 1.272065e-03 2.362625e+00
795 1.059919e+00 1.273900e-03 2.353996e+00
796 1.061193e+00 1.276019e-03 2.416392e+00
797 1.062469e+00 1.273155e-03 2.377250e+00
798 1.063742e+00 1.270837e-03 2.341522e+00
799 1.065013e+00 1.269415e-03 2.382621e+00
800 1.066282e+00 1.268834e-03 2.374831e+00
801 1.067551e+00 1.268925e-03 2.409775e+00
802 1.068820e+00 1.269650e-03 2.415401e+00
803 1.070089e+00 1.271269e-03 2.373611e+00
804 1.071361e+00 1.271968e-03 2.439551e+00
805 1.072633e+00 1.268232e-03 2.367358e+00
806 1.073901e+00 1.264872e-03 2.387044e+00
807 1.075166e+00 1.261990e-03 2.440697e+00
808 1.076428e+00 1.259719e-03 2.402618e+00
809 1.077687e+00 1.258260e-03 2.382822e+00
810 1.078946e+00 1.257707e-03 2.381842e+00
811 1.080203e+00 1.257982e-03 2.425897e+00
812 1.081461e+00 1.258983e-03 2.407843e+00
813 1.082720e+00 1.260701e-03 2.393985e+00
814 1.083981e+00 1.262936e-03 2.355464e+00
815 1.085244e+00 1.260249e-03 2.370052e+00
816 1.086504e+00 1.257974e-03 2.408921e+00
817 1.087762e+00 1.256181e-03 2.444224e+00
818 1.089018e+00 1.255043e-03 2.427410e+00
819 1.090273e+00 1.254701e-03 2.389297e+00
820 1.091528e+00 1.255171e-03 2.425111e+00
821 1.092783e+00 1.256394e-03 2.420508e+00
822 1.094040e+00 1.258507e-03 2.483660e+00
823 1.095298e+00 1.261609e-03 2.384739e+00
824 1.096560e+00 1.265687e-03 2.380274e+00
825 1.097826e+00 1.269856e-03 2.522870e+00
826 1.099095e+00 1.271138e-03 2.420720e+00
827 1.100367e+00 1.272896e-03 2.397877e+00
828 1.101639e+00 1.275574e-03 2.451821e+00
829 1.102915e+00 1.271824e-03 2.411902e+00
830 1.104187e+00 1.268950e-03 2.456503e+00
831 1.105456e+00 1.267002e-03 2.437205e+00
832 1.106723e+00 1.265967e-03 2.464472e+00
833 1.107989e+00 1.265797e-03 2.443324e+00
834 1.109255e+00 1.266503e-03 2.412911e+00
835 1.110521e+00 1.268138e-03 2.406884e+00
836 1.111789e+00 1.270838e-03 2.409780e+00
837 1.113060e+00 1.274785e-03 2.460685e+00
838 1.114335e+00 1.279393e-03 2.425862e+00
839 1.115614e+00 1.284175e-03 2.457120e+00
840 1.116898e+00 1.288908e-03 2.425781e+00
841 1.118187e+00 1.263418e-03 2.433976e+00
842 1.119451e+00 1.264575e-03 2.430468e+00
843 1.120715e+00 1.278967e-03 2.450176e+00
844 1.121994e+00 1.297879e-03 2.439620e+00
845 1.123292e+00 1.302234e-03 2.486643e+00
846 1.124594e+00 1.297553e-03 2.431512e+00
847 1.125892e+00 1.291808e-03 2.448894e+00
848 1.127184e+00 1.288694e-03 2.520547e+00
849 1.128472e+00 1.287402e-03 2.482090e+00
850 1.129760e+00 1.287158e-03 2.421842e+00
851 1.131047e+00 1.287353e-03 2.462521e+00
852 1.132334e+00 1.287586e-03 2.449671e+00
853 1.133622e+00 1.287516e-03 2.462589e+00
854 1.134909e+00 1.287248e-03 2.449409e+00
855 1.136197e+00 1.286506e-03 2.440379e+00
856 1.137483e+00 1.285181e-03 2.474386e+00
857 1.138768e+00 1.283876e-03 2.503658e+00
858 1.140052e+00 1.282369e-03 2.451473e+00
859 1.141335e+00 1.281328e-03 2.507168e+00
860 1.142616e+00 1.280719e-03 2.503476e+00
861 1.143897e+00 1.277619e-03 2.408425e+00
862 1.145174e+00 1.274638e-03 2.451800e+00
863 1.146449e+00 1.273605e-03 2.482062e+00
864 1.147723e+00 1.273758e-03 2.464749e+00
865 1.148996e+00 1.261666e-03 2.550373e+00
866 1.150258e+00 1.252879e-03 2.487031e+00
867 1.151511e+00 1.248253e-03 2.459669e+00
868 1.152759e+00 1.247652e-03 2.471979e+00
869 1.154007e+00 1.250558e-03 2.524611e+00
870 1.155257e+00 1.256470e-03 2.487252e+00
871 1.156514e+00 1.264908e-03 2.512129e+00
872 1.157779e+00 1.269859e-03 2.486900e+00
873 1.159049e+00 1.268143e-03 2.499503e+00
874 1.160317e+00 1.266494e-03 2.459315e+00
875 1.161583e+00 1.264952e-03 2.498359e+00
876 1.162848e+00 1.263516e-03 2.499541e+00
877 1.164112e+00 1.262202e-03 2.573936e+00
878 1.165374e+00 1.261293e-03 2.510993e+00
879 1.166635e+00 1.260932e-03 2.517920e+00
880 1.167896e+00 1.261230e-03 2.668945e+00
881 1.169157e+00 1.262182e-03 2.513803e+00
882 1.170419e+00 1.263743e-03 2.467184e+00
883 1.171683e+00 1.266050e-03 2.572080e+00
884 1.172949e+00 1.265760e-03 2.480992e+00
885 1.174215e+00 1.263083e-03 2.484625e+00
886 1.175478e+00 1.260624e-03 2.526046e+00
887 1.176739e+00 1.254723e-03 2.562009e+00
888 1.177993e+00 1.248309e-03 2.542135e+00
889 1.179242e+00 1.242471e-03 2.496743e+00
890 1.180484e+00 1.237119e-03 2.575085e+00
891 1.181721e+00 1.232111e-03 2.564656e+00
892 1.182953e+00 1.227474e-03 2.521401e+00
893 1.184181e+00 1.223109e-03 2.593614e+00
894 1.185404e+00 1.218725e-03 2.535813e+00
895 1.186623e+00 1.214253e-03 2.611035e+00
896 1.187837e+00 1.208045e-03 2.482728e+00
897 1.189045e+00 1.201347e-03 2.574487e+00
898 1.190246e+00 1.195220e-03 2.511380e+00
899 1.191442e+00 1.189910e-03 2.541798e+00
900 1.192632e+00 1.185300e-03 2.594294e+00
901 1.193817e+00 1.180979e-03 2.610951e+00
902 1.194998e+00 1.176921e-03 2.577016e+00
903 1.196175e+00 1.173354e-03 2.535428e+00
904 1.197348e+00 1.170394e-03 2.573441e+00
905 1.198518e+00 1.167338e-03 2.571335e+00
906 1.199686e+00 1.164165e-03 2.572794e+00
907 1.200850e+00 1.160979e-03 2.563484e+00
908 1.202011e+00 1.157518e-03 2.553533e+00
909 1.203168e+00 1.154234e-03 2.556653e+00
910 1.204323e+00 1.151189e-03 2.593025e+00
911 1.205474e+00 1.138400e-03 2.560519e+00
912 1.206612e+00 1.099375e-03 2.516295e+00
913 1.207712e+00 1.065142e-03 2.543071e+00
914 1.208777e+00 1.034316e-03 2.520006e+00
915 1.209811e+00 1.006377e-03 2.507756e+00
916 1.210818e+00 9.823895e-04 2.511295e+00
917 1.211800e+00 9.787625e-04 2.561230e+00
918 1.212779e+00 9.847162e-04 2.526467e+00
919 1.213763e+00 9.927967e-04 2.494701e+00
920 1.214756e+00 9.997025e-04 2.557546e+00
921 1.215756e+00 1.004478e-03 2.527629e+00
922 1.216760e+00 9.812233e-04 2.528466e+00
923 1.217742e+00 9.579304e-04 2.521481e+00
924 1.218700e+00 9.559229e-04 2.545396e+00
925 1.219655e+00 9.635454e-04 2.518798e+00
926 1.220619e+00 9.733308e-04 2.554370e+00
927 1.221592e+00 9.815190e-04 2.539131e+00
928 1.222574e+00 9.872920e-04 2.484867e+00
929 1.223561e+00 9.911688e-04 2.572340e+00
930 1.224552e+00 9.937642e-04 2.523771e+00
931 1.225546e+00 9.945152e-04 2.518566e+00
932 1.226541e+00 9.877374e-04 2.472071e+00
933 1.227528e+00 9.802432e-04 2.548802e+00
934 1.228509e+00 9.746860e-04 2.521984e+00
935 1.229483e+00 9.723449e-04 2.581328e+00
936 1.230456e+00 9.732415e-04 2.520789e+00
937 1.231429e+00 9.789452e-04 2.556979e+00
938 1.232408e+00 9.809510e-04 2.522867e+00
939 1.233389e+00 9.758144e-04 2.474508e+00
940 1.234365e+00 9.709375e-04 2.535517e+00
941 1.235335e+00 9.690155e-04 2.557310e+00
942 1.236304e+00 9.706618e-04 2.504029e+00
943 1.237275e+00 9.775904e-04 2.594839e+00
944 1.238253e+00 9.885831e-04 2.632430e+00
945 1.239241e+00 1.003205e-03 2.555376e+00
946 1.240245e+00 1.021966e-03 2.554030e+00
947 1.241266e+00 9.955850e-04 2.604384e+00
948 1.242262e+00 9.714356e-04 2.552065e+00
949 1.243234e+00 9.515696e-04 2.557531e+00
950 1.244185e+00 9.337162e-04 2.596330e+00
951 1.245119e+00 9.150238e-04 2.585310e+00
952 1.246034e+00 8.965641e-04 2.534732e+00
953 1.246930e+00 8.790517e-04 2.608475e+00
954 1.247809e+00 8.637852e-04 2.547364e+00
955 1.248673e+00 8.548143e-04 2.553323e+00
956 1.249528e+00 8.581853e-04 2.575300e+00
957 1.250386e+00 8.662478e-04 2.575187e+00
958 1.251252e+00 8.751170e-04 2.563003e+00
959 1.252128e+00 8.821922e-04 2.591620e+00
960 1.253010e+00 8.876373e-04 2.562107e+00
961 1.253897e+00 8.921206e-04 2.571720e+00
962 1.254790e+00 8.960545e-04 2.651096e+00
963 1.255686e+00 8.897332e-04 2.643210e+00
964 1.256575e+00 8.716167e-04 2.588019e+00
965 1.257447e+00 8.561587e-04 2.585700e+00
966 1.258303e+00 8.508319e-04 2.617655e+00
967 1.259154e+00 8.555054e-04 2.624871e+00
968 1.260009e+00 8.631670e-04 2.600134e+00
969 1.260873e+00 8.705355e-04 2.618593e+00
970 1.261743e+00 8.768432e-04 2.568513e+00
971 1.262620e+00 8.825000e-04 2.674814e+00
972 1.263502e+00 8.878617e-04 2.536632e+00
973 1.264390e+00 8.916907e-04 2.631427e+00
974 1.265282e+00 8.953938e-04 2.614067e+00
975 1.266177e+00 9.004747e-04 2.672036e+00
976 1.267078e+00 9.063454e-04 2.614903e+00
977 1.267984e+00 9.122716e-04 2.618962e+00
978 1.268897e+00 9.134922e-04 2.664445e+00
979 1.269810e+00 9.006627e-04 2.631337e+00
980 1.270711e+00 8.908492e-04 2.667165e+00
981 1.271602e+00 8.823457e-04 2.634138e+00
982 1.272484e+00 8.826961e-04 2.582092e+00
983 1.273367e+00 8.906906e-04 2.715393e+00
984 1.274257e+00 9.004970e-04 2.599709e+00
985 1.275158e+00 9.085439e-04 2.654137e+00
986 1.276066e+00 9.155991e-04 2.658761e+00
987 1.276982e+00 9.223335e-04 2.650779e+00
988 1.277904e+00 9.291570e-04 2.613953e+00
989 1.278833e+00 9.362186e-04 2.625742e+00
990 1.279770e+00 9.435143e-04 2.625650e+00
991 1.280713e+00 9.508310e-04 2.631971e+00
992 1.281664e+00 9.575635e-04 2.672159e+00
993 1.282622e+00 9.632007e-04 2.643811e+00
994 1.283585e+00 9.674431e-04 2.670554e+00
995 1.284552e+00 9.702170e-04 2.665254e+00
996 1.285522e+00 9.716765e-04 2.678270e+00
997 1.286494e+00 9.723217e-04 2.761593e+00
998 1.287466e+00 9.729443e-04 2.679816e+00
999 1.288439e+00 9.743301e-04 2.659984e+00
1000 1.289414e+00 9.771301e-04 2.740140e+00
1001 1.290391e+00 9.741832e-04 2.641229e+00
1002 1.291365e+00 9.670903e-04 2.686766e+00
1003 1.292332e+00 9.603467e-04 2.721454e+00
1004 1.293292e+00 9.543321e-04 2.680133e+00
1005 1.294247e+00 9.490714e-04 2.400049e+00
1006 1.295196e+00 9.444823e-04 2.343601e+00
1007 1.296140e+00 9.406899e-04 2.421290e+00
1008 1.297081e+00 9.377721e-04 2.327640e+00
1009 1.298019e+00 9.354687e-04 2.316539e+00
1010 1.298954e+00 9.334204e-04 2.325892e+00
1011 1.299888e+00 9.313241e-04 2.392243e+00
1012 1.300819e+00 9.289142e-04 2.342224e+00
1013 1.301748e+00 9.261786e-04 2.331204e+00
1014 1.302674e+00 9.235145e-04 2.352229e+00
1015 1.303598e+00 9.203463e-04 2.312372e+00
1016 1.304518e+00 9.161064e-04 2.340022e+00
1017 1.305434e+00 9.115032e-04 2.388740e+00
1018 1.306346e+00 9.075378e-04 2.396907e+00
1019 1.307253e+00 9.043964e-04 2.384961e+00
1020 1.308157e+00 9.024604e-04 2.433697e+00
1021 1.309060e+00 9.022986e-04 2.370376e+00
1022 1.309962e+00 9.029115e-04 2.344649e+00
1023 1.310865e+00 9.033996e-04 2.364289e+00
1024 1.311769e+00 9.035086e-04 2.380512e+00
1025 1.312672e+00 9.038240e-04 2.400235e+00
1026 1.313576e+00 9.052176e-04 2.468846e+00
1027 1.314481e+00 9.081296e-04 2.363895e+00
1028 1.315389e+00 9.126775e-04 2.356614e+00
1029 1.316302e+00 9.188374e-04 2.390952e+00
1030 1.317221e+00 9.266166e-04 2.336316e+00
1031 1.318147e+00 9.359795e-04 2.471046e+00
1032 1.319083e+00 9.468860e-04 2.358076e+00
1033 1.320030e+00 9.543317e-04 2.382264e+00
1034 1.320985e+00 9.542346e-04 2.369111e+00
1035 1.321939e+00 9.532926e-04 2.359770e+00
1036 1.322892e+00 9.517148e-04 2.361338e+00
1037 1.323844e+00 9.481940e-04 2.383231e+00
1038 1.324792e+00 9.401827e-04 2.392333e+00
--- begin checkpoint ---
Saved 37449 sub-grids with 7257091954 bytes written
--- end checkpoint ---
--- begin output ---
--- end output ---
1039 1.325732e+00 9.227382e-04 4.040012e+01
1040 1.326655e+00 9.052265e-04 2.343320e+00
1041 1.327560e+00 8.948176e-04 2.334836e+00
{stack-trace}: 4 frames:
0x2b94088e5f8f : hpx::detail::backtrace(unsigned long) + 0x7f in /home/dmarce1/lib/libhpx.so.0
0x2b94088e750d : boost::exception_ptr hpx::detail::get_exception<hpx::exception>(hpx::exception const&, std::string const&, std::string const&, long, std::string const&) + 0x23d in /home/dmarce1/lib/libhpx.so.0
0x2b94088e51a2 : hpx::detail::assertion_failed_msg(char const*, char const*, char const*, char const*, long) + 0x432 in /home/dmarce1/lib/libhpx.so.0
0x2b94088e5be2 : hpx::detail::assertion_failed(char const*, char const*, char const*, long) + 0x12 in /home/dmarce1/lib/libhpx.so.0
{env}: 128 entries:
BASH_FUNC_module()=() { eval `/usr/local/packages/Modules/$MODULE_VERSION/bin/modulecmd bash $*`
}
CPATH=/home/dmarce1/include:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/include:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/include:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/include:/usr/local/compilers/gcc/4.9.0/include
CUDA_NIC_INTEROP=1
CVS_RSH=ssh
ENVIRONMENT=BATCH
GDBSERVER_MIC=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/target/mic/bin/gdbserver
GDB_CROSS=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-mic
GDB_HOST=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-ia-mic
GFORTRAN_UNBUFFERED_PRECONNECTED=y
G_BROKEN_FILENAMES=1
HISTCONTROL=ignoredups
HISTSIZE=1000
HOME=/home/dmarce1
HOSTNAME=smic165
HPX_NODEFILE=actual.nodes
HYDI_CONTROL_FD=9
INFOPATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64/share/info/:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/info/
INTEL_LICENSE_FILE=/usr/local/compilers/Intel:/usr/local/compilers/Intel/intel_fc_10.1/licenses:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/licenses:/opt/intel/licenses:/home/dmarce1/intel/licenses
INTEL_PYTHONHOME=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/python/intel64/
IPPROOT=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp
I_MPI_CMD=mpirun -np 64 --machinefile actual.nodes ./octotiger -t20 -Ihpx.stacks.use_guard_pages=0
I_MPI_DAPL_PROVIDER=ofa-v2-mlx4_0-1u
I_MPI_EXT_MPI_CALLS_58440=0x2b940a4c2110
I_MPI_FABRICS=shm:ofa
I_MPI_HYDRA_RMK=pbs
I_MPI_INFO_BRAND=Intel(R) Xeon(R)
I_MPI_INFO_CACHE1=0,1,2,3,4,8,9,10,11,12,16,17,18,19,20,24,25,26,27,28
I_MPI_INFO_CACHE2=0,1,2,3,4,8,9,10,11,12,16,17,18,19,20,24,25,26,27,28
I_MPI_INFO_CACHE3=0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,1,1,1,1
I_MPI_INFO_CACHES=3
I_MPI_INFO_CACHE_SHARE=2,2,32
I_MPI_INFO_CACHE_SIZE=32768,262144,26214400
I_MPI_INFO_CORE=0,1,2,3,4,8,9,10,11,12,0,1,2,3,4,8,9,10,11,12
I_MPI_INFO_C_NAME=Unknown
I_MPI_INFO_DESC=1342177285
I_MPI_INFO_FLGB=641
I_MPI_INFO_FLGC=2143216639
I_MPI_INFO_FLGD=-1075053569
I_MPI_INFO_LCPU=20
I_MPI_INFO_MODE=263
I_MPI_INFO_NC=20
I_MPI_INFO_NP=2
I_MPI_INFO_NUMA_NODE_DIST=10,21,21,10
I_MPI_INFO_NUMA_NODE_MAP=mlx4_0:1,scif0:-1,mic0:0,mic1:1
I_MPI_INFO_NUMA_NODE_NUM=2
I_MPI_INFO_PACK=0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,1,1,1,1
I_MPI_INFO_SERIAL=E5-2680 v2
I_MPI_INFO_SIGN=198372
I_MPI_INFO_STATE=0
I_MPI_INFO_THREAD=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
I_MPI_INFO_VEND=1
I_MPI_MPIRUN=mpirun
I_MPI_NUMBER_OF_MPI_PROCESSES_PER_NODE=1
I_MPI_OFA_ADAPTER_NAME=mlx4_0
I_MPI_PERHOST=allcores
I_MPI_PIN_INFO=x0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19
I_MPI_PIN_MAPPING=1:0 0
I_MPI_PM=hydra
I_MPI_RANK_CMD=./octotiger -t20 -Ihpx.stacks.use_guard_pages=0
I_MPI_ROOT=/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048
I_MPI_THREAD_LEVEL=0
LANG=en_US.UTF-8
LD_LIBRARY_PATH=/home/dmarce1/lib:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mpirt/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/tools/intel64/perfsys:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/libipt/intel64/lib:/usr/local/compilers/gcc/4.9.0/lib/gcc/x86_64-unknown-linux-gnu/4.9.0:/usr/local/compilers/gcc/4.9.0/lib64:/usr/local/compilers/gcc/4.9.0/lib:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/lib:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/mic/lib
LESSOPEN=|/usr/bin/lesspipe.sh %s
LHPC_DEVELGCC=/usr/local/compilers/gcc/4.9.0/easybuild/gcc-4.9.0-easybuild-devel
LHPC_ROOTGCC=/usr/local/compilers/gcc/4.9.0
LHPC_VERSIONGCC=4.9.0
LIBRARY_PATH=/home/dmarce1/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4:/usr/local/compilers/gcc/4.9.0/lib64:/usr/local/compilers/gcc/4.9.0/lib
LM_LICENSE_FILE=/usr/local/compilers/pgi/license.dat
LOADEDMODULES=gcc/4.9.0
LOGNAME=dmarce1
MAIL=/var/spool/mail/dmarce1
MANPATH=/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/man:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/man/en_US:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/man/en_US:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64/share/man/:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/man/:/usr/local/compilers/gcc/4.9.0/share/man:/usr/local/compilers/pgi/linux86-64/man:
MIC_LD_LIBRARY_PATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mpirt/lib/mic:/opt/intel/mic/coi/device-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/lib/mic:/opt/intel/mic/coi/device-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/mic
MIC_LIBRARY_PATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mpirt/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/mic
MKLROOT=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl
MOABHOMEDIR=/usr/moab
MODULEPATH=/usr/local/packages/Modules/modulefiles/apps:/usr/local/packages/Modules/modulefiles/admin:/usr/local/packages/Modules/modulefiles/xsede
MODULESHOME=/usr/local/packages/Modules/3.2.10
MODULE_VERSION=3.2.10
MODULE_VERSION_STACK=3.2.10
MPIR_CVAR_CH3_INTERFACE_HOSTNAME=smic165
MPIR_CVAR_NEMESIS_ENABLE_CKPOINT=1
MPM_LAUNCHER=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/mpm/bin/start_mpm.sh
NLSPATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/intel64/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/intel64/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N
PATH=/home/dmarce1/bin:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/bin/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/lib64/qt-3.3/bin:/usr/local/compilers/gcc/4.9.0/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/usr/local/bin:/usr/local/compilers/pgi/linux86-64/6.1/bin:/opt/ibutils/bin:/home/dmarce1/bin
PBS_ENVIRONMENT=PBS_BATCH
PBS_GPUFILE=/var/spool/torque/aux//54362.smic3gpu
PBS_JOBCOOKIE=D71D88EFE5B6C4509B5ADAD2C6911F7C
PBS_JOBID=54362.smic3
PBS_JOBNAME=job
PBS_MOMPORT=15003
PBS_NODENUM=0
PBS_NP=1280
PBS_NUM_NODES=64
PBS_NUM_PPN=20
PBS_O_HOME=/home/dmarce1
PBS_O_HOST=smic1.hpc.lsu.edu
PBS_O_LANG=en_US.UTF-8
PBS_O_LOGNAME=dmarce1
PBS_O_MAIL=/var/spool/mail/dmarce1
PBS_O_PATH=/home/dmarce1/bin:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/bin/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/lib64/qt-3.3/bin:/usr/local/compilers/gcc/4.9.0/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/usr/local/bin:/usr/local/compilers/pgi/linux86-64/6.1/bin:/opt/ibutils/bin:/opt/dell/srvadmin/bin:/home/dmarce1/bin
PBS_O_QUEUE=checkpt
PBS_O_SHELL=/bin/bash
PBS_O_WORKDIR=/work/dmarce1/octotiger/release
PBS_QUEUE=checkpt
PBS_SERVER=smic3
PBS_TASKNUM=1
PBS_VERSION=TORQUE-3.0.6
PBS_VNODENUM=0
PBS_WALLTIME=21600
PGI=/usr/local/compilers/pgi
PKG_CONFIG_PATH=:/home/dmarce1/lib/pkgconfig
PMI_FD=14
PMI_RANK=0
PMI_SIZE=64
PWD=/work/dmarce1/octotiger/release
QTDIR=/usr/lib64/qt-3.3
QTINC=/usr/lib64/qt-3.3/include
QTLIB=/usr/lib64/qt-3.3/lib
SHELL=/bin/bash
SHLVL=3
SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
TBBROOT=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb
USER=dmarce1
_=/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin/mpiexec.hydra
_LMFILES_=/usr/local/packages/Modules/modulefiles/apps/gcc/4.9.0
_MODULESBEGINENV_=/home/dmarce1/.modulesbeginenv
{locality-id}: 0
{hostname}: [ (mpi:0) (tcp:127.0.0.1:7910) ]
{process-id}: 58440
{function}: hpx::parcelset::parcel::parcel(hpx::parcelset::parcel &&)
{file}: /home/dmarce1/include/hpx/runtime/parcelset/parcel.hpp
{line}: 220
{os-thread}: 0, worker-thread#0
{thread-id}: 00002ba7e736cb20
{thread-description}: <unknown>
{state}: state_running
{auxinfo}:
{config}:
HPX_HAVE_NATIVE_TLS=ON
HPX_HAVE_STACKTRACES=ON
HPX_HAVE_COMPRESSION_BZIP2=OFF
HPX_HAVE_COMPRESSION_SNAPPY=OFF
HPX_HAVE_COMPRESSION_ZLIB=OFF
HPX_HAVE_PARCEL_COALESCING=ON
HPX_HAVE_PARCELPORT_TCP=ON
HPX_HAVE_PARCELPORT_MPI=ON (MPICH V3.1.2, MPI V3.0)
HPX_HAVE_PARCELPORT_IPC=OFF
HPX_HAVE_PARCELPORT_IBVERBS=OFF
HPX_HAVE_VERIFY_LOCKS=OFF
HPX_HAVE_HWLOC=ON
HPX_HAVE_ITTNOTIFY=OFF
HPX_HAVE_RUN_MAIN_EVERYWHERE=OFF
HPX_LIMIT=5
HPX_PARCEL_MAX_CONNECTIONS=512
HPX_PARCEL_MAX_CONNECTIONS_PER_LOCALITY=4
HPX_INITIAL_AGAS_LOCAL_CACHE_SIZE=256
HPX_AGAS_LOCAL_CACHE_SIZE_PER_THREAD=32
HPX_HAVE_MALLOC=custom
HPX_PREFIX (configured)=/work/dmarce1/builds/hpx_build
HPX_PREFIX=/home/dmarce1
{version}: V0.9.11-trunk (AGAS: V3.0), Git:
{boost}: V1.59.0
{build-type}: release
{date}: Oct 8 2015 11:50:28
{platform}: linux
{compiler}: Intel C++ C++0x mode version 1500
{stdlib}: GNU libstdc++ version 20140422
{what}: assertion 'action_.get()' failed: HPX(assertion_failure)
===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= PID 58440 RUNNING AT smic165
= EXIT CODE: 6
= CLEANING UP REMAINING PROCESSES
= YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
APPLICATION TERMINATED WITH THE EXIT STRING: Aborted (signal 6)
------------------------------------------------------
Running PBS epilogue script - 08-Oct-2015 14:36:47
------------------------------------------------------
Checking node smic165 (MS)
Checking node smic313 ok
Checking node smic312 ok
Checking node smic311 ok
Checking node smic310 ok
Checking node smic309 ok
Checking node smic308 ok
Checking node smic307 ok
Checking node smic306 ok
Checking node smic305 ok
Checking node smic304 ok
Checking node smic303 ok
Checking node smic300 ok
Checking node smic299 ok
Checking node smic298 ok
Checking node smic297 ok
Checking node smic296 ok
Checking node smic295 ok
Checking node smic294 ok
Checking node smic293 ok
Checking node smic292 ok
Checking node smic291 ok
Checking node smic290 ok
Checking node smic289 ok
Checking node smic288 ok
Checking node smic287 ok
Checking node smic286 ok
Checking node smic285 ok
Checking node smic284 ok
Checking node smic283 ok
Checking node smic282 ok
Checking node smic281 ok
Checking node smic280 ok
Checking node smic279 ok
Checking node smic278 ok
Checking node smic277 ok
Checking node smic276 ok
Checking node smic275 ok
Checking node smic274 ok
Checking node smic273 ok
Checking node smic272 ok
Checking node smic271 ok
Checking node smic270 ok
Checking node smic269 ok
Checking node smic268 ok
Checking node smic267 ok
Checking node smic266 ok
Checking node smic265 ok
Checking node smic264 ok
Checking node smic263 ok
Checking node smic262 ok
Checking node smic261 ok
Checking node smic260 ok
Checking node smic259 ok
Checking node smic252 ok
Checking node smic248 ok
Checking node smic247 ok
Checking node smic246 ok
Checking node smic245 ok
Checking node smic244 ok
Checking node smic242 ok
Checking node smic241 ok
Checking node smic240 ok
Checking node smic200 ok
Checking node smic165 ok
------------------------------------------------------
Concluding PBS epilogue script - 08-Oct-2015 14:39:15
------------------------------------------------------
Exit Status: 6
Job ID: 54362.smic3
Username: dmarce1
Group: hpcusers
Job Name: job
Session Id: 57166
Resource Limits: ncpus=1,neednodes=64:ppn=20,nodes=64:ppn=20,walltime=06:00:00
Resources Used: cput=13:21:02,mem=9493836kb,vmem=128006380kb,walltime=00:41:34
Queue Used: checkpt
Account String: hpc_supermic01
Node: smic165
Process id: 59616
------------------------------------------------------
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment