Skip to content

Instantly share code, notes, and snippets.

@dmarce1

dmarce1/assertion failure

Created December 9, 2015 16:43
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dmarce1/cd3d837b592fbbd54363 to your computer and use it in GitHub Desktop.
Save dmarce1/cd3d837b592fbbd54363 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
assertion failure
[dmarce1@smic004 octotiger]$ ./smic.sh
+ cd /work/dmarce1/octotiger
+ make -j20
Scanning dependencies of target octotiger_exe
[ 5%] [ 11%] [ 17%] [ 23%] [ 29%] [ 35%] Building CXX object CMakeFiles/octotiger_exe.dir/src/node_client.cpp.o
[ 41%] Building CXX object CMakeFiles/octotiger_exe.dir/src/node_server.cpp.o
Building CXX object CMakeFiles/octotiger_exe.dir/src/main.cpp.o
[ 47%] Building CXX object CMakeFiles/octotiger_exe.dir/src/grid.cpp.o
[ 52%] Building CXX object CMakeFiles/octotiger_exe.dir/src/grid_fmm.cpp.o
[ 58%] [ 64%] Building CXX object CMakeFiles/octotiger_exe.dir/src/node_server_decomp.cpp.o
[ 70%] [ 76%] Building CXX object CMakeFiles/octotiger_exe.dir/src/node_server_output.cpp.o
[ 82%] [ 88%] Building CXX object CMakeFiles/octotiger_exe.dir/src/node_octstruct.cpp.o
[100%] Building CXX object CMakeFiles/octotiger_exe.dir/src/grid_scf.cpp.o
[100%] Building CXX object CMakeFiles/octotiger_exe.dir/src/grid_output.cpp.o
Building CXX object CMakeFiles/octotiger_exe.dir/src/lane_emden.cpp.o
Building CXX object CMakeFiles/octotiger_exe.dir/src/geometry.cpp.o
Building CXX object CMakeFiles/octotiger_exe.dir/src/node_location.cpp.o
Building CXX object CMakeFiles/octotiger_exe.dir/src/problem.cpp.o
Building CXX object CMakeFiles/octotiger_exe.dir/src/roe.cpp.o
Building CXX object CMakeFiles/octotiger_exe.dir/src/taylor.cpp.o
Building CXX object CMakeFiles/octotiger_exe.dir/src/old_scf_read.cpp.o
Linking CXX executable octotiger
[100%] Built target octotiger_exe
+ cat /var/spool/torque/aux//72828.smic3
+ awk 'NR % 20 == 0'
+ export HPX_NODEFILE=node.list
+ HPX_NODEFILE=node.list
+ unset PBS_NODEFILE
+ export I_MPI_FABRICS=shm:ofa
+ I_MPI_FABRICS=shm:ofa
+ export I_MPI_DAPL_PROVIDER=ofa-v2-mlx4_0-1u
+ I_MPI_DAPL_PROVIDER=ofa-v2-mlx4_0-1u
+ export I_MPI_OFA_ADAPTER_NAME=mlx4_0
+ I_MPI_OFA_ADAPTER_NAME=mlx4_0
++ wc -l node.list
++ gawk '//{print $1}'
+ export NPROCS=64
+ NPROCS=64
+ rm data.bin
rm: cannot remove `data.bin': No such file or directory
+ mpirun -np 64 --machinefile node.list ./octotiger -t20
Running
-----------------------------------------------
checking for refinement
regridding
rebalancing 9 nodes
forming tree connections
solving gravity
regrid done
-----------------------------------------------
---------------Created Level 1---------------
-----------------------------------------------
checking for refinement
regridding
rebalancing 73 nodes
forming tree connections
solving gravity
regrid done
-----------------------------------------------
---------------Created Level 2---------------
-----------------------------------------------
checking for refinement
regridding
rebalancing 169 nodes
forming tree connections
solving gravity
regrid done
-----------------------------------------------
---------------Created Level 3---------------
-----------------------------------------------
checking for refinement
regridding
rebalancing 265 nodes
forming tree connections
solving gravity
regrid done
-----------------------------------------------
---------------Created Level 4---------------
-----------------------------------------------
checking for refinement
regridding
rebalancing 553 nodes
forming tree connections
solving gravity
regrid done
-----------------------------------------------
---------------Created Level 5---------------
-----------------------------------------------
checking for refinement
regridding
rebalancing 2601 nodes
forming tree connections
solving gravity
regrid done
-----------------------------------------------
---------------Created Level 6---------------
-----------------------------------------------
checking for refinement
regridding
rebalancing 6921 nodes
forming tree connections
solving gravity
regrid done
-----------------------------------------------
---------------Created Level 7---------------
Forming tree connections------------
...done
-----------------------------------------------
checking for refinement
regridding
rebalancing 6921 nodes
forming tree connections
solving gravity
regrid done
-----------------------------------------------
s rho_max_acc rho_max_don omega X_com C_acc C_don virial xdrif ydrift zdrift q w0 res
0 7.134015e+00 3.091109e-01 1.314014e-01 1.051209e-07 -2.396209e-02 -5.264273e-03 -3.153307e-02 -2.025314e-19 2.160335e-18 0.000000e+00 2.397582e-01 1.000000e-03 6.693714e-01
1 7.136183e+00 3.043047e-01 1.227450e-01 1.046869e-02 -1.429904e-02 -5.643930e-03 -2.492787e-01 -2.190722e-20 -2.804124e-18 0.000000e+00 2.235336e-01 4.693539e-03 3.764849e-01
2 7.137456e+00 3.039554e-01 1.280564e-01 6.195722e-03 -1.728286e-02 -5.683395e-03 6.853338e-02 -1.532609e-19 1.050932e-18 0.000000e+00 2.205432e-01 8.442052e-03 5.650354e-02
3 7.138758e+00 3.024290e-01 1.289554e-01 5.367680e-03 -1.710821e-02 -5.716321e-03 -1.638757e-02 6.557343e-20 -2.448075e-18 0.000000e+00 2.158512e-01 1.224719e-02 8.077885e-02
4 7.139904e+00 3.011777e-01 1.301880e-01 4.086117e-03 -1.754586e-02 -5.720821e-03 -7.942719e-03 -6.568855e-20 1.051017e-18 0.000000e+00 2.124867e-01 9.435396e-03 4.967112e-02
5 7.140952e+00 2.999131e-01 1.309143e-01 3.155880e-03 -1.775016e-02 -5.713393e-03 -1.916656e-02 -4.394913e-20 0.000000e+00 0.000000e+00 2.096455e-01 1.325569e-02 4.550650e-02
6 7.141902e+00 2.987096e-01 1.313938e-01 2.364959e-03 -1.791531e-02 -5.694113e-03 -2.407451e-02 4.417705e-20 -2.120499e-18 0.000000e+00 2.073515e-01 1.713481e-02 5.236770e-02
7 7.142764e+00 2.975611e-01 1.316427e-01 1.721158e-03 -1.801530e-02 -5.666214e-03 -2.855573e-02 -6.668940e-20 -1.422707e-18 0.000000e+00 2.054907e-01 1.310110e-02 6.434492e-02
8 7.143547e+00 2.964754e-01 1.317135e-01 1.194711e-03 -1.806774e-02 -5.631656e-03 -3.169351e-02 8.957020e-20 -1.791404e-18 0.000000e+00 2.039992e-01 1.007583e-02 7.352978e-02
9 7.144256e+00 2.954549e-01 1.316414e-01 7.688323e-04 -1.807961e-02 -5.592218e-03 -3.392472e-02 6.771512e-20 -5.417210e-18 0.000000e+00 2.028190e-01 7.806871e-03 8.027863e-02
10 7.144900e+00 2.945012e-01 1.314574e-01 4.281590e-04 -1.805854e-02 -5.549346e-03 -3.535868e-02 -2.276303e-20 5.098919e-18 0.000000e+00 2.019034e-01 6.105153e-03 8.500258e-02
11 7.145483e+00 2.936146e-01 1.311868e-01 1.601268e-04 -1.801081e-02 -5.504241e-03 -3.613577e-02 -2.296290e-20 1.469626e-18 0.000000e+00 2.012129e-01 4.828865e-03 8.802385e-02
12 7.146011e+00 2.927944e-01 1.308509e-01 -4.596623e-05 -1.794184e-02 -5.457893e-03 -3.636334e-02 0.000000e+00 -2.594839e-18 0.000000e+00 2.007140e-01 3.871649e-03 8.961736e-02
13 7.146490e+00 2.920391e-01 1.304676e-01 -1.992714e-04 -1.785630e-02 -5.411113e-03 -3.613474e-02 -4.675256e-20 -3.740205e-19 0.000000e+00 2.003778e-01 3.153736e-03 9.001525e-02
14 7.146923e+00 2.913509e-01 1.300519e-01 -3.076973e-04 -1.775817e-02 -5.364562e-03 -3.553010e-02 -4.716961e-20 8.301851e-18 0.000000e+00 2.001794e-01 2.615302e-03 8.941709e-02
15 7.147316e+00 2.907197e-01 1.296163e-01 -3.781231e-04 -1.763386e-02 -5.318773e-03 -3.461930e-02 0.000000e+00 3.044941e-18 0.000000e+00 2.000384e-01 6.332783e-03 8.662953e-02
16 7.147669e+00 2.901522e-01 1.291901e-01 -4.326758e-04 -1.752809e-02 -5.274669e-03 -3.283108e-02 9.596106e-20 -3.838442e-19 0.000000e+00 2.000119e-01 1.010596e-02 8.501360e-02
17 7.147990e+00 2.896365e-01 1.287564e-01 -4.556699e-04 -1.741375e-02 -5.232034e-03 -3.169879e-02 -4.837539e-20 -3.870031e-19 0.000000e+00 2.000657e-01 1.393651e-02 8.256591e-02
18 7.148279e+00 2.891712e-01 1.283275e-01 -4.566116e-04 -1.729783e-02 -5.191021e-03 -3.027470e-02 -4.875956e-20 -1.560306e-18 0.000000e+00 2.001881e-01 1.782620e-02 7.972253e-02
19 7.148541e+00 2.887531e-01 1.279083e-01 -4.387133e-04 -1.718115e-02 -5.151854e-03 -2.876539e-02 4.913095e-20 3.144381e-18 0.000000e+00 2.003654e-01 2.177689e-02 7.652600e-02
20 7.148777e+00 2.883774e-01 1.274978e-01 -4.057904e-04 -1.706346e-02 -5.114451e-03 -2.717630e-02 -4.948698e-20 1.781531e-18 0.000000e+00 2.005838e-01 2.579051e-02 7.289198e-02
21 7.148990e+00 2.880417e-01 1.271011e-01 -3.616820e-04 -1.694886e-02 -5.079174e-03 -2.547713e-02 -4.982675e-20 -5.979210e-19 0.000000e+00 2.008344e-01 2.986908e-02 6.916592e-02
22 7.149182e+00 2.877444e-01 1.267273e-01 -3.088697e-04 -1.683805e-02 -5.046067e-03 -2.379810e-02 5.014953e-20 2.206579e-18 0.000000e+00 2.011114e-01 3.401474e-02 6.538705e-02
23 7.149356e+00 2.874821e-01 1.263775e-01 -2.489551e-04 -1.673087e-02 -5.015158e-03 -2.215367e-02 2.522730e-20 -2.421821e-18 0.000000e+00 2.014064e-01 3.822972e-02 6.154951e-02
24 7.149512e+00 2.872520e-01 1.260534e-01 -1.842338e-04 -1.662808e-02 -4.986435e-03 -2.053230e-02 5.074157e-20 8.118651e-19 0.000000e+00 2.017130e-01 4.251636e-02 5.771489e-02
25 7.149653e+00 2.870511e-01 1.257559e-01 -1.164893e-04 -1.653009e-02 -4.959866e-03 -1.895644e-02 0.000000e+00 6.121228e-19 0.000000e+00 2.020255e-01 4.687714e-02 5.392201e-02
26 7.149780e+00 2.868769e-01 1.254854e-01 -4.727392e-05 -1.643718e-02 -4.935398e-03 -1.743823e-02 7.689093e-20 1.640340e-18 0.000000e+00 2.023389e-01 5.131465e-02 5.020532e-02
27 7.149894e+00 2.867267e-01 1.252419e-01 2.211654e-05 -1.634956e-02 -4.912966e-03 -1.598833e-02 2.574647e-20 8.238872e-19 0.000000e+00 2.026494e-01 5.583163e-02 4.659228e-02
28 7.149997e+00 2.865982e-01 1.250249e-01 9.060839e-05 -1.626732e-02 -4.892490e-03 -1.461458e-02 0.000000e+00 -2.688794e-18 0.000000e+00 2.029536e-01 6.043096e-02 4.310486e-02
29 7.150089e+00 2.864891e-01 1.248340e-01 1.573295e-04 -1.619047e-02 -4.873884e-03 -1.332258e-02 -2.335723e-19 5.813356e-18 0.000000e+00 2.032489e-01 6.511570e-02 3.975996e-02
30 7.150172e+00 2.863973e-01 1.246682e-01 2.215873e-04 -1.611898e-02 -4.857057e-03 -1.211591e-02 -1.041715e-19 -1.875086e-18 0.000000e+00 2.035334e-01 6.988904e-02 3.657021e-02
31 7.150246e+00 2.863209e-01 1.245266e-01 2.828483e-04 -1.605273e-02 -4.841912e-03 -1.099642e-02 7.837582e-20 -2.090022e-19 0.000000e+00 2.038054e-01 7.475441e-02 3.354439e-02
32 7.150313e+00 2.862581e-01 1.244080e-01 3.407184e-04 -1.599160e-02 -4.828350e-03 -9.964464e-03 2.620007e-20 -3.563210e-18 0.000000e+00 2.040638e-01 7.971538e-02 3.068798e-02
33 7.150373e+00 2.862072e-01 1.243112e-01 3.949247e-04 -1.593541e-02 -4.816275e-03 -9.019132e-03 1.050706e-19 1.050706e-18 0.000000e+00 2.043080e-01 8.477579e-02 2.800352e-02
34 7.150427e+00 2.861668e-01 1.242349e-01 4.452978e-04 -1.588396e-02 -4.805587e-03 -8.158457e-03 -2.632843e-20 -3.791294e-18 0.000000e+00 2.045376e-01 8.993967e-02 2.549123e-02
35 7.150475e+00 2.861354e-01 1.241778e-01 4.917558e-04 -1.583702e-02 -4.796191e-03 -7.379620e-03 0.000000e+00 -1.899563e-18 0.000000e+00 2.047524e-01 9.521132e-02 2.314917e-02
36 7.150518e+00 2.861119e-01 1.241387e-01 5.342900e-04 -1.579437e-02 -4.787992e-03 -6.679123e-03 -2.643123e-20 1.057249e-18 0.000000e+00 2.049526e-01 1.005953e-01 2.097387e-02
37 7.150557e+00 2.860952e-01 1.241161e-01 5.729516e-04 -1.575576e-02 -4.780898e-03 -6.052954e-03 0.000000e+00 1.694342e-18 0.000000e+00 2.051385e-01 1.060965e-01 1.896040e-02
38 7.150591e+00 2.861123e-01 1.241088e-01 6.078404e-04 -1.572094e-02 -4.774823e-03 -5.496738e-03 5.302362e-20 6.362834e-19 0.000000e+00 2.053105e-01 1.117201e-01 1.710280e-02
39 7.150622e+00 2.861034e-01 1.241154e-01 6.390938e-04 -1.567211e-02 -4.769683e-03 -5.005852e-03 2.654052e-20 -8.492968e-19 0.000000e+00 2.053972e-01 1.174716e-01 1.361690e-02
40 7.150649e+00 2.861056e-01 1.241560e-01 6.474641e-04 -1.565280e-02 -4.765942e-03 -3.889904e-03 -5.313302e-20 -8.501283e-19 0.000000e+00 2.054948e-01 1.233570e-01 1.270114e-02
41 7.150673e+00 2.861082e-01 1.242002e-01 6.589444e-04 -1.563130e-02 -4.762908e-03 -3.783728e-03 7.976748e-20 2.765273e-18 0.000000e+00 2.055809e-01 1.293826e-01 1.147848e-02
42 7.150694e+00 2.861128e-01 1.242528e-01 6.675441e-04 -1.561291e-02 -4.760414e-03 -3.547785e-03 -5.321784e-20 2.767328e-18 0.000000e+00 2.056607e-01 1.355552e-01 1.043543e-02
43 7.150714e+00 2.861186e-01 1.243118e-01 6.746315e-04 -1.559637e-02 -4.758432e-03 -3.375579e-03 1.331300e-19 -4.686178e-18 0.000000e+00 2.057338e-01 1.418820e-01 9.466872e-03
44 7.150731e+00 2.861255e-01 1.243767e-01 6.800974e-04 -1.558173e-02 -4.756910e-03 -3.224876e-03 -2.664067e-20 -1.491878e-18 0.000000e+00 2.058007e-01 1.483711e-01 8.598257e-03
45 7.150746e+00 2.861330e-01 1.244468e-01 6.841290e-04 -1.556879e-02 -4.755803e-03 -3.100505e-03 -1.332657e-19 -4.264501e-19 0.000000e+00 2.058621e-01 1.550307e-01 7.863992e-03
46 7.150760e+00 2.861411e-01 1.245215e-01 6.868520e-04 -1.555742e-02 -4.755072e-03 -2.998093e-03 5.332718e-20 -2.986322e-18 0.000000e+00 2.059183e-01 1.618702e-01 7.239151e-03
47 7.150773e+00 2.861494e-01 1.246000e-01 6.884003e-04 -1.554748e-02 -4.754678e-03 -2.915335e-03 -5.334449e-20 -2.560535e-18 0.000000e+00 2.059698e-01 1.688993e-01 6.701587e-03
48 7.150784e+00 2.861578e-01 1.246820e-01 6.889002e-04 -1.553883e-02 -4.754586e-03 -2.849741e-03 2.667926e-20 1.707473e-18 0.000000e+00 2.060172e-01 1.761289e-01 6.237738e-03
49 7.150794e+00 2.861661e-01 1.247668e-01 6.884723e-04 -1.553137e-02 -4.754764e-03 -2.799091e-03 2.668481e-20 1.067392e-18 0.000000e+00 2.060607e-01 1.835706e-01 5.838228e-03
-----------------------------------------------
checking for refinement
regridding
rebalancing 7113 nodes
forming tree connections
solving gravity
regrid done
-----------------------------------------------
s rho_max_acc rho_max_don omega X_com C_acc C_don virial xdrif ydrift zdrift q w0 res
50 7.150797e+00 2.861693e-01 1.248540e-01 6.872305e-04 -1.552496e-02 -4.755184e-03 -2.761340e-03 -8.007027e-20 -2.562249e-18 0.000000e+00 2.060560e-01 1.912372e-01 5.508450e-03
51 7.150805e+00 2.861876e-01 1.249806e-01 6.765731e-04 -1.552706e-02 -4.756305e-03 -2.722681e-03 -8.008560e-20 4.271232e-18 0.000000e+00 2.061172e-01 1.991425e-01 5.403115e-03
52 7.150813e+00 2.861923e-01 1.250640e-01 6.804977e-04 -1.551609e-02 -4.757063e-03 -2.986238e-03 0.000000e+00 2.135844e-18 0.000000e+00 2.061463e-01 2.073018e-01 4.956580e-03
53 7.150820e+00 2.861993e-01 1.251557e-01 6.760002e-04 -1.551316e-02 -4.757871e-03 -2.755496e-03 2.670020e-20 -4.272032e-19 0.000000e+00 2.061791e-01 2.157317e-01 4.729804e-03
54 7.150826e+00 2.862054e-01 1.252466e-01 6.727271e-04 -1.550946e-02 -4.758849e-03 -2.793550e-03 -1.068059e-19 -1.922506e-18 0.000000e+00 2.062086e-01 2.242988e-01 4.520811e-03
55 7.150832e+00 2.862111e-01 1.253382e-01 6.687856e-04 -1.550664e-02 -4.759944e-03 -2.784647e-03 -1.602120e-19 -6.408480e-19 0.000000e+00 2.062366e-01 2.307241e-01 4.341519e-03
56 7.150837e+00 2.862162e-01 1.254299e-01 6.646339e-04 -1.550431e-02 -4.761148e-03 -2.789580e-03 1.335092e-19 -1.281689e-18 0.000000e+00 2.062630e-01 2.355431e-01 4.188410e-03
57 7.150841e+00 2.862209e-01 1.255216e-01 6.602562e-04 -1.550247e-02 -4.762448e-03 -2.795337e-03 2.670108e-20 -3.417739e-18 0.000000e+00 2.062881e-01 2.391573e-01 4.058468e-03
58 7.150845e+00 2.862252e-01 1.256133e-01 6.557243e-04 -1.550107e-02 -4.763833e-03 -2.803677e-03 -1.334988e-19 -1.922383e-18 0.000000e+00 2.063121e-01 2.418680e-01 3.949767e-03
59 7.150849e+00 2.862290e-01 1.257047e-01 6.510837e-04 -1.550006e-02 -4.765292e-03 -2.813492e-03 5.339592e-20 2.990172e-18 0.000000e+00 2.063352e-01 2.439010e-01 3.860363e-03
60 7.150852e+00 2.862323e-01 1.257957e-01 6.463775e-04 -1.549940e-02 -4.766817e-03 -2.824362e-03 2.936528e-19 -3.417050e-18 0.000000e+00 2.063574e-01 2.454257e-01 3.788572e-03
61 7.150855e+00 2.862352e-01 1.258864e-01 6.416418e-04 -1.549906e-02 -4.768401e-03 -2.835826e-03 -1.334652e-19 4.911521e-18 0.000000e+00 2.063790e-01 2.465693e-01 3.733052e-03
62 7.150858e+00 2.862378e-01 1.259765e-01 6.369074e-04 -1.549901e-02 -4.770035e-03 -2.847521e-03 0.000000e+00 8.540809e-19 0.000000e+00 2.064000e-01 2.474270e-01 3.692188e-03
63 7.150860e+00 2.862399e-01 1.260661e-01 6.322004e-04 -1.549921e-02 -4.771713e-03 -2.859144e-03 1.067467e-19 1.921441e-18 0.000000e+00 2.064206e-01 2.480702e-01 3.664568e-03
64 7.150862e+00 2.862650e-01 1.261550e-01 6.275422e-04 -1.549963e-02 -4.773430e-03 -2.870452e-03 2.668305e-20 -2.134644e-19 0.000000e+00 2.064408e-01 2.485527e-01 3.648730e-03
65 7.150864e+00 2.862638e-01 1.262432e-01 6.229505e-04 -1.548643e-02 -4.775181e-03 -2.881251e-03 1.067028e-19 1.067028e-18 0.000000e+00 2.064028e-01 2.489145e-01 5.022504e-03
66 7.150865e+00 2.862681e-01 1.263473e-01 6.029040e-04 -1.549427e-02 -4.777400e-03 -2.354085e-03 1.066780e-19 -4.267121e-19 0.000000e+00 2.063844e-01 2.452049e-01 4.485692e-03
67 7.150866e+00 2.862697e-01 1.264442e-01 5.883227e-04 -1.549800e-02 -4.779580e-03 -2.583682e-03 1.333182e-19 -1.706474e-18 0.000000e+00 2.063668e-01 2.464037e-01 4.324872e-03
68 7.150867e+00 2.862705e-01 1.265385e-01 5.741137e-04 -1.550207e-02 -4.781642e-03 -2.664995e-03 -2.665823e-20 8.530634e-19 0.000000e+00 2.063534e-01 2.473028e-01 4.115608e-03
69 7.150868e+00 2.862704e-01 1.266297e-01 5.612073e-04 -1.550564e-02 -4.783617e-03 -2.757896e-03 0.000000e+00 2.345479e-18 0.000000e+00 2.063431e-01 2.479771e-01 3.940883e-03
70 7.150869e+00 2.862695e-01 1.267182e-01 5.493184e-04 -1.550891e-02 -4.785510e-03 -2.832230e-03 -7.994523e-20 0.000000e+00 0.000000e+00 2.063358e-01 2.484828e-01 3.782284e-03
71 7.150870e+00 2.862681e-01 1.268041e-01 5.384075e-04 -1.551189e-02 -4.787332e-03 -2.895663e-03 2.664392e-20 3.623572e-18 0.000000e+00 2.063314e-01 2.488621e-01 3.641785e-03
72 7.150870e+00 2.862661e-01 1.268877e-01 5.283884e-04 -1.551460e-02 -4.789093e-03 -2.948172e-03 5.327928e-20 1.491820e-18 0.000000e+00 2.063294e-01 2.491466e-01 3.517252e-03
73 7.150871e+00 2.862628e-01 1.269652e-01 5.191879e-04 -1.551696e-02 -4.790783e-03 -2.991177e-03 -1.065422e-19 0.000000e+00 0.000000e+00 2.063277e-01 2.493599e-01 3.423784e-03
74 7.150872e+00 2.862597e-01 1.270421e-01 5.102117e-04 -1.551924e-02 -4.792365e-03 -3.022582e-03 -5.326315e-20 1.704421e-18 0.000000e+00 2.063292e-01 2.495199e-01 3.331471e-03
75 7.150873e+00 2.862563e-01 1.271172e-01 5.022198e-04 -1.552117e-02 -4.793922e-03 -3.050451e-03 -5.325530e-20 2.130212e-19 0.000000e+00 2.063327e-01 2.496400e-01 3.270380e-03
76 7.150873e+00 2.862529e-01 1.271909e-01 4.948739e-04 -1.552301e-02 -4.795458e-03 -3.064841e-03 -5.324751e-20 2.342890e-18 0.000000e+00 2.063381e-01 2.497300e-01 3.216283e-03
77 7.150874e+00 2.862495e-01 1.272633e-01 4.881551e-04 -1.552474e-02 -4.796978e-03 -3.075123e-03 -5.323973e-20 1.703671e-18 0.000000e+00 2.063451e-01 2.497975e-01 3.172427e-03
78 7.150875e+00 2.862461e-01 1.273345e-01 4.819849e-04 -1.552639e-02 -4.798487e-03 -3.080378e-03 1.863118e-19 6.387833e-19 0.000000e+00 2.063534e-01 2.498481e-01 3.136521e-03
79 7.150875e+00 2.862427e-01 1.274046e-01 4.763042e-04 -1.552798e-02 -4.799987e-03 -3.081696e-03 -1.064482e-19 5.109513e-18 0.000000e+00 2.063630e-01 2.498861e-01 3.107563e-03
80 7.150876e+00 2.862393e-01 1.274737e-01 4.710570e-04 -1.552951e-02 -4.801481e-03 -3.079650e-03 5.321617e-20 -4.044429e-18 0.000000e+00 2.063736e-01 2.499146e-01 3.084401e-03
81 7.150876e+00 2.862361e-01 1.275418e-01 4.661929e-04 -1.553102e-02 -4.802972e-03 -3.074830e-03 -2.660408e-20 -2.128326e-18 0.000000e+00 2.063851e-01 2.499359e-01 3.066031e-03
82 7.150877e+00 2.862329e-01 1.276091e-01 4.616666e-04 -1.553251e-02 -4.804463e-03 -3.067737e-03 1.862001e-19 -4.256002e-19 0.000000e+00 2.063972e-01 2.499519e-01 3.051549e-03
83 7.150877e+00 2.862299e-01 1.276756e-01 4.574372e-04 -1.553399e-02 -4.805953e-03 -3.058814e-03 -7.978767e-20 -1.489370e-18 0.000000e+00 2.064100e-01 2.499640e-01 3.040165e-03
84 7.150878e+00 2.862269e-01 1.277413e-01 4.534686e-04 -1.553547e-02 -4.807445e-03 -3.048447e-03 5.318341e-20 1.063668e-18 0.000000e+00 2.064232e-01 2.499730e-01 3.031171e-03
85 7.150878e+00 2.862240e-01 1.278063e-01 4.497283e-04 -1.553696e-02 -4.808938e-03 -3.036967e-03 1.063498e-19 -2.126996e-19 0.000000e+00 2.064368e-01 2.499797e-01 3.023942e-03
86 7.150878e+00 2.862213e-01 1.278706e-01 4.461875e-04 -1.553846e-02 -4.810434e-03 -3.024660e-03 1.063325e-19 -4.253302e-19 0.000000e+00 2.064507e-01 2.499848e-01 3.017938e-03
87 7.150879e+00 2.862186e-01 1.279342e-01 4.428211e-04 -1.553999e-02 -4.811933e-03 -3.011771e-03 -5.315752e-20 -3.189451e-18 0.000000e+00 2.064648e-01 2.499886e-01 3.012689e-03
88 7.150879e+00 2.862161e-01 1.279972e-01 4.396068e-04 -1.554154e-02 -4.813435e-03 -2.998506e-03 1.594459e-19 -1.913351e-18 0.000000e+00 2.064790e-01 2.499914e-01 3.007796e-03
89 7.150879e+00 2.862136e-01 1.280596e-01 4.365251e-04 -1.554311e-02 -4.814939e-03 -2.985037e-03 0.000000e+00 6.376755e-18 0.000000e+00 2.064933e-01 2.499936e-01 3.002916e-03
90 7.150880e+00 2.862113e-01 1.281214e-01 4.335590e-04 -1.554472e-02 -4.816445e-03 -2.971507e-03 -1.593915e-19 -4.037919e-18 0.000000e+00 2.065077e-01 2.499952e-01 2.997766e-03
91 7.150880e+00 2.862090e-01 1.281826e-01 4.306940e-04 -1.554635e-02 -4.817954e-03 -2.958035e-03 -2.390458e-19 2.124851e-19 0.000000e+00 2.065220e-01 2.499964e-01 2.992105e-03
92 7.150880e+00 2.862068e-01 1.282432e-01 4.279174e-04 -1.554801e-02 -4.819463e-03 -2.944714e-03 -5.311196e-20 -3.611613e-18 0.000000e+00 2.065363e-01 2.499973e-01 2.985741e-03
93 7.150880e+00 2.862047e-01 1.283033e-01 4.252184e-04 -1.554970e-02 -4.820973e-03 -2.931619e-03 7.965383e-20 -5.735076e-18 0.000000e+00 2.065505e-01 2.499980e-01 2.978523e-03
94 7.150880e+00 2.862115e-01 1.283627e-01 4.225876e-04 -1.555143e-02 -4.822482e-03 -2.918807e-03 -2.389188e-19 2.336095e-18 0.000000e+00 2.065646e-01 2.499985e-01 2.970333e-03
95 7.150881e+00 2.862084e-01 1.284216e-01 4.200174e-04 -1.554425e-02 -4.823991e-03 -2.906323e-03 5.307909e-20 -1.698531e-18 0.000000e+00 2.065414e-01 2.499989e-01 3.898674e-03
96 7.150880e+00 2.862091e-01 1.284906e-01 4.075353e-04 -1.555059e-02 -4.825787e-03 -2.548984e-03 0.000000e+00 -1.698139e-18 0.000000e+00 2.065308e-01 2.463053e-01 3.518788e-03
97 7.150880e+00 2.862082e-01 1.285549e-01 3.985573e-04 -1.555415e-02 -4.827536e-03 -2.679659e-03 -5.305526e-20 6.366631e-19 0.000000e+00 2.065206e-01 2.472290e-01 3.388233e-03
98 7.150880e+00 2.862070e-01 1.286175e-01 3.897714e-04 -1.555788e-02 -4.829192e-03 -2.714513e-03 -2.652222e-20 4.880089e-18 0.000000e+00 2.065130e-01 2.479217e-01 3.226522e-03
99 7.150880e+00 2.862054e-01 1.286780e-01 3.817925e-04 -1.556122e-02 -4.830775e-03 -2.758681e-03 -1.060685e-19 2.969919e-18 0.000000e+00 2.065074e-01 2.484413e-01 3.089708e-03
-----------------------------------------------
checking for refinement
regridding
rebalancing 7113 nodes
forming tree connections
{stack-trace}: 4 frames:
0x2b1fd1543e0f : hpx::detail::backtrace(unsigned long) + 0x7f in /home/dmarce1/debug/lib/libhpxd.so.0
0x2b1fd1545448 : boost::exception_ptr hpx::detail::get_exception<hpx::exception>(hpx::exception const&, std::string const&, std::string const&, long, std::string const&) + 0x238 in /home/dmarce1/debug/lib/libhpxd.so.0
0x2b1fd1542f92 : hpx::detail::assertion_failed_msg(char const*, char const*, char const*, char const*, long) + 0x432 in /home/dmarce1/debug/lib/libhpxd.so.0
0x2b1fd1543a62 : hpx::detail::assertion_failed(char const*, char const*, char const*, long) + 0x12 in /home/dmarce1/debug/lib/libhpxd.so.0
{env}: 141 entries:
ACLOCAL_PATH=/usr/local/packages/cmake/2.8.12/INTEL-14.0.2/share/aclocal
BASH_FUNC_module()=() { eval `/usr/local/packages/Modules/$MODULE_VERSION/bin/modulecmd bash $*`
}
CPATH=/home/dmarce1/debug/include:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/include:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/include:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/include:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//include:/usr/local/compilers/gcc/4.9.0/include:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/include:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/tbb/include
CUDA_NIC_INTEROP=1
CVS_RSH=ssh
GDBSERVER_MIC=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/target/mic/bin/gdbserver
GDB_CROSS=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-mic
GDB_HOST=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-ia-mic
GFORTRAN_UNBUFFERED_PRECONNECTED=y
G_BROKEN_FILENAMES=1
HISTCONTROL=ignoredups
HISTSIZE=1000
HOME=/home/dmarce1
HOSTNAME=smic004
HPX_NODEFILE=node.list
HYDI_CONTROL_FD=9
INFOPATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64/share/info/:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/info/
INTEL_LICENSE_FILE=/usr/local/compilers/Intel:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/licenses:/opt/intel/licenses:/home/dmarce1/intel/licenses
INTEL_PYTHONHOME=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/python/intel64/
IPPROOT=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp
I_MPI_CMD=mpirun -np 64 --machinefile node.list ./octotiger -t20
I_MPI_DAPL_PROVIDER=ofa-v2-mlx4_0-1u
I_MPI_EXT_MPI_CALLS_47452=0x2b1fd64d9110
I_MPI_FABRICS=shm:ofa
I_MPI_HYDRA_RMK=pbs
I_MPI_INFO_BRAND=Intel(R) Xeon(R)
I_MPI_INFO_CACHE1=0,1,2,3,4,8,9,10,11,12,16,17,18,19,20,24,25,26,27,28
I_MPI_INFO_CACHE2=0,1,2,3,4,8,9,10,11,12,16,17,18,19,20,24,25,26,27,28
I_MPI_INFO_CACHE3=0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,1,1,1,1
I_MPI_INFO_CACHES=3
I_MPI_INFO_CACHE_SHARE=2,2,32
I_MPI_INFO_CACHE_SIZE=32768,262144,26214400
I_MPI_INFO_CORE=0,1,2,3,4,8,9,10,11,12,0,1,2,3,4,8,9,10,11,12
I_MPI_INFO_C_NAME=Unknown
I_MPI_INFO_DESC=1342177285
I_MPI_INFO_FLGB=641
I_MPI_INFO_FLGC=2143216639
I_MPI_INFO_FLGD=-1075053569
I_MPI_INFO_LCPU=20
I_MPI_INFO_MODE=263
I_MPI_INFO_NC=20
I_MPI_INFO_NP=2
I_MPI_INFO_NUMA_NODE_DIST=10,21,21,10
I_MPI_INFO_NUMA_NODE_MAP=mlx4_0:1,scif0:-1,mic0:0,mic1:1
I_MPI_INFO_NUMA_NODE_NUM=2
I_MPI_INFO_PACK=0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,1,1,1,1
I_MPI_INFO_SERIAL=E5-2680 v2
I_MPI_INFO_SIGN=198372
I_MPI_INFO_STATE=0
I_MPI_INFO_THREAD=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
I_MPI_INFO_VEND=1
I_MPI_MPIRUN=mpirun
I_MPI_NUMBER_OF_MPI_PROCESSES_PER_NODE=1
I_MPI_OFA_ADAPTER_NAME=mlx4_0
I_MPI_PERHOST=allcores
I_MPI_PIN_INFO=x0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19
I_MPI_PIN_MAPPING=1:0 0
I_MPI_PM=hydra
I_MPI_RANK_CMD=./octotiger -t20
I_MPI_ROOT=/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048
I_MPI_THREAD_LEVEL=0
LANG=en_US.UTF-8
LANGUAGE_TERRITORY=en_US
LD_INCLUDE_PATH=/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/include
LD_LIBRARY_PATH=/home/dmarce1/debug/lib:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mpirt/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/tools/intel64/perfsys:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/libipt/intel64/lib:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//lib:/usr/local/compilers/gcc/4.9.0/lib/gcc/x86_64-unknown-linux-gnu/4.9.0:/usr/local/compilers/gcc/4.9.0/lib64:/usr/local/compilers/gcc/4.9.0/lib:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/compiler/lib/intel64:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/lib:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/mic/lib
LESSOPEN=|/usr/bin/lesspipe.sh %s
LHPC_DEVELCMAKE=/usr/local/packages/cmake/2.8.12/INTEL-14.0.2/easybuild/cmake-2.8.12-INTEL-14.0.2-easybuild-devel
LHPC_DEVELGCC=/usr/local/compilers/gcc/4.9.0/easybuild/gcc-4.9.0-easybuild-devel
LHPC_DEVELINTEL=/usr/local/packages/INTEL/14.0.2/easybuild/INTEL-14.0.2-easybuild-devel
LHPC_ROOTCMAKE=/usr/local/packages/cmake/2.8.12/INTEL-14.0.2
LHPC_ROOTGCC=/usr/local/compilers/gcc/4.9.0
LHPC_ROOTINTEL=/usr/local/packages/INTEL/14.0.2
LHPC_ROOT_HWLOC=/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2/
LHPC_VERSIONCMAKE=2.8.12
LHPC_VERSIONGCC=4.9.0
LHPC_VERSIONINTEL=14.0.2
LHPC_VERSION_HWLOC=1.10.0
LIBRARY_PATH=/home/dmarce1/debug/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//lib:/usr/local/compilers/gcc/4.9.0/lib64:/usr/local/compilers/gcc/4.9.0/lib:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/compiler/lib/intel64:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/lib/intel64
LM_LICENSE_FILE=/usr/local/compilers/pgi/license.dat
LOADEDMODULES=gcc/4.9.0:intel/14.0.2:hwloc/1.10.0/INTEL-14.0.2:INTEL/14.0.2:cmake/2.8.12/INTEL-14.0.2
LOGNAME=dmarce1
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.tbz=01;31:*.tbz2=01;31:*.bz=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01;36:
MAIL=/var/spool/mail/dmarce1
MANPATH=/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/man:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/man/en_US:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/man/en_US:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64/share/man/:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/man/:/usr/local/packages/cmake/2.8.12/INTEL-14.0.2/man:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//share/man:/usr/local/compilers/gcc/4.9.0/share/man:/usr/local/compilers/pgi/linux86-64/man:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/man/en_US:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/man/en_US:
MIC_LD_LIBRARY_PATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mpirt/lib/mic:/opt/intel/mic/coi/device-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/lib/mic:/opt/intel/mic/coi/device-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/mic:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/compiler/lib/mic:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/lib/mic
MIC_LIBRARY_PATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mpirt/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/mic
MKLROOT=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl
MOABHOMEDIR=/usr/moab
MODULEPATH=/usr/local/packages/Modules/modulefiles/apps:/usr/local/packages/Modules/modulefiles/admin:/usr/local/packages/Modules/modulefiles/xsede
MODULESHOME=/usr/local/packages/Modules/3.2.10
MODULE_VERSION=3.2.10
MODULE_VERSION_STACK=3.2.10
MPIR_CVAR_CH3_INTERFACE_HOSTNAME=smic004
MPIR_CVAR_NEMESIS_ENABLE_CKPOINT=1
MPM_LAUNCHER=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/mpm/bin/start_mpm.sh
NLSPATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/intel64/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/intel64/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/compiler/lib/intel64/locale/en_US:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/lib/intel64/locale/en_US
NPROCS=64
PATH=/home/dmarce1/debug/bin:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/bin/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/local/packages/cmake/2.8.12/INTEL-14.0.2/bin:/usr/lib64/qt-3.3/bin:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//bin:/usr/local/compilers/gcc/4.9.0/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/usr/local/bin:/usr/local/compilers/pgi/linux86-64/6.1/bin:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/bin/intel64:/opt/ibutils/bin:/home/dmarce1/bin
PBS_ENVIRONMENT=PBS_INTERACTIVE
PBS_GPUFILE=/var/spool/torque/aux//72828.smic3gpu
PBS_JOBCOOKIE=2A8BB89086446DFA34647EC68FAB7327
PBS_JOBID=72828.smic3
PBS_JOBNAME=STDIN
PBS_MOMPORT=15003
PBS_NODENUM=0
PBS_NP=1280
PBS_NUM_NODES=64
PBS_NUM_PPN=20
PBS_O_HOME=/home/dmarce1
PBS_O_HOST=smic1.hpc.lsu.edu
PBS_O_LANG=en_US.UTF-8
PBS_O_LOGNAME=dmarce1
PBS_O_MAIL=/var/spool/mail/dmarce1
PBS_O_PATH=/home/dmarce1/debug/bin:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/bin/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/home/dmarce1/debug/bin:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/bin/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/local/packages/cmake/2.8.12/INTEL-14.0.2/bin:/usr/lib64/qt-3.3/bin:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//bin:/usr/local/compilers/gcc/4.9.0/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/usr/local/bin:/usr/local/compilers/pgi/linux86-64/6.1/bin:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/bin/intel64:/opt/ibutils/bin:/opt/dell/srvadmin/bin:/home/dmarce1/bin:/usr/local/compilers/pgi/linux86-64/6.1/bin
PBS_O_QUEUE=workq
PBS_O_SHELL=/bin/bash
PBS_O_WORKDIR=/work/dmarce1/hpx/release
PBS_QUEUE=workq
PBS_SERVER=smic3
PBS_TASKNUM=1
PBS_VERSION=TORQUE-3.0.6
PBS_VNODENUM=0
PBS_WALLTIME=3600
PGI=/usr/local/compilers/pgi
PKG_CONFIG_PATH=/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//lib/pkgconfig:/home/dmarce1/debug/lib/pkgconfig
PMI_FD=14
PMI_RANK=0
PMI_SIZE=64
PWD=/work/dmarce1/octotiger
QTDIR=/usr/lib64/qt-3.3
QTINC=/usr/lib64/qt-3.3/include
QTLIB=/usr/lib64/qt-3.3/lib
SHELL=/bin/bash
SHLVL=3
SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
TBBROOT=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb
TERM=screen
USER=dmarce1
_=/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin/mpiexec.hydra
_LMFILES_=/usr/local/packages/Modules/modulefiles/apps/gcc/4.9.0:/usr/local/packages/Modules/modulefiles/apps/intel/14.0.2:/usr/local/packages/Modules/modulefiles/apps/hwloc/1.10.0/INTEL-14.0.2:/usr/local/packages/Modules/modulefiles/admin/INTEL/14.0.2:/usr/local/packages/Modules/modulefiles/apps/cmake/2.8.12/INTEL-14.0.2
_MODULESBEGINENV_=/home/dmarce1/.modulesbeginenv
{locality-id}: 0
{hostname}: [ (mpi:0) (tcp:127.0.0.1:7910) ]
{process-id}: 47452
{function}: void hpx::serialization::output_archive::add_gid(const hpx::naming::gid_type &, const hpx::naming::gid_type &)
{file}: /work/dmarce1/builds/hpx/src/runtime/serialization/output_archive.cpp
{line}: 18
{os-thread}: 1, worker-thread#1
{thread-id}: 00002b2014dc6780
{thread-description}: primary_namespace_service_action
{state}: state_running
{auxinfo}:
{config}:
HPX_HAVE_NATIVE_TLS=ON
HPX_HAVE_STACKTRACES=ON
HPX_HAVE_COMPRESSION_BZIP2=OFF
HPX_HAVE_COMPRESSION_SNAPPY=OFF
HPX_HAVE_COMPRESSION_ZLIB=OFF
HPX_HAVE_PARCEL_COALESCING=ON
HPX_HAVE_PARCELPORT_TCP=ON
HPX_HAVE_PARCELPORT_MPI=ON (MPICH V3.1.2, MPI V3.0)
HPX_HAVE_PARCELPORT_IPC=OFF
HPX_HAVE_PARCELPORT_IBVERBS=OFF
HPX_HAVE_VERIFY_LOCKS=ON
HPX_HAVE_HWLOC=ON
HPX_HAVE_ITTNOTIFY=OFF
HPX_HAVE_RUN_MAIN_EVERYWHERE=OFF
HPX_LIMIT=5
HPX_PARCEL_MAX_CONNECTIONS=512
HPX_PARCEL_MAX_CONNECTIONS_PER_LOCALITY=4
HPX_INITIAL_AGAS_LOCAL_CACHE_SIZE=256
HPX_AGAS_LOCAL_CACHE_SIZE_PER_THREAD=32
HPX_HAVE_MALLOC=custom
HPX_PREFIX (configured)=/work/dmarce1/builds/hpx_build
HPX_PREFIX=/home/dmarce1/debug
{version}: V0.9.12-trunk (AGAS: V3.0), Git: unknown
{boost}: V1.59.0
{build-type}: debug
{date}: Dec 9 2015 10:27:51
{platform}: linux
{compiler}: Intel C++ C++0x mode version 1500
{stdlib}: GNU libstdc++ version 20140422
{what}: assertion '(*new_gids_)[gid].size() == 1' failed: HPX(assertion_failure)
{stack-trace}: 4 frames:
0x2b4a059e0e0f : hpx::detail::backtrace(unsigned long) + 0x7f in /home/dmarce1/debug/lib/libhpxd.so.0
0x2b4a059e2448 : boost::exception_ptr hpx::detail::get_exception<hpx::exception>(hpx::exception const&, std::string const&, std::string const&, long, std::string const&) + 0x238 in /home/dmarce1/debug/lib/libhpxd.so.0
0x2b4a059dff92 : hpx::detail::assertion_failed_msg(char const*, char const*, char const*, char const*, long) + 0x432 in /home/dmarce1/debug/lib/libhpxd.so.0
0x2b4a059e0a62 : hpx::detail::assertion_failed(char const*, char const*, char const*, long) + 0x12 in /home/dmarce1/debug/lib/libhpxd.so.0
{env}: 141 entries:
ACLOCAL_PATH=/usr/local/packages/cmake/2.8.12/INTEL-14.0.2/share/aclocal
BASH_FUNC_module()=() { eval `/usr/local/packages/Modules/$MODULE_VERSION/bin/modulecmd bash $*`
}
CPATH=/home/dmarce1/debug/include:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/include:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/include:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/include:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//include:/usr/local/compilers/gcc/4.9.0/include:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/include:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/tbb/include
CUDA_NIC_INTEROP=1
CVS_RSH=ssh
GDBSERVER_MIC=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/target/mic/bin/gdbserver
GDB_CROSS=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-mic
GDB_HOST=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-ia-mic
GFORTRAN_UNBUFFERED_PRECONNECTED=y
G_BROKEN_FILENAMES=1
HISTCONTROL=ignoredups
HISTSIZE=1000
HOME=/home/dmarce1
HPX_NODEFILE=node.list
INFOPATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64/share/info/:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/info/
INTEL_LICENSE_FILE=/usr/local/compilers/Intel:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/licenses:/opt/intel/licenses:/home/dmarce1/intel/licenses
INTEL_PYTHONHOME=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/python/intel64/
IPPROOT=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp
I_MPI_CMD=mpirun -np 64 --machinefile node.list ./octotiger -t20
I_MPI_DAPL_PROVIDER=ofa-v2-mlx4_0-1u
I_MPI_EXT_MPI_CALLS_112618=0x2b4a0a976110
I_MPI_FABRICS=shm:ofa
I_MPI_HYDRA_RMK=pbs
I_MPI_INFO_BRAND=Intel(R) Xeon(R)
I_MPI_INFO_CACHE1=0,1,2,3,4,8,9,10,11,12,16,17,18,19,20,24,25,26,27,28
I_MPI_INFO_CACHE2=0,1,2,3,4,8,9,10,11,12,16,17,18,19,20,24,25,26,27,28
I_MPI_INFO_CACHE3=0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,1,1,1,1
I_MPI_INFO_CACHES=3
I_MPI_INFO_CACHE_SHARE=2,2,32
I_MPI_INFO_CACHE_SIZE=32768,262144,26214400
I_MPI_INFO_CORE=0,1,2,3,4,8,9,10,11,12,0,1,2,3,4,8,9,10,11,12
I_MPI_INFO_C_NAME=Unknown
I_MPI_INFO_DESC=1342177285
I_MPI_INFO_FLGB=641
I_MPI_INFO_FLGC=2143216639
I_MPI_INFO_FLGD=-1075053569
I_MPI_INFO_LCPU=20
I_MPI_INFO_MODE=263
I_MPI_INFO_NC=20
I_MPI_INFO_NP=2
I_MPI_INFO_NUMA_NODE_DIST=10,21,21,10
I_MPI_INFO_NUMA_NODE_MAP=mlx4_0:1,scif0:-1,mic0:0,mic1:1
I_MPI_INFO_NUMA_NODE_NUM=2
I_MPI_INFO_PACK=0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,1,1,1,1
I_MPI_INFO_SERIAL=E5-2680 v2
I_MPI_INFO_SIGN=198372
I_MPI_INFO_STATE=0
I_MPI_INFO_THREAD=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
I_MPI_INFO_VEND=1
I_MPI_MPIRUN=mpirun
I_MPI_NUMBER_OF_MPI_PROCESSES_PER_NODE=1
I_MPI_OFA_ADAPTER_NAME=mlx4_0
I_MPI_PERHOST=allcores
I_MPI_PIN_INFO=x0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19
I_MPI_PIN_MAPPING=1:24 0
I_MPI_PM=hydra
I_MPI_RANK_CMD=./octotiger -t20
I_MPI_ROOT=/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048
I_MPI_THREAD_LEVEL=0
LANG=en_US.UTF-8
LANGUAGE_TERRITORY=en_US
LD_INCLUDE_PATH=/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/include
LD_LIBRARY_PATH=/home/dmarce1/debug/lib:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mpirt/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/tools/intel64/perfsys:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/libipt/intel64/lib:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//lib:/usr/local/compilers/gcc/4.9.0/lib/gcc/x86_64-unknown-linux-gnu/4.9.0:/usr/local/compilers/gcc/4.9.0/lib64:/usr/local/compilers/gcc/4.9.0/lib:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/compiler/lib/intel64:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/lib:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/mic/lib
LESSOPEN=|/usr/bin/lesspipe.sh %s
LHPC_DEVELCMAKE=/usr/local/packages/cmake/2.8.12/INTEL-14.0.2/easybuild/cmake-2.8.12-INTEL-14.0.2-easybuild-devel
LHPC_DEVELGCC=/usr/local/compilers/gcc/4.9.0/easybuild/gcc-4.9.0-easybuild-devel
LHPC_DEVELINTEL=/usr/local/packages/INTEL/14.0.2/easybuild/INTEL-14.0.2-easybuild-devel
LHPC_ROOTCMAKE=/usr/local/packages/cmake/2.8.12/INTEL-14.0.2
LHPC_ROOTGCC=/usr/local/compilers/gcc/4.9.0
LHPC_ROOTINTEL=/usr/local/packages/INTEL/14.0.2
LHPC_ROOT_HWLOC=/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2/
LHPC_VERSIONCMAKE=2.8.12
LHPC_VERSIONGCC=4.9.0
LHPC_VERSIONINTEL=14.0.2
LHPC_VERSION_HWLOC=1.10.0
LIBRARY_PATH=/home/dmarce1/debug/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//lib:/usr/local/compilers/gcc/4.9.0/lib64:/usr/local/compilers/gcc/4.9.0/lib:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/compiler/lib/intel64:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/lib/intel64
LM_LICENSE_FILE=/usr/local/compilers/pgi/license.dat
LOADEDMODULES=gcc/4.9.0:intel/14.0.2:hwloc/1.10.0/INTEL-14.0.2:INTEL/14.0.2:cmake/2.8.12/INTEL-14.0.2
LOGNAME=dmarce1
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.tbz=01;31:*.tbz2=01;31:*.bz=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01;36:
MAIL=/var/spool/mail/dmarce1
MANPATH=/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/man:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/man/en_US:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/man/en_US:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64/share/man/:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/man/:/usr/local/packages/cmake/2.8.12/INTEL-14.0.2/man:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//share/man:/usr/local/compilers/gcc/4.9.0/share/man:/usr/local/compilers/pgi/linux86-64/man:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/man/en_US:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/man/en_US:
MIC_LD_LIBRARY_PATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mpirt/lib/mic:/opt/intel/mic/coi/device-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/lib/mic:/opt/intel/mic/coi/device-linux-release/lib:/opt/intel/mic/myo/lib:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/mic:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/compiler/lib/mic:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/lib/mic
MIC_LIBRARY_PATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mpirt/lib/mic:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb/lib/mic
MKLROOT=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl
MOABHOMEDIR=/usr/moab
MODULEPATH=/usr/local/packages/Modules/modulefiles/apps:/usr/local/packages/Modules/modulefiles/admin:/usr/local/packages/Modules/modulefiles/xsede
MODULESHOME=/usr/local/packages/Modules/3.2.10
MODULE_VERSION=3.2.10
MODULE_VERSION_STACK=3.2.10
MPIR_CVAR_CH3_INTERFACE_HOSTNAME=smic274
MPIR_CVAR_NEMESIS_ENABLE_CKPOINT=1
MPM_LAUNCHER=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/mpm/bin/start_mpm.sh
NLSPATH=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/compiler/lib/intel64/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/ipp/lib/intel64/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/mkl/lib/intel64/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/compiler/lib/intel64/locale/en_US:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/mkl/lib/intel64/locale/en_US
NPROCS=64
PATH=/home/dmarce1/debug/bin:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/bin/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/local/packages/cmake/2.8.12/INTEL-14.0.2/bin:/usr/lib64/qt-3.3/bin:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//bin:/usr/local/compilers/gcc/4.9.0/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/usr/local/bin:/usr/local/compilers/pgi/linux86-64/6.1/bin:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/bin/intel64:/opt/ibutils/bin:/home/dmarce1/bin
PBS_ENVIRONMENT=PBS_INTERACTIVE
PBS_GPUFILE=/var/spool/torque/aux//72828.smic3gpu
PBS_JOBCOOKIE=2A8BB89086446DFA34647EC68FAB7327
PBS_JOBID=72828.smic3
PBS_JOBNAME=STDIN
PBS_MOMPORT=15003
PBS_NODENUM=0
PBS_NP=1280
PBS_NUM_NODES=64
PBS_NUM_PPN=20
PBS_O_HOME=/home/dmarce1
PBS_O_HOST=smic1.hpc.lsu.edu
PBS_O_LANG=en_US.UTF-8
PBS_O_LOGNAME=dmarce1
PBS_O_MAIL=/var/spool/mail/dmarce1
PBS_O_PATH=/home/dmarce1/debug/bin:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/bin/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/home/dmarce1/debug/bin:/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/bin/intel64:/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/local/packages/cmake/2.8.12/INTEL-14.0.2/bin:/usr/lib64/qt-3.3/bin:/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//bin:/usr/local/compilers/gcc/4.9.0/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/usr/local/bin:/usr/local/compilers/pgi/linux86-64/6.1/bin:/usr/local/compilers/Intel/cluster_studio_xe_2013.1.046/composer_xe_2013_sp1.2.144/bin/intel64:/opt/ibutils/bin:/opt/dell/srvadmin/bin:/home/dmarce1/bin:/usr/local/compilers/pgi/linux86-64/6.1/bin
PBS_O_QUEUE=workq
PBS_O_SHELL=/bin/bash
PBS_O_WORKDIR=/work/dmarce1/hpx/release
PBS_QUEUE=workq
PBS_SERVER=smic3
PBS_TASKNUM=1
PBS_VERSION=TORQUE-3.0.6
PBS_VNODENUM=0
PBS_WALLTIME=3600
PGI=/usr/local/compilers/pgi
PKG_CONFIG_PATH=/usr/local/packages/hwloc/1.10.0/INTEL-14.0.2//lib/pkgconfig:/home/dmarce1/debug/lib/pkgconfig
PMI_FD=7
PMI_RANK=24
PMI_SIZE=64
PWD=/work/dmarce1/octotiger
QTDIR=/usr/lib64/qt-3.3
QTINC=/usr/lib64/qt-3.3/include
QTLIB=/usr/lib64/qt-3.3/lib
SHELL=/bin/bash
SHLVL=3
SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
SSH_CLIENT=204.90.41.4 50797 22
SSH_CONNECTION=204.90.41.4 50797 204.90.42.20 22
TBBROOT=/usr/local/compilers/Intel/parallel_studio-2015u3/composer_xe_2015.3.187/tbb
TERM=screen
USER=dmarce1
_=/usr/local/compilers/Intel/parallel_studio-2015u3//impi/5.0.3.048/intel64/bin/mpiexec.hydra
_LMFILES_=/usr/local/packages/Modules/modulefiles/apps/gcc/4.9.0:/usr/local/packages/Modules/modulefiles/apps/intel/14.0.2:/usr/local/packages/Modules/modulefiles/apps/hwloc/1.10.0/INTEL-14.0.2:/usr/local/packages/Modules/modulefiles/admin/INTEL/14.0.2:/usr/local/packages/Modules/modulefiles/apps/cmake/2.8.12/INTEL-14.0.2
_MODULESBEGINENV_=/home/dmarce1/.modulesbeginenv
{locality-id}: 24
{hostname}: [ (mpi:24) (tcp:127.0.0.1:7934) ]
{process-id}: 112618
{function}: void hpx::serialization::output_archive::add_gid(const hpx::naming::gid_type &, const hpx::naming::gid_type &)
{file}: /work/dmarce1/builds/hpx/src/runtime/serialization/output_archive.cpp
{line}: 18
{os-thread}: 3, worker-thread#3
{thread-id}: 00002b4a900072c0
{thread-description}: primary_namespace_service_action
{state}: state_running
{auxinfo}:
{config}:
HPX_HAVE_NATIVE_TLS=ON
HPX_HAVE_STACKTRACES=ON
HPX_HAVE_COMPRESSION_BZIP2=OFF
HPX_HAVE_COMPRESSION_SNAPPY=OFF
HPX_HAVE_COMPRESSION_ZLIB=OFF
HPX_HAVE_PARCEL_COALESCING=ON
HPX_HAVE_PARCELPORT_TCP=ON
HPX_HAVE_PARCELPORT_MPI=ON (MPICH V3.1.2, MPI V3.0)
HPX_HAVE_PARCELPORT_IPC=OFF
HPX_HAVE_PARCELPORT_IBVERBS=OFF
HPX_HAVE_VERIFY_LOCKS=ON
HPX_HAVE_HWLOC=ON
HPX_HAVE_ITTNOTIFY=OFF
HPX_HAVE_RUN_MAIN_EVERYWHERE=OFF
HPX_LIMIT=5
HPX_PARCEL_MAX_CONNECTIONS=512
HPX_PARCEL_MAX_CONNECTIONS_PER_LOCALITY=4
HPX_INITIAL_AGAS_LOCAL_CACHE_SIZE=256
HPX_AGAS_LOCAL_CACHE_SIZE_PER_THREAD=32
HPX_HAVE_MALLOC=custom
HPX_PREFIX (configured)=/work/dmarce1/builds/hpx_build
HPX_PREFIX=/home/dmarce1/debug
{version}: V0.9.12-trunk (AGAS: V3.0), Git: unknown
{boost}: V1.59.0
{build-type}: debug
{date}: Dec 9 2015 10:27:51
{platform}: linux
{compiler}: Intel C++ C++0x mode version 1500
{stdlib}: GNU libstdc++ version 20140422
{what}: assertion '(*new_gids_)[gid].size() == 1' failed: HPX(assertion_failure)
===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= PID 47452 RUNNING AT smic004
= EXIT CODE: 6
= CLEANING UP REMAINING PROCESSES
= YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
APPLICATION TERMINATED WITH THE EXIT STRING: Aborted (signal 6)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment