Impostor Bounds Simulations

covertype-5k_simulation.txt

$ bin/mlpack_lmnn -i covertype-5k.csv -l covertype-5k.labels.csv  -k 5  -o output.csv   -P true  -O lbfgs -v -n 50| grep -v 'node combinations\|base cases' 
[DEBUG] Compiled with debugging symbols.
[INFO ] Loading 'covertype-5k.csv' as CSV data.  Size is 54 x 5000.
[INFO ] Loading 'covertype-5k.labels.csv' as raw ASCII formatted data.  Size is 5000 x 1.
[INFO ] Initial learning point have invalid dimensionality.  Identity matrix will be used as initial learning point for optimization.
Iteration - 0 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0
[DEBUG] L-BFGS iteration 0; objective 3.09637e+06, gradient norm 8.1396e+08, 0.
Iteration - 1 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.697094
[DEBUG] L-BFGS iteration 1; objective 1.93411e+06, gradient norm 3.23659e+08, 0.375363.
Iteration - 2 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.47624
[DEBUG] L-BFGS iteration 2; objective 1.306e+06, gradient norm 2.25493e+08, 0.324751.
Iteration - 3 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.411651
[DEBUG] L-BFGS iteration 3; objective 1.1691e+06, gradient norm 2.99546e+08, 0.104824.
Iteration - 4 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.425348
Iteration - 5 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.212674
[DEBUG] L-BFGS iteration 4; objective 980278, gradient norm 1.98417e+08, 0.161513.
Iteration - 6 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.076317
[DEBUG] L-BFGS iteration 5; objective 886474, gradient norm 1.2214e+08, 0.0956916.
Iteration - 7 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.152408
[DEBUG] L-BFGS iteration 6; objective 790235, gradient norm 6.51051e+07, 0.108564.
Iteration - 8 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.140987
[DEBUG] L-BFGS iteration 7; objective 657977, gradient norm 8.25228e+07, 0.167365.
Iteration - 9 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.201268
[DEBUG] L-BFGS iteration 8; objective 511261, gradient norm 7.35727e+07, 0.22298.
Iteration - 10 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.132912
[DEBUG] L-BFGS iteration 9; objective 418332, gradient norm 7.47346e+07, 0.181766.
Iteration - 11 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.263801
Iteration - 12 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.1319
[DEBUG] L-BFGS iteration 10; objective 372288, gradient norm 1.00396e+08, 0.110066.
Iteration - 13 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.043245
[DEBUG] L-BFGS iteration 11; objective 308663, gradient norm 4.18334e+07, 0.170901.
Iteration - 14 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0546897
[DEBUG] L-BFGS iteration 12; objective 270022, gradient norm 2.4347e+07, 0.125189.
Iteration - 15 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0952191
[DEBUG] L-BFGS iteration 13; objective 234873, gradient norm 1.56353e+07, 0.130172.
Iteration - 16 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.118201
[DEBUG] L-BFGS iteration 14; objective 230599, gradient norm 3.20919e+07, 0.0181971.
Iteration - 17 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0458051
[DEBUG] L-BFGS iteration 15; objective 202926, gradient norm 2.03654e+07, 0.120002.
Iteration - 18 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.021505
[DEBUG] L-BFGS iteration 16; objective 188434, gradient norm 1.44657e+07, 0.071418.
Iteration - 19 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0405141
[DEBUG] L-BFGS iteration 17; objective 174427, gradient norm 1.40686e+07, 0.0743308.
Iteration - 20 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0571309
[DEBUG] L-BFGS iteration 18; objective 160007, gradient norm 1.29594e+07, 0.0826732.
Iteration - 21 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0776934
[DEBUG] L-BFGS iteration 19; objective 151223, gradient norm 1.44931e+07, 0.0548976.
Iteration - 22 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0154389
Iteration - 23 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.00771943
[DEBUG] L-BFGS iteration 20; objective 148545, gradient norm 5.62981e+06, 0.0177054.
Iteration - 24 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.00857175
[DEBUG] L-BFGS iteration 21; objective 147755, gradient norm 3.25521e+06, 0.00532338.
Iteration - 25 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0142983
[DEBUG] L-BFGS iteration 22; objective 147588, gradient norm 3.52359e+06, 0.00112669.
Iteration - 26 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0447965
[DEBUG] L-BFGS iteration 23; objective 145956, gradient norm 4.01999e+06, 0.0110563.
Iteration - 27 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0273302
[DEBUG] L-BFGS iteration 24; objective 143524, gradient norm 4.39309e+06, 0.0166672.
Iteration - 28 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0287402
[DEBUG] L-BFGS iteration 25; objective 138986, gradient norm 6.07197e+06, 0.0316174.
Iteration - 29 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0351457
[DEBUG] L-BFGS iteration 26; objective 136817, gradient norm 6.08389e+06, 0.0156062.
Iteration - 30 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0404275
[DEBUG] L-BFGS iteration 27; objective 133716, gradient norm 1.30653e+07, 0.022663.
Iteration - 31 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.00717834
[DEBUG] L-BFGS iteration 28; objective 131719, gradient norm 4.86899e+06, 0.014939.
Iteration - 32 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0223392
[DEBUG] L-BFGS iteration 29; objective 128997, gradient norm 5.6549e+06, 0.0206591.
Iteration - 33 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0487968
[DEBUG] L-BFGS iteration 30; objective 125347, gradient norm 7.56099e+06, 0.0283003.
Iteration - 34 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0887029
[DEBUG] L-BFGS iteration 31; objective 116774, gradient norm 8.66661e+06, 0.0683939.
Iteration - 35 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0815075
[DEBUG] L-BFGS iteration 32; objective 109272, gradient norm 7.91705e+06, 0.0642457.
Iteration - 36 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.042956
[DEBUG] L-BFGS iteration 33; objective 100809, gradient norm 5.41249e+06, 0.077444.
Iteration - 37 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.114598
Iteration - 38 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0572992
[DEBUG] L-BFGS iteration 34; objective 95160.2, gradient norm 8.7839e+06, 0.0560359.
Iteration - 39 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0374193
[DEBUG] L-BFGS iteration 35; objective 90445.2, gradient norm 6.12573e+06, 0.0495484.
Iteration - 40 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.123203
[DEBUG] L-BFGS iteration 36; objective 82601.8, gradient norm 9.68747e+06, 0.0867198.
Iteration - 41 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0946966
[DEBUG] L-BFGS iteration 37; objective 75479.2, gradient norm 5.39667e+06, 0.0862273.
Iteration - 42 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0214351
[DEBUG] L-BFGS iteration 38; objective 71990.4, gradient norm 3.96723e+06, 0.0462222.
Iteration - 43 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0455925
[DEBUG] L-BFGS iteration 39; objective 69383.8, gradient norm 2.73121e+06, 0.0362078.
Iteration - 44 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0525331
[DEBUG] L-BFGS iteration 40; objective 67184.9, gradient norm 2.77132e+06, 0.0316925.
Iteration - 45 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0507428
[DEBUG] L-BFGS iteration 41; objective 65692.9, gradient norm 4.07772e+06, 0.0222071.
Iteration - 46 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0152443
[DEBUG] L-BFGS iteration 42; objective 64147.4, gradient norm 1.75056e+06, 0.0235262.
Iteration - 47 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.020738
[DEBUG] L-BFGS iteration 43; objective 63397.3, gradient norm 1.55823e+06, 0.0116925.
Iteration - 48 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0207637
[DEBUG] L-BFGS iteration 44; objective 63066.1, gradient norm 2.6188e+06, 0.0052255.
Iteration - 49 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.00210609
[DEBUG] L-BFGS iteration 45; objective 62607.5, gradient norm 1.02169e+06, 0.00727103.
Iteration - 50 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.00437198
[DEBUG] L-BFGS iteration 46; objective 62269.1, gradient norm 1.15495e+06, 0.005405.
Iteration - 51 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.00401681
[DEBUG] L-BFGS iteration 47; objective 61866.4, gradient norm 1.16903e+06, 0.00646776.
Iteration - 52 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.0155961
[DEBUG] L-BFGS iteration 48; objective 61582.7, gradient norm 2.35527e+06, 0.00458576.
Iteration - 53 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.00862342
[DEBUG] L-BFGS iteration 49; objective 61207.9, gradient norm 1.4856e+06, 0.00608594.
Iteration - 54 : Out of 5000, Impostors were recalculated for 5000 points. transformationDiff : 0.00892191
[INFO ] Accuracy on initial dataset: 86.74%
[INFO ] Accuracy on transformed dataset: 88.14%
[INFO ] Saving CSV data to 'output.csv'.
[INFO ] 
[INFO ] Execution parameters:
[INFO ]   batch_size: 50
[INFO ]   distance_file: 
[INFO ]   help: 0
[INFO ]   info: 
[INFO ]   input_file: covertype-5k.csv
[INFO ]   k: 5
[INFO ]   labels_file: covertype-5k.labels.csv
[INFO ]   linear_scan: 0
[INFO ]   max_iterations: 50
[INFO ]   normalize: 0
[INFO ]   optimizer: lbfgs
[INFO ]   output_file: output.csv
[INFO ]   passes: 50
[INFO ]   print_accuracy: 1
[INFO ]   range: 1
[INFO ]   rank: 0
[INFO ]   regularization: 0.5
[INFO ]   seed: 0
[INFO ]   step_size: 0.01
[INFO ]   tolerance: 1e-07
[INFO ]   transformed_data_file: 
[INFO ]   verbose: 1
[INFO ]   version: 0
[INFO ] Program timers:
[INFO ]   computing_neighbors: 244.109149s (4 mins, 4.1 secs)
[INFO ]   line_search: 401.660048s (6 mins, 41.6 secs)
[INFO ]   lmnn_function_compute_impostors: 260.587437s (4 mins, 20.5 secs)
[INFO ]   lmnn_optimization: 405.991062s (6 mins, 45.9 secs)
[INFO ]   loading_data: 0.082364s
[INFO ]   saving_data: 0.003465s
[INFO ]   total_time: 415.228501s (6 mins, 55.2 secs)
[INFO ]   tree_building: 2.591929s

iris_simulation.txt

$ bin/mlpack_lmnn -i iris.csv -l iris_labels.txt  -k 5  -o output.csv   -P true  -O lbfgs -v -A 4| grep -v 'node combinations\|base cases' 
[DEBUG] Compiled with debugging symbols.
[INFO ] Loading 'iris.csv' as CSV data.  Size is 4 x 150.
[INFO ] Loading 'iris_labels.txt' as raw ASCII formatted data.  Size is 150 x 1.
Iteration - 0 : Out of 150, Impostors were recalculated for 150 points. transformationDiff : 0
[DEBUG] L-BFGS iteration 0; objective 879.389, gradient norm 919.64, 0.
Iteration - 1 : Out of 150, Impostors were recalculated for 150 points. transformationDiff : 0.988833
[DEBUG] L-BFGS iteration 1; objective 611.852, gradient norm 405.707, 0.304231.
Iteration - 2 : Out of 150, Impostors were recalculated for 150 points. transformationDiff : 0.899811
[DEBUG] L-BFGS iteration 2; objective 492.278, gradient norm 236.235, 0.195429.
Iteration - 3 : Out of 150, Impostors were recalculated for 150 points. transformationDiff : 1.42929
Iteration - 4 : Out of 150, Impostors were recalculated for 150 points. transformationDiff : 0.714647
[DEBUG] L-BFGS iteration 3; objective 477.899, gradient norm 80.2165, 0.0292104.
Iteration - 5 : Out of 150, Impostors were recalculated for 150 points. transformationDiff : 0.41961
Iteration - 6 : Out of 150, Impostors were recalculated for 150 points. transformationDiff : 0.209805
Iteration - 7 : Out of 150, Impostors were recalculated for 150 points. transformationDiff : 0.104903
Iteration - 8 : Out of 150, Impostors were recalculated for 149 points. transformationDiff : 0.0524513
Iteration - 9 : Out of 150, Impostors were recalculated for 124 points. transformationDiff : 0.0262256
Iteration - 10 : Out of 150, Impostors were recalculated for 87 points. transformationDiff : 0.0131128
Iteration - 11 : Out of 150, Impostors were recalculated for 63 points. transformationDiff : 0.00655641
Iteration - 12 : Out of 150, Impostors were recalculated for 38 points. transformationDiff : 0.0032782
Iteration - 13 : Out of 150, Impostors were recalculated for 20 points. transformationDiff : 0.0016391
Iteration - 14 : Out of 150, Impostors were recalculated for 11 points. transformationDiff : 0.000819551
Iteration - 15 : Out of 150, Impostors were recalculated for 6 points. transformationDiff : 0.000409775
Iteration - 16 : Out of 150, Impostors were recalculated for 3 points. transformationDiff : 0.000204888
Iteration - 17 : Out of 150, Impostors were recalculated for 1 points. transformationDiff : 0.000102444
Iteration - 18 : Out of 150, Impostors were recalculated for 1 points. transformationDiff : 5.12219e-05
Iteration - 19 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 2.5611e-05
Iteration - 20 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 1.28055e-05
Iteration - 21 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 6.40274e-06
Iteration - 22 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 3.20137e-06
Iteration - 23 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 1.60069e-06
Iteration - 24 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 8.00343e-07
Iteration - 25 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 4.00171e-07
Iteration - 26 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 2.00086e-07
Iteration - 27 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 1.00043e-07
Iteration - 28 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 5.00214e-08
Iteration - 29 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 2.50107e-08
Iteration - 30 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 1.25054e-08
Iteration - 31 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 6.25268e-09
Iteration - 32 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 3.12634e-09
Iteration - 33 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 1.56317e-09
Iteration - 34 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 7.81585e-10
Iteration - 35 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 3.90792e-10
Iteration - 36 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 1.95396e-10
Iteration - 37 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 9.7698e-11
Iteration - 38 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 4.88491e-11
Iteration - 39 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 2.44245e-11
Iteration - 40 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 1.22122e-11
Iteration - 41 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 6.10622e-12
Iteration - 42 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 3.05302e-12
Iteration - 43 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 1.52655e-12
Iteration - 44 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 7.63206e-13
Iteration - 45 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 3.8168e-13
Iteration - 46 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 1.90821e-13
Iteration - 47 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 9.5344e-14
Iteration - 48 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 4.77169e-14
Iteration - 49 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 5.24146e-14
Iteration - 50 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 5.00175e-14
Iteration - 51 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 5.51271e-14
Iteration - 52 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 5.2646e-14
Iteration - 53 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 5.78043e-14
Iteration - 54 : Out of 150, Impostors were recalculated for 0 points. transformationDiff : 5.51891e-14
[DEBUG] L-BFGS function value stable (terminating successfully).
[INFO ] Accuracy on initial dataset: 96.6667%
[INFO ] Accuracy on transformed dataset: 96.6667%
[INFO ] Saving CSV data to 'output.csv'.
[INFO ] 
[INFO ] Execution parameters:
[INFO ]   batch_size: 50
[INFO ]   distance_file: 
[INFO ]   help: 0
[INFO ]   info: 
[INFO ]   input_file: iris.csv
[INFO ]   k: 5
[INFO ]   labels_file: iris_labels.txt
[INFO ]   linear_scan: 0
[INFO ]   max_iterations: 100000
[INFO ]   normalize: 0
[INFO ]   optimizer: lbfgs
[INFO ]   output_file: output.csv
[INFO ]   passes: 50
[INFO ]   print_accuracy: 1
[INFO ]   range: 1
[INFO ]   rank: 4
[INFO ]   regularization: 0.5
[INFO ]   seed: 0
[INFO ]   step_size: 0.01
[INFO ]   tolerance: 1e-07
[INFO ]   transformed_data_file: 
[INFO ]   verbose: 1
[INFO ]   version: 0
[INFO ] Program timers:
[INFO ]   computing_neighbors: 0.162287s
[INFO ]   line_search: 0.424232s
[INFO ]   lmnn_function_compute_impostors: 0.184121s
[INFO ]   lmnn_optimization: 0.444343s
[INFO ]   loading_data: 0.000586s
[INFO ]   saving_data: 0.000146s
[INFO ]   total_time: 0.497246s
[INFO ]   tree_building: 0.005237s

vc2_simulation.txt

$ bin/mlpack_lmnn -i vc2.csv -l vc2_labels.txt  -k 5  -o output.csv   -P true  -O lbfgs -v -A 6| grep -v 'node combinations\|base cases' 
[DEBUG] Compiled with debugging symbols.
[INFO ] Loading 'vc2.csv' as CSV data.  Size is 6 x 207.
[INFO ] Loading 'vc2_labels.txt' as raw ASCII formatted data.  Size is 207 x 1.
Iteration - 0 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0
[DEBUG] L-BFGS iteration 0; objective 27026.5, gradient norm 1.26898e+06, 0.
Iteration - 1 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.993055
[DEBUG] L-BFGS iteration 1; objective 18657.3, gradient norm 692667, 0.309667.
Iteration - 2 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 1.48981
[DEBUG] L-BFGS iteration 2; objective 9337.29, gradient norm 295584, 0.499536.
Iteration - 3 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.451885
[DEBUG] L-BFGS iteration 3; objective 8890.35, gradient norm 455710, 0.0478664.
Iteration - 4 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.279036
[DEBUG] L-BFGS iteration 4; objective 6429.24, gradient norm 92499.4, 0.276829.
Iteration - 5 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.205974
[DEBUG] L-BFGS iteration 5; objective 5012.41, gradient norm 99575.8, 0.220374.
Iteration - 6 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.215435
[DEBUG] L-BFGS iteration 6; objective 3579.4, gradient norm 108749, 0.285892.
Iteration - 7 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.249883
[DEBUG] L-BFGS iteration 7; objective 3178.4, gradient norm 47882.8, 0.112029.
Iteration - 8 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.16244
[DEBUG] L-BFGS iteration 8; objective 2426.99, gradient norm 66439.5, 0.236411.
Iteration - 9 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.065376
[DEBUG] L-BFGS iteration 9; objective 2423.52, gradient norm 20009.4, 0.00143015.
Iteration - 10 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.0424204
[DEBUG] L-BFGS iteration 10; objective 2134.2, gradient norm 10587, 0.11938.
Iteration - 11 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.018408
[DEBUG] L-BFGS iteration 11; objective 2077.13, gradient norm 4320.53, 0.0267423.
Iteration - 12 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.0113672
[DEBUG] L-BFGS iteration 12; objective 2067.79, gradient norm 2666.19, 0.00449441.
Iteration - 13 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.00387424
[DEBUG] L-BFGS iteration 13; objective 2059.81, gradient norm 1222.8, 0.00385859.
Iteration - 14 : Out of 207, Impostors were recalculated for 207 points. transformationDiff : 0.00270572
[DEBUG] L-BFGS iteration 14; objective 2057.9, gradient norm 1069.04, 0.000930571.
Iteration - 15 : Out of 207, Impostors were recalculated for 203 points. transformationDiff : 0.00150598
[DEBUG] L-BFGS iteration 15; objective 2056.14, gradient norm 522.663, 0.000856543.
Iteration - 16 : Out of 207, Impostors were recalculated for 188 points. transformationDiff : 0.00092451
Iteration - 17 : Out of 207, Impostors were recalculated for 137 points. transformationDiff : 0.000462255
Iteration - 18 : Out of 207, Impostors were recalculated for 99 points. transformationDiff : 0.000231128
Iteration - 19 : Out of 207, Impostors were recalculated for 56 points. transformationDiff : 0.000115564
Iteration - 20 : Out of 207, Impostors were recalculated for 39 points. transformationDiff : 5.77819e-05
Iteration - 21 : Out of 207, Impostors were recalculated for 25 points. transformationDiff : 2.88909e-05
Iteration - 22 : Out of 207, Impostors were recalculated for 11 points. transformationDiff : 1.44455e-05
Iteration - 23 : Out of 207, Impostors were recalculated for 4 points. transformationDiff : 7.22274e-06
Iteration - 24 : Out of 207, Impostors were recalculated for 3 points. transformationDiff : 3.61137e-06
Iteration - 25 : Out of 207, Impostors were recalculated for 1 points. transformationDiff : 1.80568e-06
Iteration - 26 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 9.02842e-07
Iteration - 27 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 4.51421e-07
Iteration - 28 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 2.25711e-07
Iteration - 29 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 1.12855e-07
Iteration - 30 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 5.64276e-08
Iteration - 31 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 2.82138e-08
Iteration - 32 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 1.41069e-08
Iteration - 33 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 7.05345e-09
Iteration - 34 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 3.52673e-09
Iteration - 35 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 1.76336e-09
Iteration - 36 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 8.81682e-10
Iteration - 37 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 4.40841e-10
Iteration - 38 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 2.2042e-10
Iteration - 39 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 1.1021e-10
Iteration - 40 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 5.51051e-11
Iteration - 41 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 2.75526e-11
Iteration - 42 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 1.37763e-11
Iteration - 43 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 6.88815e-12
Iteration - 44 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 3.44408e-12
Iteration - 45 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 1.72202e-12
Iteration - 46 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 8.61039e-13
Iteration - 47 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 4.3049e-13
Iteration - 48 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 2.15262e-13
Iteration - 49 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 1.07612e-13
Iteration - 50 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 5.38278e-14
Iteration - 51 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 2.68993e-14
Iteration - 52 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 1.34646e-14
Iteration - 53 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 6.71839e-15
Iteration - 54 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 3.37071e-15
Iteration - 55 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 1.68596e-15
Iteration - 56 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 8.43137e-16
Iteration - 57 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 4.06293e-16
Iteration - 58 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 2.07942e-16
Iteration - 59 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 1.34212e-16
Iteration - 60 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 4.83798e-17
Iteration - 61 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 7.13385e-17
Iteration - 62 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 7.12258e-17
Iteration - 63 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 7.35538e-17
Iteration - 64 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 7.17142e-17
Iteration - 65 : Out of 207, Impostors were recalculated for 0 points. transformationDiff : 7.45817e-17
[DEBUG] L-BFGS function value stable (terminating successfully).
[INFO ] Accuracy on initial dataset: 77.7778%
[INFO ] Accuracy on transformed dataset: 78.744%
[INFO ] Saving CSV data to 'output.csv'.
[INFO ] 
[INFO ] Execution parameters:
[INFO ]   batch_size: 50
[INFO ]   distance_file: 
[INFO ]   help: 0
[INFO ]   info: 
[INFO ]   input_file: vc2.csv
[INFO ]   k: 5
[INFO ]   labels_file: vc2_labels.txt
[INFO ]   linear_scan: 0
[INFO ]   max_iterations: 100000
[INFO ]   normalize: 0
[INFO ]   optimizer: lbfgs
[INFO ]   output_file: output.csv
[INFO ]   passes: 50
[INFO ]   print_accuracy: 1
[INFO ]   range: 1
[INFO ]   rank: 6
[INFO ]   regularization: 0.5
[INFO ]   seed: 0
[INFO ]   step_size: 0.01
[INFO ]   tolerance: 1e-07
[INFO ]   transformed_data_file: 
[INFO ]   verbose: 1
[INFO ]   version: 0
[INFO ] Program timers:
[INFO ]   computing_neighbors: 0.681866s
[INFO ]   line_search: 1.848978s
[INFO ]   lmnn_function_compute_impostors: 0.702938s
[INFO ]   lmnn_optimization: 1.887925s
[INFO ]   loading_data: 0.001036s
[INFO ]   saving_data: 0.000162s
[INFO ]   total_time: 2.003206s
[INFO ]   tree_building: 0.011074s