Skip to content

Instantly share code, notes, and snippets.

View supercoolgreatcoder's full-sized avatar

Greatest Coder supercoolgreatcoder

View GitHub Profile
@supercoolgreatcoder
supercoolgreatcoder / gist:764ca0f196bee8a28b629e9e3c56f945
Created May 28, 2019 18:02
/tmp/hnswlib/build$ ./main
Loading GT:
Loading queries:
Building index:
=================================================================
==17683==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x607000017054 at pc 0x564fd833c248 bp 0x7f603515ea10 sp 0x7f603515ea00
READ of size 4 at 0x607000017054 thread T6
#0 0x564fd833c247 in hnswlib::HierarchicalNSW<int>::searchBaseLayer(unsigned int, void*, int) (/tmp/hnswlib/build/main+0x24247)
#1 0x564fd8349749 in hnswlib::HierarchicalNSW<int>::addPoint(void*, unsigned long, int) (/tmp/hnswlib/build/main+0x31749)
#2 0x564fd832286f in sift_test1B() [clone ._omp_fn.0] (/tmp/hnswlib/build/main+0xa86f)
@supercoolgreatcoder
supercoolgreatcoder / gist:11b5deccd1f500bd19c84cdf11f2c2a9
Created May 28, 2019 18:01
cmake_minimum_required (VERSION 2.6)
project (hnsw_lib)
include_directories("${PROJECT_BINARY_DIR}")
set(SOURCE_EXE main.cpp)
set(SOURCE_LIB sift_1b.cpp)
@supercoolgreatcoder
supercoolgreatcoder / superpoint_coco_0
Created May 25, 2019 01:51
2019-05-23 17:11:30.293452: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node superpoint/train_tower0/strided_slice_16. Error: ValidateStridedSliceOp returned partial shapes [3,?,?] and [3,?,?,1]
2019-05-23 17:11:30.625785: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node superpoint/train_tower0/strided_slice_2. Error: ValidateStridedSliceOp returned partial shapes [3,?,?] and [3,?,?,1]
2019-05-23 17:11:30.625875: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node superpoint/train_tower0/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [3,?,?] and [3,?,?,1]
2019-05-23 17:11:30.625923: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimize
@supercoolgreatcoder
supercoolgreatcoder / magicpoint_coco_1
Created May 25, 2019 01:51
[05/23/2019 04:20:40 INFO] Start training
2019-05-23 04:20:44.363450: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node magicpoint/train_tower0/strided_slice_2. Error: ValidateStridedSliceOp returned partial shapes [32,?,?] and [32,?,?,1]
2019-05-23 04:20:44.363545: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node magicpoint/train_tower0/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [32,?,?] and [32,?,?,1]
2019-05-23 04:20:44.523021: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node magicpoint/train_tower0/strided_slice_2. Error: ValidateStridedSliceOp returned partial shapes [32,?,?] and [32,?,?,1]
2019-05-23 04:20:44.523110: W ./tensorflow/core/grappler/optimizers/grap
@supercoolgreatcoder
supercoolgreatcoder / magicpoint_coco_0
Created May 25, 2019 01:50
[05/22/2019 15:57:31 INFO] Start training
2019-05-22 15:57:35.117456: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node magicpoint/train_tower0/strided_slice_2. Error: ValidateStridedSliceOp returned partial shapes [32,?,?] and [32,?,?,1]
2019-05-22 15:57:35.117571: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node magicpoint/train_tower0/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [32,?,?] and [32,?,?,1]
2019-05-22 15:57:35.263818: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node magicpoint/train_tower0/strided_slice_2. Error: ValidateStridedSliceOp returned partial shapes [32,?,?] and [32,?,?,1]
2019-05-22 15:57:35.263906: W ./tensorflow/core/grappler/optimizers/grap
@supercoolgreatcoder
supercoolgreatcoder / magicpoint_synth
Created May 25, 2019 01:48
[05/21/2019 13:23:18 INFO] Start training
2019-05-21 13:23:19.384973: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node magicpoint/train_tower0/strided_slice_2. Error: ValidateStridedSliceOp returned partial shapes [64,?,?] and [64,?,?,1]
2019-05-21 13:23:19.385055: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node magicpoint/train_tower0/strided_slice. Error: ValidateStridedSliceOp returned partial shapes [64,?,?] and [64,?,?,1]
2019-05-21 13:23:19.553195: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node magicpoint/train_tower0/strided_slice_2. Error: ValidateStridedSliceOp returned partial shapes [64,?,?] and [64,?,?,1]
2019-05-21 13:23:19.553285: W ./tensorflow/core/grappler/optimizers/grap
@supercoolgreatcoder
supercoolgreatcoder / superpoint_coco_from_magicpoint_synth
Created May 11, 2019 21:04
[05/09/2019 21:51:16 INFO] Running command TRAIN
[05/09/2019 21:51:16 INFO] Number of GPUs detected: 1
/home/hadkevich/dev/mpcode/buck-out/gen/superpoint/experiment#link-tree/tensorflow/contrib/cudnn_rnn/python/ops/cudnn_rnn_ops.py:109: DeprecationWarning: invalid escape sequence \s
"""
/home/hadkevich/dev/mpcode/buck-out/gen/superpoint/experiment#link-tree/tensorflow/python/util/tf_inspect.py:75: DeprecationWarning: inspect.getargspec() is deprecated, use inspect.signature() or inspect.getfullargspec()
return _inspect.getargspec(target)
/home/hadkevich/dev/mpcode/buck-out/gen/superpoint/experiment#link-tree/tensorflow/contrib/kernel_methods/python/losses.py:70: DeprecationWarning: invalid escape sequence \
"""
/home/hadkevich/dev/mpcode/buck-out/gen/superpoint/experiment#link-tree/tensorflow/contrib/optimizer_v2/adam.py:90: DeprecationWarning: invalid escape sequence \s
"""
@supercoolgreatcoder
supercoolgreatcoder / superpoint_coco
Created May 11, 2019 21:03
[05/08/2019 00:00:47 INFO] Running command TRAIN
[05/08/2019 00:00:47 INFO] Number of GPUs detected: 1
/home/hadkevich/dev/mpcode/buck-out/gen/superpoint/experiment#link-tree/tensorflow/python/util/tf_inspect.py:75: DeprecationWarning: inspect.getargspec() is deprecated, use inspect.signature() or inspect.getfullargspec()
return _inspect.getargspec(target)
2019-05-08 00:01:10.469880: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2
2019-05-08 00:01:10.747003: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:897] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2019-05-08 00:01:10.748162: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1405] Found device 0 with properties:
name: GeForce GTX 1080 Ti major: 6 minor: 1 memoryClockRate(GHz): 1.6705
pciBusID: 0000:03:00.0
totalMemory: 10.92GiB freeMemory: 10.72GiB
@supercoolgreatcoder
supercoolgreatcoder / magicpoint_coco
Created May 11, 2019 21:02
[05/05/2019 10:46:09 INFO] Running command TRAIN
[05/05/2019 10:46:09 INFO] Number of GPUs detected: 1
2019-05-05 10:46:28.981516: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2
2019-05-05 10:46:29.318355: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:897] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2019-05-05 10:46:29.319069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1405] Found device 0 with properties:
name: GeForce GTX 1080 Ti major: 6 minor: 1 memoryClockRate(GHz): 1.6705
pciBusID: 0000:03:00.0
totalMemory: 10.92GiB freeMemory: 10.72GiB
2019-05-05 10:46:29.319093: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2019-05-05 10:46:29.640886: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
@supercoolgreatcoder
supercoolgreatcoder / magicpoint_synth
Created May 11, 2019 21:01
2018-12-21 19:38:48.457668: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-12-21 19:38:48.457719: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-12-21 19:38:48.457728: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] 0
2018-12-21 19:38:48.457734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0: N
2018-12-21 19:38:48.457878: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10410 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080 Ti, pci bus id: 0000:03:00.0, compute capability: 6.1)
[12/21/2018 19:38:54 INFO] Start training
[12/21/2018 19:39:44 INFO] Iter 0: loss 4.6639, precision 0.0006, recall 0.0562
[12/21/2018 19:49:00 INFO] Iter 1000: loss 1.4334, precision 0.0027, recall 0.2551
[12/21/2018 19:57:41 INFO] Iter 2000: loss 0.5045, precision 0.0033, recall 0.3159
[