Skip to content

Instantly share code, notes, and snippets.

@amcintyre99
Last active December 16, 2015 21:10
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save amcintyre99/5498042 to your computer and use it in GitHub Desktop.
Save amcintyre99/5498042 to your computer and use it in GitHub Desktop.
analysis of changing from:
node odbc 4.4 using db.query - does prepare/bind/exec every time - 2 days below - 4/26 and 4/29
node odbc 5.7 using prepare once - then bind/execute - 1 day below - 5/1
node odbc 5.9 using prepare once - then execute - 1 day below - 5/2
node odbc 5.10 using prepare once - then executeNonQuery - 1 day below - 5/3
each day roughly the same 3 million db2 calls in 6.5 hour day - all INSERTs
so days are comparable
top taken each day at same time
============================
Fri Apr 26 16:00:01 EDT 2013
top - 16:00:01 up 10:57, 0 users, load average: 0.51, 0.46, 0.36
Tasks: 180 total, 2 running, 178 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.9%us, 0.1%sy, 0.0%ni, 98.8%id, 0.1%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 8153488k total, 3156064k used, 4997424k free, 140576k buffers
Swap: 8364540k total, 0k used, 8364540k free, 1904672k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1520 db2inst1 20 0 5860m 1.4g 1.3g S 39 17.5 73:57.81 db2sysc
8327 andrew 20 0 957m 64m 19m S 0 0.8 3:24.41 nodejs
8178 andrew 20 0 882m 49m 19m S 0 0.6 1:23.44 nodejs
8140 andrew 20 0 881m 47m 19m S 0 0.6 1:22.21 nodejs
8161 andrew 20 0 880m 49m 19m S 0 0.6 1:21.26 nodejs
8166 andrew 20 0 881m 50m 19m S 0 0.6 1:20.34 nodejs
8151 andrew 20 0 881m 47m 19m S 0 0.6 1:18.01 nodejs
8168 andrew 20 0 881m 48m 19m S 0 0.6 1:15.87 nodejs
8131 andrew 20 0 880m 47m 19m S 0 0.6 1:15.48 nodejs
8145 andrew 20 0 879m 40m 19m S 0 0.5 1:12.18 nodejs
8172 andrew 20 0 882m 44m 19m S 0 0.6 1:10.96 nodejs
8148 andrew 20 0 881m 45m 19m S 2 0.6 1:10.07 nodejs
8132 andrew 20 0 879m 43m 19m S 0 0.5 1:09.58 nodejs
8146 andrew 20 0 881m 45m 19m S 2 0.6 1:08.99 nodejs
8176 andrew 20 0 879m 49m 19m S 2 0.6 1:07.47 nodejs
8153 andrew 20 0 880m 41m 19m S 0 0.5 1:07.37 nodejs
8133 andrew 20 0 880m 52m 19m S 0 0.7 1:06.29 nodejs
8147 andrew 20 0 880m 53m 19m S 0 0.7 1:06.06 nodejs
8136 andrew 20 0 880m 50m 19m S 0 0.6 1:05.18 nodejs
8170 andrew 20 0 879m 43m 19m S 0 0.5 1:04.42 nodejs
8138 andrew 20 0 880m 52m 19m S 2 0.7 1:03.02 nodejs
8150 andrew 20 0 880m 48m 19m S 0 0.6 1:03.01 nodejs
8135 andrew 20 0 879m 49m 19m S 0 0.6 1:02.81 nodejs
8159 andrew 20 0 879m 48m 19m S 0 0.6 1:02.22 nodejs
8174 andrew 20 0 880m 52m 19m S 0 0.7 1:01.13 nodejs
8164 andrew 20 0 881m 50m 19m S 2 0.6 0:59.62 nodejs
8156 andrew 20 0 880m 48m 19m S 0 0.6 0:54.92 nodejs
============================
Mon Apr 29 16:00:01 EDT 2013
top - 16:00:01 up 10:57, 0 users, load average: 0.53, 0.57, 0.46
Tasks: 180 total, 2 running, 178 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.9%us, 0.1%sy, 0.0%ni, 98.9%id, 0.1%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 8153492k total, 4132712k used, 4020780k free, 142184k buffers
Swap: 8364540k total, 0k used, 8364540k free, 2905516k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1468 db2inst1 20 0 6999m 2.3g 2.3g S 31 29.9 72:35.41 db2sysc
8581 andrew 20 0 955m 66m 19m S 0 0.8 3:24.78 nodejs
8420 andrew 20 0 881m 46m 19m S 0 0.6 1:28.45 nodejs
8394 andrew 20 0 882m 49m 19m S 0 0.6 1:23.05 nodejs
8416 andrew 20 0 882m 50m 19m S 0 0.6 1:22.73 nodejs
8406 andrew 20 0 882m 48m 19m S 0 0.6 1:22.39 nodejs
8398 andrew 20 0 880m 42m 19m S 0 0.5 1:17.55 nodejs
8396 andrew 20 0 881m 44m 19m S 0 0.6 1:16.93 nodejs
8432 andrew 20 0 881m 46m 19m S 0 0.6 1:16.63 nodejs
8422 andrew 20 0 881m 48m 19m S 0 0.6 1:14.81 nodejs
8385 andrew 20 0 880m 45m 19m S 0 0.6 1:13.83 nodejs
8404 andrew 20 0 879m 42m 19m S 0 0.5 1:13.71 nodejs
8407 andrew 20 0 879m 42m 19m S 2 0.5 1:13.05 nodejs
8403 andrew 20 0 880m 49m 19m S 0 0.6 1:10.21 nodejs
8405 andrew 20 0 881m 50m 19m S 0 0.6 1:10.00 nodejs
8426 andrew 20 0 880m 41m 19m S 0 0.5 1:08.63 nodejs
8387 andrew 20 0 879m 43m 19m S 2 0.5 1:08.38 nodejs
8415 andrew 20 0 879m 47m 19m S 0 0.6 1:06.28 nodejs
8386 andrew 20 0 880m 51m 19m S 2 0.6 1:04.90 nodejs
8430 andrew 20 0 881m 49m 19m S 0 0.6 1:04.33 nodejs
8428 andrew 20 0 879m 48m 19m S 2 0.6 1:02.51 nodejs
8388 andrew 20 0 878m 46m 19m S 0 0.6 1:02.22 nodejs
8390 andrew 20 0 879m 49m 19m S 0 0.6 1:01.48 nodejs
8392 andrew 20 0 880m 49m 19m S 0 0.6 1:00.60 nodejs
8409 andrew 20 0 878m 44m 19m S 2 0.6 0:58.35 nodejs
8418 andrew 20 0 878m 44m 19m S 0 0.6 0:57.81 nodejs
8424 andrew 20 0 879m 47m 19m S 0 0.6 0:56.94 nodejs
============================
Wed May 1 16:00:01 EDT 2013
top - 16:00:01 up 10:57, 0 users, load average: 0.80, 0.61, 0.45
Tasks: 180 total, 1 running, 179 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.9%us, 0.1%sy, 0.0%ni, 98.8%id, 0.1%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 8153488k total, 4770092k used, 3383396k free, 141648k buffers
Swap: 8364540k total, 0k used, 8364540k free, 2924508k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1515 db2inst1 20 0 7000m 2.3g 2.3g S 41 29.9 75:12.69 db2sysc <=== db2 cpu time unchanged - was hoping for big drop
8326 andrew 20 0 978m 85m 20m S 0 1.1 3:18.05 nodejs <=== Q node wakes up every second - cpu and VIRT unchanged
8139 andrew 20 0 1219m 88m 20m S 0 1.1 1:28.63 nodejs <=== 1st of 25 S (streaming) nodes
8158 andrew 20 0 1310m 88m 20m S 0 1.1 1:28.02 nodejs cpu roughly unchanged
8165 andrew 20 0 1618m 94m 20m S 0 1.2 1:20.61 nodejs but very noticeable is that each of
8141 andrew 20 0 1319m 86m 20m S 0 1.1 1:20.26 nodejs the 25 went up in VIRT
8176 andrew 20 0 1120m 67m 20m S 0 0.8 1:19.61 nodejs
8167 andrew 20 0 1299m 78m 20m S 2 1.0 1:18.11 nodejs
8143 andrew 20 0 1323m 78m 20m S 0 1.0 1:17.83 nodejs
8171 andrew 20 0 1071m 61m 20m S 2 0.8 1:14.32 nodejs
8154 andrew 20 0 1216m 53m 20m S 2 0.7 1:13.27 nodejs
8153 andrew 20 0 1261m 80m 20m S 0 1.0 1:12.93 nodejs
8132 andrew 20 0 1305m 66m 20m S 0 0.8 1:12.36 nodejs
8149 andrew 20 0 1244m 78m 20m S 0 1.0 1:12.12 nodejs
8151 andrew 20 0 1667m 60m 20m S 4 0.8 1:10.75 nodejs
8147 andrew 20 0 1454m 80m 20m S 0 1.0 1:08.80 nodejs
8135 andrew 20 0 1312m 67m 20m S 0 0.8 1:08.03 nodejs
8175 andrew 20 0 1311m 54m 20m S 0 0.7 1:07.13 nodejs
8156 andrew 20 0 1080m 60m 20m S 2 0.8 1:05.54 nodejs
8137 andrew 20 0 1313m 53m 20m S 0 0.7 1:05.18 nodejs
8172 andrew 20 0 1498m 73m 20m S 0 0.9 1:03.80 nodejs
8163 andrew 20 0 1188m 68m 20m S 2 0.9 1:02.28 nodejs
8131 andrew 20 0 1231m 58m 20m S 0 0.7 0:57.34 nodejs
8133 andrew 20 0 1039m 49m 20m S 0 0.6 0:56.98 nodejs
8155 andrew 20 0 1211m 73m 20m S 0 0.9 0:56.94 nodejs
8169 andrew 20 0 1301m 66m 20m S 0 0.8 0:56.30 nodejs
8130 andrew 20 0 1204m 48m 20m S 0 0.6 0:50.40 nodejs
============================
Thu May 2 16:00:01 EDT 2013
top - 16:00:01 up 7:19, 0 users, load average: 0.65, 0.48, 0.39
Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie
Cpu(s): 1.3%us, 0.2%sy, 0.0%ni, 98.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 8153488k total, 4469224k used, 3684264k free, 82556k buffers
Swap: 8364540k total, 0k used, 8364540k free, 2791492k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1466 db2inst1 20 0 7002m 2.4g 2.3g S 26 30.3 74:29.34 db2sysc <=== db2 cpu time unchanged
8127 andrew 20 0 995m 99m 20m S 0 1.2 2:38.77 nodejs <=== Q had unrelated glitch earlier and had to be restarted
so not comparable
3308 andrew 20 0 1174m 68m 20m S 2 0.9 1:23.05 nodejs <=== 1st of 25 S (streaming) nodes
3328 andrew 20 0 1299m 66m 20m S 0 0.8 1:20.85 nodejs cpu roughly unchanged
3346 andrew 20 0 1339m 63m 20m S 0 0.8 1:19.02 nodejs VIRT looks about same, maybe a little lower overall
3334 andrew 20 0 1268m 69m 20m S 2 0.9 1:18.68 nodejs
3340 andrew 20 0 1223m 74m 20m S 0 0.9 1:17.32 nodejs
3312 andrew 20 0 1203m 59m 20m S 0 0.7 1:15.97 nodejs
3325 andrew 20 0 1232m 74m 20m S 0 0.9 1:15.37 nodejs
3336 andrew 20 0 1238m 74m 20m S 0 0.9 1:14.51 nodejs
3344 andrew 20 0 1229m 82m 20m S 0 1.0 1:14.31 nodejs
3301 andrew 20 0 1290m 64m 20m S 0 0.8 1:13.19 nodejs
3323 andrew 20 0 1098m 71m 20m S 0 0.9 1:12.10 nodejs
3315 andrew 20 0 1284m 79m 20m S 0 1.0 1:11.91 nodejs
3318 andrew 20 0 1278m 62m 20m S 0 0.8 1:10.24 nodejs
3313 andrew 20 0 1283m 72m 20m S 0 0.9 1:09.88 nodejs
3310 andrew 20 0 1283m 69m 20m S 0 0.9 1:08.77 nodejs
3306 andrew 20 0 1281m 70m 20m S 0 0.9 1:06.53 nodejs
3327 andrew 20 0 1080m 55m 20m S 0 0.7 1:03.17 nodejs
3342 andrew 20 0 1691m 67m 20m S 0 0.9 1:01.98 nodejs
3332 andrew 20 0 1072m 64m 20m S 0 0.8 1:01.45 nodejs
3304 andrew 20 0 1162m 54m 20m S 0 0.7 1:00.18 nodejs
3303 andrew 20 0 1079m 52m 20m S 0 0.7 1:00.17 nodejs
3326 andrew 20 0 1086m 52m 20m S 0 0.7 0:59.11 nodejs
3300 andrew 20 0 1168m 58m 20m S 0 0.7 0:56.88 nodejs
3338 andrew 20 0 1280m 55m 20m S 0 0.7 0:54.97 nodejs
3299 andrew 20 0 1134m 53m 20m S 0 0.7 0:49.83 nodejs
============================
Fri May 3 16:00:01 EDT 2013
top - 16:00:01 up 10:57, 0 users, load average: 0.48, 0.52, 0.42
Tasks: 181 total, 2 running, 179 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.8%us, 0.1%sy, 0.0%ni, 98.9%id, 0.1%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 8153492k total, 4112540k used, 4040952k free, 143748k buffers
Swap: 8364540k total, 0k used, 8364540k free, 2932676k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1461 db2inst1 20 0 6999m 2.3g 2.3g S 28 29.9 74:52.61 db2sysc <=== db2 cpu still unchanged
10622 andrew 20 0 956m 69m 20m S 0 0.9 3:00.00 nodejs <=== Q still not comparable today (had to restart again)
8428 andrew 20 0 878m 48m 20m S 0 0.6 1:24.55 nodejs <=== 1st of 25 S (streaming) nodes
8452 andrew 20 0 879m 48m 20m S 0 0.6 1:21.72 nodejs
8448 andrew 20 0 878m 43m 20m S 0 0.6 1:17.96 nodejs cpu a little lower - maybe 3% (from spreadsheet)
8464 andrew 20 0 879m 46m 20m S 2 0.6 1:16.97 nodejs
8436 andrew 20 0 879m 47m 20m S 0 0.6 1:15.93 nodejs
8439 andrew 20 0 879m 45m 20m S 2 0.6 1:14.02 nodejs but VIRT back to normal !!!
8419 andrew 20 0 878m 43m 20m S 0 0.5 1:13.29 nodejs
8454 andrew 20 0 878m 43m 20m S 2 0.6 1:13.08 nodejs
8429 andrew 20 0 878m 42m 20m S 0 0.5 1:12.00 nodejs
8440 andrew 20 0 878m 43m 20m S 0 0.5 1:11.59 nodejs
8430 andrew 20 0 879m 44m 20m S 0 0.6 1:08.23 nodejs
8432 andrew 20 0 875m 37m 20m S 0 0.5 1:07.83 nodejs
8460 andrew 20 0 876m 39m 20m S 2 0.5 1:06.07 nodejs
8458 andrew 20 0 879m 44m 20m S 2 0.6 1:04.49 nodejs
8424 andrew 20 0 879m 51m 20m S 0 0.6 1:03.10 nodejs
8437 andrew 20 0 877m 38m 20m S 0 0.5 1:01.10 nodejs
8456 andrew 20 0 878m 47m 20m S 0 0.6 1:00.26 nodejs
8462 andrew 20 0 879m 41m 20m S 0 0.5 1:00.10 nodejs
8444 andrew 20 0 879m 50m 20m S 0 0.6 0:57.86 nodejs
8422 andrew 20 0 877m 47m 20m S 0 0.6 0:57.85 nodejs
8450 andrew 20 0 878m 49m 20m S 0 0.6 0:57.47 nodejs
8441 andrew 20 0 877m 43m 20m S 0 0.5 0:55.77 nodejs
8418 andrew 20 0 877m 44m 20m S 0 0.6 0:53.53 nodejs
8421 andrew 20 0 878m 45m 20m S 0 0.6 0:52.91 nodejs
8417 andrew 20 0 878m 43m 20m S 0 0.5 0:45.32 nodejs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment