Skip to content

Instantly share code, notes, and snippets.

@konklone
Created June 14, 2011 19:22
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save konklone/1025642 to your computer and use it in GitHub Desktop.
Save konklone/1025642 to your computer and use it in GitHub Desktop.
ElasticSearch running out of control
# Running normally, each request made generates one or two lines here
[2011-06-14 19:11:05,753][DEBUG][monitor.jvm] [Protector] [gc][ParNew][11] took [18ms]/[252ms], reclaimed [23.1mb], leaving [57.7mb] used, max [1.2gb]
[2011-06-14 19:11:06,753][DEBUG][monitor.jvm] [Protector] [gc][ParNew][14] took [2ms]/[340ms], reclaimed [28.9mb], leaving [60.3mb] used, max [1.2gb]
[2011-06-14 19:11:21,759][DEBUG][monitor.jvm] [Protector] [gc][ParNew][17] took [3ms]/[355ms], reclaimed [27.2mb], leaving [63.6mb] used, max [1.2gb]
[2011-06-14 19:11:31,762][DEBUG][monitor.jvm] [Protector] [gc][ParNew][19] took [17ms]/[374ms], reclaimed [26.4mb], leaving [63.7mb] used, max [1.2gb]
[2011-06-14 19:11:32,763][DEBUG][monitor.jvm] [Protector] [gc][ParNew][21] took [1ms]/[384ms], reclaimed [28.9mb], leaving [63.2mb] used, max [1.2gb]
[2011-06-14 19:11:36,765][DEBUG][monitor.jvm] [Protector] [gc][ParNew][25] took [4ms]/[404ms], reclaimed [27.8mb], leaving [66.3mb] used, max [1.2gb]
[2011-06-14 19:11:40,767][DEBUG][monitor.jvm] [Protector] [gc][ParNew][29] took [4ms]/[440ms], reclaimed [27.8mb], leaving [68.3mb] used, max [1.2gb]
[2011-06-14 19:11:49,771][DEBUG][monitor.jvm] [Protector] [gc][ParNew][32] took [28ms]/[561ms], reclaimed [22.6mb], leaving [71.7mb] used, max [1.2gb]
[2011-06-14 19:11:50,772][DEBUG][monitor.jvm] [Protector] [gc][ParNew][33] took [3ms]/[564ms], reclaimed [28.9mb], leaving [69.8mb] used, max [1.2gb]
[2011-06-14 19:11:51,774][DEBUG][monitor.jvm] [Protector] [gc][ParNew][37] took [6ms]/[587ms], reclaimed [27.4mb], leaving [72.3mb] used, max [1.2gb]
[2011-06-14 19:11:53,776][DEBUG][monitor.jvm] [Protector] [gc][ParNew][41] took [3ms]/[603ms], reclaimed [25.5mb], leaving [72.5mb] used, max [1.2gb]
# These all start appearing continuously after the same query gets run, and CPU starts spinning out of control
[2011-06-14 19:12:02,779][DEBUG][monitor.jvm] [Protector] [gc][ParNew][45] took [4ms]/[686ms], reclaimed [26.8mb], leaving [74.2mb] used, max [1.2gb]
[2011-06-14 19:12:08,782][DEBUG][monitor.jvm] [Protector] [gc][ParNew][47] took [131ms]/[821ms], reclaimed [10.7mb], leaving [92.9mb] used, max [1.2gb]
[2011-06-14 19:12:09,782][DEBUG][monitor.jvm] [Protector] [gc][ParNew][51] took [40ms]/[1.4s], reclaimed [17.6mb], leaving [187.3mb] used, max [1.2gb]
[2011-06-14 19:12:10,783][DEBUG][monitor.jvm] [Protector] [gc][ParNew][57] took [11ms]/[1.6s], reclaimed [24.3mb], leaving [205.1mb] used, max [1.2gb]
[2011-06-14 19:12:11,958][DEBUG][monitor.jvm] [Protector] [gc][ParNew][64] took [250ms]/[2.5s], reclaimed [-10168b], leaving [359.8mb] used, max [1.2gb]
[2011-06-14 19:12:12,968][DEBUG][monitor.jvm] [Protector] [gc][ParNew][68] took [190ms]/[3.3s], reclaimed [6kb], leaving [467.9mb] used, max [1.2gb]
[2011-06-14 19:12:13,969][DEBUG][monitor.jvm] [Protector] [gc][ParNew][72] took [90ms]/[4s], reclaimed [8.3mb], leaving [559.6mb] used, max [1.2gb]
[2011-06-14 19:12:15,198][DEBUG][monitor.jvm] [Protector] [gc][ParNew][77] took [189ms]/[4.9s], reclaimed [4.9kb], leaving [685.7mb] used, max [1.2gb]
[2011-06-14 19:12:16,228][DEBUG][monitor.jvm] [Protector] [gc][ParNew][81] took [22ms]/[5.5s], reclaimed [23mb], leaving [748.8mb] used, max [1.2gb]
[2011-06-14 19:12:17,229][DEBUG][monitor.jvm] [Protector] [gc][ParNew][88] took [17ms]/[5.6s], reclaimed [23.7mb], leaving [630mb] used, max [1.2gb]
[2011-06-14 19:12:18,312][DEBUG][monitor.jvm] [Protector] [gc][ParNew][98] took [129ms]/[6.1s], reclaimed [10.2mb], leaving [753.1mb] used, max [1.2gb]
[2011-06-14 19:12:19,425][DEBUG][monitor.jvm] [Protector] [gc][ParNew][103] took [58ms]/[6.6s], reclaimed [3.5mb], leaving [850mb] used, max [1.2gb]
[2011-06-14 19:12:20,428][DEBUG][monitor.jvm] [Protector] [gc][ParNew][107] took [252ms]/[7.2s], reclaimed [3.9mb], leaving [941.3mb] used, max [1.2gb]
[2011-06-14 19:12:25,715][DEBUG][monitor.jvm] [Protector] [gc][ParNew][111] took [0s]/[7.9s], reclaimed [0b], leaving [1gb] used, max [1.2gb]
[2011-06-14 19:12:26,948][DEBUG][monitor.jvm] [Protector] [gc][ParNew][117] took [22ms]/[8.3s], reclaimed [28.7mb], leaving [884.5mb] used, max [1.2gb]
[2011-06-14 19:12:28,038][DEBUG][monitor.jvm] [Protector] [gc][ParNew][122] took [101ms]/[9s], reclaimed [9.6mb], leaving [1011.2mb] used, max [1.2gb]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment