Skip to content

Instantly share code, notes, and snippets.

@james1ewis

james1ewis/gist:4318175

Created December 17, 2012 13:11
Show Gist options
  • Save james1ewis/4318175 to your computer and use it in GitHub Desktop.
Save james1ewis/4318175 to your computer and use it in GitHub Desktop.
Download ZIP
Elastic Search log output showing the ConcurrentMarkSweep gc warnings when they first start happening after ~5million docs inserted via bulk api.
Raw
gistfile1.txt
[2012-12-17 12:05:59,285][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][4875][17] duration [5s], collections [1]/[5.9s], total [5s]/[1m], memory [2.7gb]->[2.1gb]/[5.9gb], all_pools {[Code Cache] [6.7mb]->[6.7mb]/[48mb]}{[Eden Space] [15.4mb]->[1.6mb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [2.7gb]->[2.1gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:07:30,357][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][4956][19] duration [5s], collections [1]/[5.1s], total [5s]/[1.2m], memory [2.6gb]->[2.1gb]/[5.9gb], all_pools {[Code Cache] [6.7mb]->[6.7mb]/[48mb]}{[Eden Space] [12.6mb]->[413.1kb]/[16.6mb]}{[Survivor Space] [1.8mb]->[0b]/[2mb]}{[CMS Old Gen] [2.6gb]->[2.1gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:09:44,979][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5075][22] duration [5.2s], collections [1]/[5.6s], total [5.2s]/[1.4m], memory [2.7gb]->[2.3gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [7.1mb]->[2.1kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [2.7gb]->[2.3gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:10:29,315][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5114][23] duration [5.2s], collections [1]/[5.4s], total [5.2s]/[1.5m], memory [2.9gb]->[2.3gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [181.5kb]->[182.4kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [2.9gb]->[2.3gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:11:12,685][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5152][24] duration [5.3s], collections [1]/[5.8s], total [5.3s]/[1.6m], memory [2.9gb]->[2.4gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [15.2kb]->[210.9kb]/[16.6mb]}{[Survivor Space] [1.9mb]->[0b]/[2mb]}{[CMS Old Gen] [2.9gb]->[2.4gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:11:53,756][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5187][25] duration [5.7s], collections [1]/[5.8s], total [5.7s]/[1.7m], memory [3gb]->[2.5gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [12.2mb]->[18.3kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3gb]->[2.5gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:12:42,721][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5230][26] duration [5.6s], collections [1]/[6.4s], total [5.6s]/[1.8m], memory [3.2gb]->[2.5gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [8.4mb]->[7.3kb]/[16.6mb]}{[Survivor Space] [411.4kb]->[0b]/[2mb]}{[CMS Old Gen] [3.2gb]->[2.5gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:13:23,307][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5265][27] duration [5.7s], collections [1]/[5.9s], total [5.7s]/[1.9m], memory [2.9gb]->[2.5gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [6.2mb]->[6.5mb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [2.9gb]->[2.5gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:14:06,909][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5303][28] duration [5.7s], collections [1]/[5.9s], total [5.7s]/[2m], memory [3.2gb]->[2.5gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [7.7mb]->[12.7kb]/[16.6mb]}{[Survivor Space] [1.9mb]->[0b]/[2mb]}{[CMS Old Gen] [3.2gb]->[2.5gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:14:44,954][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5336][29] duration [5.6s], collections [1]/[5.7s], total [5.6s]/[2.1m], memory [3.2gb]->[2.6gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [2.1kb]->[2kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.2gb]->[2.6gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:15:24,363][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5369][30] duration [6s], collections [1]/[6.9s], total [6s]/[2.2m], memory [3gb]->[2.7gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [2.3mb]->[11mb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3gb]->[2.7gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:16:06,491][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5405][31] duration [6.3s], collections [1]/[6.7s], total [6.3s]/[2.3m], memory [3.3gb]->[2.7gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [90.6kb]->[62.5kb]/[16.6mb]}{[Survivor Space] [1.2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.3gb]->[2.7gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:16:46,891][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5439][32] duration [6.2s], collections [1]/[6.8s], total [6.2s]/[2.4m], memory [3.2gb]->[2.8gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [6.3mb]->[153.2kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.2gb]->[2.8gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:17:28,789][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5475][33] duration [6.1s], collections [1]/[6.2s], total [6.1s]/[2.5m], memory [3.5gb]->[2.8gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [14.7mb]->[39kb]/[16.6mb]}{[Survivor Space] [229.3kb]->[0b]/[2mb]}{[CMS Old Gen] [3.5gb]->[2.8gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:18:08,597][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5508][34] duration [6.2s], collections [1]/[7.1s], total [6.2s]/[2.6m], memory [3.4gb]->[2.9gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [10.8mb]->[356.4kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.3gb]->[2.9gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:18:51,435][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5545][35] duration [6.3s], collections [1]/[6.5s], total [6.3s]/[2.7m], memory [3.4gb]->[2.9gb]/[5.9gb], all_pools {[Code Cache] [6.7mb]->[6.7mb]/[48mb]}{[Eden Space] [7mb]->[15.6kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.4gb]->[2.9gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:19:30,841][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5578][36] duration [6.4s], collections [1]/[6.7s], total [6.4s]/[2.8m], memory [3.5gb]->[3gb]/[5.9gb], all_pools {[Code Cache] [6.7mb]->[6.7mb]/[48mb]}{[Eden Space] [16.6mb]->[4.2kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.5gb]->[3gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:20:08,011][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5608][37] duration [6.6s], collections [1]/[7.5s], total [6.6s]/[2.9m], memory [3.4gb]->[3.1gb]/[5.9gb], all_pools {[Code Cache] [6.7mb]->[6.7mb]/[48mb]}{[Eden Space] [514kb]->[640.7kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.4gb]->[3.1gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:20:45,364][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5638][38] duration [6.8s], collections [1]/[7.7s], total [6.8s]/[3m], memory [3.6gb]->[3.2gb]/[5.9gb], all_pools {[Code Cache] [6.7mb]->[6.7mb]/[48mb]}{[Eden Space] [5.3kb]->[95.9kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.6gb]->[3.2gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:21:20,495][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5666][39] duration [6.9s], collections [1]/[7.8s], total [6.9s]/[3.1m], memory [3.5gb]->[3.2gb]/[5.9gb], all_pools {[Code Cache] [6.7mb]->[6.7mb]/[48mb]}{[Eden Space] [12.7mb]->[1.2mb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.5gb]->[3.2gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:21:58,024][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5696][40] duration [6.8s], collections [1]/[7.7s], total [6.8s]/[3.2m], memory [3.8gb]->[3.2gb]/[5.9gb], all_pools {[Code Cache] [6.7mb]->[6.7mb]/[48mb]}{[Eden Space] [6.5mb]->[1.7mb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.8gb]->[3.2gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:22:31,326][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5722][41] duration [6.8s], collections [1]/[7.8s], total [6.8s]/[3.4m], memory [3.7gb]->[3.2gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [3.6mb]->[12.4kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.7gb]->[3.2gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:23:06,902][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5751][42] duration [6.9s], collections [1]/[7.1s], total [6.9s]/[3.5m], memory [3.7gb]->[3.3gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [15.6kb]->[2.1mb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.7gb]->[3.3gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
[2012-12-17 12:23:40,223][INFO ][monitor.jvm ] [Autolycus] [gc][ConcurrentMarkSweep][5777][43] duration [7s], collections [1]/[7.7s], total [7s]/[3.6m], memory [3.6gb]->[3.4gb]/[5.9gb], all_pools {[Code Cache] [6.8mb]->[6.8mb]/[48mb]}{[Eden Space] [7.6mb]->[2.1kb]/[16.6mb]}{[Survivor Space] [2mb]->[0b]/[2mb]}{[CMS Old Gen] [3.6gb]->[3.4gb]/[5.9gb]}{[CMS Perm Gen] [37.2mb]->[37.2mb]/[168mb]}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment