Skip to content

Instantly share code, notes, and snippets.

@randomstatistic

randomstatistic/solr_garbage_analysis.txt

Last active March 22, 2016 00:00
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save randomstatistic/727ab5851ec5d7bafc4a to your computer and use it in GitHub Desktop.
Save randomstatistic/727ab5851ec5d7bafc4a to your computer and use it in GitHub Desktop.
Download ZIP
Solr Garbage Analysis
Raw
solr_garbage_analysis.txt
This was against a pretty specific index, using a very specialized query corpus, with lots of caveats. Be careful about comparisions.
Index stats: 85M docs/shard, 3 shards, 1 node.
Query stats: 142k queries. 78k use a simple facet.query, 27k do geospatial radius, 115 use CollapseQParser
CollapsingQParserPlugin:
22% of garbage by size
These were huge, perhaps a half-dozen allocations
Lines 510,512 CollapsingQParserPlugin
SolrIndexSearcher: (getDocListAndSetNC)
56% of garbage by size
Almost all of which is about 200 allocations
Line 50 of DocSetCollector
FacetComponent
14% garbage by size
Almost all due to about 70 allocations
Line 50 of DocSetCollector
DocSetCollector
Apparently almost 70% of garbage by size comes from a very small number of allocations in line 50 of DocSetCollector. (Solr 5.4)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment