Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
es-utils-4.4-release-notes
==================================================
Changes from 2014-02-27 00:00:00 +0000 to present.
==================================================
----------------------------------------
version 4.4 at 2016-02-27 07:15:06 +0000
----------------------------------------
Change: 4a832f92659ebc575d2de0948dbb01b8e349138b
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 23:12:47 +0000
Bug fixes in es-copy-index.pl
Found some bugs around error handling as I convinced it throw errors. These
have been fixed and it should be ready fo general use.
Change: eb446d391c937da9c29917db8b1cf39e2c2eada9
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 23:00:28 +0000
Use fake_home for compiles to catch problems not apparent with my RC files.
Change: 764878a671d8ae548c2bbb0cdb83b0c7d28ae6b4
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 23:00:28 +0000
Testing for index name methods.
Added tests for expected results when parsing certain index names. This
flushed out a bug in the handling of index names already.
Change: c6db63a4555205e1649f11c9226124117420626b
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 22:43:19 +0000
Corrected es_index_bases() to match expected behavior
Subtle bug in calculating the bases for each index was flushed out during
creation of tests. Bases are free words, combined with '-'s maintaining
order in the index name, but without regard for offset.
For example: type-dcid-2016.02.26-tags has the following bases:
type
type-dcid
type-dcid-tags
dcid
dcid-tags
tags
This behaviour is now correct.
Change: a798f5c3aa8f29dcba51964174e79ae99770802e
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 21:58:53 +0000
es-search.pl updated to use more flexible methods
Several underlying functions were dramatically enhanced, so es-search.pl is
now making full use of them.
Important changes:
es-search.pl --bases
This command now uses a call to es_indices(_all => 1), so all
available index bases will be displayed. Additionally, using
--verbose it's possible to see the age-ranges of the indexes in the
output so calls to the --base <base> --days <days> will do what you
expect.
es-search.pl --base <base> --fields
This command now uses the enhanced es_index_fields() function which
has support for full path key names
General
Because of the enhancements to es_index_fields(), every search,
aggregate, and display check for key names is more accurate. If you
have been annoyed with '--top requires a valid key' errors in the
past, this patch fixes most of those issues.
Change: 198070c98534a5ef868d63fdb9b57cc4120d7577
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 21:56:04 +0000
es_index_fields(index-name) dramatically improved.
Previous versions of the module broken down with nested fields. This change
adds support for full path key lookups and magic around handling weirdness
is the document structure. All keys are now accessible via their full path
names and any unique leaf key is still available by it's unique name.
Change: 618afcf75d5d36002846c765bb6eecfb2e0f36c0
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 21:52:34 +0000
es_index_bases(index-name) returns bases
Converted es_indices() to use _cat API. Added es_index_bases(index-name) to
return a list of base tags that the index passed matches. The logic is much
more consistent and less prone to error.
es_index_days_old() can now returns undef if it can't figure out an index
age instead of -1. This is due to timezones. There are cases where an index
can have a negative age.
Change: 1cf798a0033ce7d62e3e60d79bf4805762d19ffe
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 21:49:46 +0000
Add support for _cat API with es_request()
Elastijk does not support responses from ElasticSearch that do not pass a
JSON decode. To allow _cat API calls through the es_request(), I am using
Hijk directly from this module and encapsulating the _cat API responses in
an ARRAY reference.
Change: 239b115a53c97fd43bbf743c5ebc8ed835f2b12c
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 21:46:56 +0000
Fix uninitialized errors in es-copy-index.pl
Replaced several places in the es-copy-index.pl where $OPT{to} was
referenced with $HOST{to}, which is always defined.
Change: 7d36f5af7fa1a27b2fb7663c5400eac133b1d9aa
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 21:45:44 +0000
Long overdue, disable bloom filters.
es-daily-index-maintenance.pl now manages the the: index.codec.bloom.load
setting and will set it to false for indexes older than 1 day.
----------------------------------------
version 4.3 at 2016-02-27 00:50:57 +0000
----------------------------------------
Change: fdd6b0f48cbb0fe376b99ff1b6331f63cc5970b7
Author: Brad Lhotsky <blhotsky@craigslist.org>
Date : 2016-02-26 16:50:57 +0000
Fix typos in es-copy-index.pl
Change: 6b475f713ab9dab705d50f915bd11bf5ce86f5df
Author: Brad Lhotsky <brad@divisionbyzero.net>
Date : 2016-02-23 11:36:39 +0000
Ignore generated Changes file.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.