es-utils-4.4-release-notes

es-utils-4.4-release-notes

==================================================
Changes from 2014-02-27 00:00:00 +0000 to present.
==================================================

----------------------------------------
version 4.4 at 2016-02-27 07:15:06 +0000
----------------------------------------

  Change: 4a832f92659ebc575d2de0948dbb01b8e349138b
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 23:12:47 +0000

    Bug fixes in es-copy-index.pl

    Found some bugs around error handling as I convinced it throw errors. These
    have been fixed and it should be ready fo general use. 

  Change: eb446d391c937da9c29917db8b1cf39e2c2eada9
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 23:00:28 +0000

    Use fake_home for compiles to catch problems not apparent with my RC files. 

  Change: 764878a671d8ae548c2bbb0cdb83b0c7d28ae6b4
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 23:00:28 +0000

    Testing for index name methods.

    Added tests for expected results when parsing certain index names. This
    flushed out a bug in the handling of index names already. 

  Change: c6db63a4555205e1649f11c9226124117420626b
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 22:43:19 +0000

    Corrected es_index_bases() to match expected behavior

    Subtle bug in calculating the bases for each index was flushed out during
    creation of tests. Bases are free words, combined with '-'s maintaining
    order in the index name, but without regard for offset.

    For example: type-dcid-2016.02.26-tags has the following bases:

    type
    type-dcid
    type-dcid-tags
    dcid
    dcid-tags
    tags

    This behaviour is now correct. 

  Change: a798f5c3aa8f29dcba51964174e79ae99770802e
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 21:58:53 +0000

    es-search.pl updated to use more flexible methods

    Several underlying functions were dramatically enhanced, so es-search.pl is
    now making full use of them.

    Important changes:

    es-search.pl --bases

    This command now uses a call to es_indices(_all => 1), so all
    available index bases will be displayed. Additionally, using
    --verbose it's possible to see the age-ranges of the indexes in the
    output so calls to the --base <base> --days <days> will do what you
    expect.

    es-search.pl --base <base> --fields

    This command now uses the enhanced es_index_fields() function which
    has support for full path key names
    
    General

    Because of the enhancements to es_index_fields(), every search,
    aggregate, and display check for key names is more accurate. If you
    have been annoyed with '--top requires a valid key' errors in the
    past, this patch fixes most of those issues. 

  Change: 198070c98534a5ef868d63fdb9b57cc4120d7577
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 21:56:04 +0000

    es_index_fields(index-name) dramatically improved.

    Previous versions of the module broken down with nested fields. This change
    adds support for full path key lookups and magic around handling weirdness
    is the document structure. All keys are now accessible via their full path
    names and any unique leaf key is still available by it's unique name. 

  Change: 618afcf75d5d36002846c765bb6eecfb2e0f36c0
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 21:52:34 +0000

    es_index_bases(index-name) returns bases

    Converted es_indices() to use _cat API. Added es_index_bases(index-name) to
    return a list of base tags that the index passed matches. The logic is much
    more consistent and less prone to error.

    es_index_days_old() can now returns undef if it can't figure out an index
    age instead of -1. This is due to timezones. There are cases where an index
    can have a negative age. 

  Change: 1cf798a0033ce7d62e3e60d79bf4805762d19ffe
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 21:49:46 +0000

    Add support for _cat API with es_request()

    Elastijk does not support responses from ElasticSearch that do not pass a
    JSON decode. To allow _cat API calls through the es_request(), I am using
    Hijk directly from this module and encapsulating the _cat API responses in
    an ARRAY reference. 

  Change: 239b115a53c97fd43bbf743c5ebc8ed835f2b12c
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 21:46:56 +0000

    Fix uninitialized errors in es-copy-index.pl

    Replaced several places in the es-copy-index.pl where $OPT{to} was
    referenced with $HOST{to}, which is always defined. 

  Change: 7d36f5af7fa1a27b2fb7663c5400eac133b1d9aa
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 21:45:44 +0000

    Long overdue, disable bloom filters.

    es-daily-index-maintenance.pl now manages the the: index.codec.bloom.load
    setting and will set it to false for indexes older than 1 day. 

----------------------------------------
version 4.3 at 2016-02-27 00:50:57 +0000
----------------------------------------

  Change: fdd6b0f48cbb0fe376b99ff1b6331f63cc5970b7
  Author: Brad Lhotsky <blhotsky@craigslist.org>
  Date : 2016-02-26 16:50:57 +0000

    Fix typos in es-copy-index.pl 

  Change: 6b475f713ab9dab705d50f915bd11bf5ce86f5df
  Author: Brad Lhotsky <brad@divisionbyzero.net>
  Date : 2016-02-23 11:36:39 +0000

    Ignore generated Changes file.