Version 0.9.1
We are simplifying the Long-Term Storage design and laying foundation for supporting more external storage adapters and more exciting features in future.
We continue improving the new storage layout and in this release we have fixed critical issues (like 5853,5456 etc.) as well as added important improvements ( like 5698, 5460 etc.).
For more details, please refer to PDP-34 SLTS.
- Issue 5698: SLTS - SystemJournal should create new snapshots periodically (#5904) (#5962)
- Issue 5788: (SLTS) Remove ACL operations from ExtendedS3ChunkStorage (#5790)
- Issue 5460: (SLTS) Add read index virtual block entries to metadata. (#5461)
- Issue 4967: (SLTS) No need to check last chunk length for claimOwnership for no append mode. (#5663)
- Issue 5475: Eliminate unnecessary pessimistic checks. (#5662)
- Issue 4967: (SLTS) Add createWithContent overload that creates object and writes to it in a single call. (#5455)
- Issue 5458: (SLTS) For read operation, read all chunks in parallel. (#5459)
- Issue 5535: (SegmentStore) Refactoring ExtendedS3 Test Mocks (#5537)
- Issue 5861: (SLTS) Make metadata buffer size and metadata cache size configurable. (#5862)
- Issue 5902: SLTS - Metrics Improvements and minor perf improvements (#5903)
- Issue 6041: Change default value of storage.metadata.rollover.size.bytes.max to 128MB (#6058) (#6074)
- Issue 5737: (SLTS) Improve metrics (#5746)
- Issue 5808: SLTS - Fix Preconditions checks to include enough information in message. (#5809)
- Issue 5963: SLTS - writeSnapshotInfo should not block in case of cache throttle. #5964
- Issue 5866: (SLTS) ReadIndexCache stats not reported. (#5867)
- Issue 5853: SLTS - BaseMetadataStore.get does not return deep copy when loading from store. #5858
- Issue 5798: (SLTS) Fix close in GarbageCollector, ExtendedS3ChunkStorage and HDFSChunkStorage. (#5800)
- Issue 5772: (SLTS) - BaseMetadataStore does not evict entries from buffer. (#5773)
- Issue 5673: (SLTS) Fix wrong GC config (#5674)
- Issue 5570: (SLTS) AsyncBaseChunkStorage latency should not include time spent in waiting to be executed. (#5661)
- Issue 5664: SLTS - fix possible thread visibility issues.. (#5665)
- Issue 5456: (SLTS) - Handle possible failure during deletion of metadata keys can cause version mismatch in next attempt (#5457)
- Issue 5597: ExtendedS3ChunkStorage and ExtendedS3Storage should close S3Client. (#5598)
- Issue 5606: BoundedInputStream::markSupported() should always return false.. (#5615)
- Issue 5518: (SLTS) Fix Integer overflow. (#5520)
As of 0.9, SLTS is released as Experimental. While fully supported, we will continue to make improvements over the upcoming releases and expect to graduate them out of Beta in a future release.
- Issue 5736: Ensure segment writers handles a race between SegmentIsSealed and reconnection to Segmentstore #5735
- Issue 4964: Prevent a busy loop while waiting for the segments to be updated #4965
- Issue 5933: Checkpoint should not be empty #5943
- Issue 5907: (SegmentStore) Enabling rollover and compaction for container metadata table segment. #5908
- Issue 5999: (SegmentStore) Increasing priority of WriterTableProcessor indexer operations #6000
- Issue 5994: (SegmentStore) Auto-deleting LTS segments if marked as deleted in metadata #5995
- Issue 5840: (SegmentStore) Fixed a deadlock in SegmentKeyCache.
- Issue 5850: (SegmentStore) Fixed a bug in WriterTableProcessor where it would attempt to flush to a deleted segment.
- Issue 5581: (SegmentStore) Disabling non-essential cache inserts if cache utilization is high
- Issue 5789: (SegmentStore) Improving stability during Segment Container Recoveries
- Issue 5810: (SegmentStore) Fixed a StorageWriter bug that could lead to data loss
- Issue 5771: (SegmentStore) Reducing the amount of heap memory used when doing Table Segment Reads.
- Issue 6021: OperationProcessor queue may be left closed while the container is in RUNNING state #6085
- Issue 6036: Potential ConcurrentModificationException working with Segment attributes #6039
- Issue 6045: Storage - StorageReadManager does not correctly handle failures in Storage::openRead #6048
- Issue 6030: (SegmentStore) Ignoring missing ledgers that were previously marked as Empty. #6031
- Issue 5622: Bug fix - Enforce max limit for retention correctly and handle overlaps with min bound optimally (#5623) (#5870)
- Issue 5693: Code for migration of RGs created prior to 0.9 to 0.9+ #5720
- Issue 5802: Controller fails with OOM on aggressive scaling and transactions. #5827
- Issue 5393: Logging improvements for Controller #5613
- Issue 2887: AutoScale stream if configuration changes the minNumberOfSegments #6018