Created
January 26, 2023 23:48
-
-
Save splatch/b5ec9134cd9df19bc62f007dd17a19a1 to your computer and use it in GitHub Desktop.
Ignite OOM Crash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2023-01-26T23:43:08.711Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default'} | |
| 2023-01-26T23:43:08.712Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default'} | |
| 2023-01-26T23:43:11.879Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default1'} | |
| 2023-01-26T23:43:11.879Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default1'} | |
| 2023-01-26T23:43:14.384Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default2'} | |
| 2023-01-26T23:43:14.384Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default2'} | |
| 2023-01-26T23:43:16.869Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default3'} | |
| 2023-01-26T23:43:16.869Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default3'} | |
| 2023-01-26T23:43:19.299Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default4'} | |
| 2023-01-26T23:43:19.299Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default4'} | |
| 2023-01-26T23:43:21.864Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default5'} | |
| 2023-01-26T23:43:21.864Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default5'} | |
| 2023-01-26T23:43:24.218Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default6'} | |
| 2023-01-26T23:43:24.218Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default6'} | |
| 2023-01-26T23:43:26.566Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default7'} | |
| 2023-01-26T23:43:26.566Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default7'} | |
| 2023-01-26T23:43:28.947Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default8'} | |
| 2023-01-26T23:43:28.948Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default8'} | |
| 2023-01-26T23:43:29.634Z INFO 1 --- [ sys-#142] o.a.i.i.p.impl.PageMemoryNoStoreImpl : Allocated next memory segment [plcName=default, chunkSize=161.1 MB] | |
| 2023-01-26T23:43:31.294Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default9'} | |
| 2023-01-26T23:43:31.295Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default9'} | |
| 2023-01-26T23:43:33.739Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default10'} | |
| 2023-01-26T23:43:33.739Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default10'} | |
| 2023-01-26T23:43:36.122Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default11'} | |
| 2023-01-26T23:43:36.122Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default11'} | |
| 2023-01-26T23:43:38.459Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default12'} | |
| 2023-01-26T23:43:38.459Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default12'} | |
| 2023-01-26T23:43:40.796Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default13'} | |
| 2023-01-26T23:43:40.796Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default13'} | |
| 2023-01-26T23:43:43.176Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Registered a session with key SessionKey{location='Default14'} | |
| 2023-01-26T23:43:43.176Z INFO 1 --- [ault-executor-0] o.o.m.grpc.twin.AbstractTwinPublisher : Published an object update for the session with key SessionKey{location='Default14'} | |
| 2023-01-26T23:43:43.844Z ERROR 1 --- [ sys-#144] : Critical system error detected. Will be handled accordingly to configured handler [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data region [name=default, initSize=256.0 MiB, maxSize=409.6 MiB, persistenceEnabled=false] Try the following: | |
| ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) | |
| ^-- Enable Ignite persistence (DataRegionConfiguration.persistenceEnabled) | |
| ^-- Enable eviction or expiration policies]] | |
| org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=default, initSize=256.0 MiB, maxSize=409.6 MiB, persistenceEnabled=false] Try the following: | |
| ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) | |
| ^-- Enable Ignite persistence (DataRegionConfiguration.persistenceEnabled) | |
| ^-- Enable eviction or expiration policies | |
| at org.apache.ignite.internal.processors.cache.persistence.IgniteCacheDatabaseSharedManager.ensureFreeSpaceForInsert(IgniteCacheDatabaseSharedManager.java:1321) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:109) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.createRow(IgniteCacheOffheapManagerImpl.java:1748) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.GridCacheMapEntry$UpdateClosure.call(GridCacheMapEntry.java:5513) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.GridCacheMapEntry$UpdateClosure.call(GridCacheMapEntry.java:5450) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.invokeClosure(BPlusTree.java:4254) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.access$5700(BPlusTree.java:4148) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invokeDown(BPlusTree.java:2226) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invoke(BPlusTree.java:2116) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke0(IgniteCacheOffheapManagerImpl.java:1698) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1681) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:425) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:3980) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:3954) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.versionedValue(GridCacheMapEntry.java:3310) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.GridCacheAdapter$16$1.apply(GridCacheAdapter.java:2163) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.GridCacheAdapter$16$1.apply(GridCacheAdapter.java:2132) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.store.GridCacheStoreManagerAdapter.loadAllFromStore(GridCacheStoreManagerAdapter.java:434) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.store.GridCacheStoreManagerAdapter.loadAll(GridCacheStoreManagerAdapter.java:400) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.GridCacheAdapter$16.call(GridCacheAdapter.java:2132) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.GridCacheAdapter$16.call(GridCacheAdapter.java:2130) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.cache.GridCacheContext$3.call(GridCacheContext.java:1448) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7384) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.processors.closure.GridClosureProcessor$2.body(GridClosureProcessor.java:967) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) ~[ignite-core-2.14.0.jar:2.14.0] | |
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] | |
| at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] | |
| at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] | |
| 2023-01-26T23:43:43.846Z ERROR 1 --- [ sys-#144] o.a.i.i.p.failure.FailureProcessor : No deadlocked threads detected. | |
| 2023-01-26T23:43:43.884Z ERROR 1 --- [ sys-#144] o.a.i.i.p.failure.FailureProcessor : Thread dump at 2023/01/26 23:43:43 UTC | |
| 2023-01-26T23:43:43.891Z WARN 1 --- [ sys-#144] o.a.i.i.p.cache.CacheDiagnosticManager : Page locks dump: | |
| 2023-01-26T23:43:43.891Z ERROR 1 --- [ sys-#144] : JVM will be halted immediately due to the failure: [failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data region [name=default, initSize=256.0 MiB, maxSize=409.6 MiB, persistenceEnabled=false] Try the following: | |
| ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) | |
| ^-- Enable Ignite persistence (DataRegionConfiguration.persistenceEnabled) | |
| ^-- Enable eviction or expiration policies]] |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment