Skip to content

Instantly share code, notes, and snippets.

@rafbgarcia

rafbgarcia/crate01.md Secret

Created May 23, 2022 12:53
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save rafbgarcia/0541ec9bd1a0c646624906be2a153864 to your computer and use it in GitHub Desktop.
Save rafbgarcia/0541ec9bd1a0c646624906be2a153864 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
crate01.md

No logs, it just crashed.

The logs below are after its reinitialization (seem to be only start up logs):

[2022-05-23T12:49:41,188][INFO ][o.e.e.NodeEnvironment    ] [cratedb01] using [1] data paths, mounts [[/data (overlay)]], net usable_space [3gb], net total_space [3.8gb], types [overlay]
[2022-05-23T12:49:41,192][INFO ][o.e.e.NodeEnvironment    ] [cratedb01] heap size [2gb], compressed ordinary object pointers [true]
[2022-05-23T12:49:41,448][INFO ][o.e.n.Node               ] [cratedb01] node name [cratedb01], node ID [onjmxXu0Q5mGvEZqBYve8A], cluster name [crate-docker-cluster]
[2022-05-23T12:49:41,467][INFO ][o.e.n.Node               ] [cratedb01] version[4.8.0], pid[1], build[e1dea64/2022-04-28T17:08:55Z], OS[Linux/5.10.104-linuxkit/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.3/17.0.3+7]
[2022-05-23T12:49:42,674][INFO ][o.e.p.PluginsService     ] [cratedb01] no modules loaded
[2022-05-23T12:49:42,681][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [cr8-copy-s3]
[2022-05-23T12:49:42,682][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [crate-azure-discovery]
[2022-05-23T12:49:42,682][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [crate-functions]
[2022-05-23T12:49:42,682][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [crate-jmx-monitoring]
[2022-05-23T12:49:42,682][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [crate-lang-js]
[2022-05-23T12:49:42,682][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [es-analysis-common]
[2022-05-23T12:49:42,683][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [es-analysis-phonetic]
[2022-05-23T12:49:42,683][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [es-repository-azure]
[2022-05-23T12:49:42,683][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [io.crate.plugin.SrvPlugin]
[2022-05-23T12:49:42,684][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [io.crate.udc.plugin.UDCPlugin]
[2022-05-23T12:49:42,684][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [org.elasticsearch.discovery.ec2.Ec2DiscoveryPlugin]
[2022-05-23T12:49:42,684][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [org.elasticsearch.plugin.repository.url.URLRepositoryPlugin]
[2022-05-23T12:49:42,684][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [org.elasticsearch.repositories.s3.S3RepositoryPlugin]
[2022-05-23T12:49:42,684][INFO ][o.e.p.PluginsService     ] [cratedb01] loaded plugin [org.elasticsearch.transport.Netty4Plugin]
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[2022-05-23T12:49:43,820][WARN ][o.e.d.c.s.Settings       ] [cratedb01] [gateway.expected_nodes] setting was deprecated in CrateDB and will be removed in a future release! See the breaking changes documentation for the next major version.
[2022-05-23T12:49:43,822][WARN ][o.e.d.c.s.Settings       ] [cratedb01] [gateway.recover_after_nodes] setting was deprecated in CrateDB and will be removed in a future release! See the breaking changes documentation for the next major version.
[2022-05-23T12:49:44,287][INFO ][o.e.d.DiscoveryModule    ] [cratedb01] using discovery type [zen] and seed hosts providers [settings]
[2022-05-23T12:49:45,770][INFO ][psql                     ] [cratedb01] PSQL SSL support is disabled.
[2022-05-23T12:49:45,993][INFO ][i.c.n.c.PipelineRegistry ] [cratedb01] HTTP SSL support is disabled.
[2022-05-23T12:49:46,089][INFO ][o.e.n.Node               ] [cratedb01] initialized
[2022-05-23T12:49:46,089][INFO ][o.e.n.Node               ] [cratedb01] starting ...
[2022-05-23T12:49:46,313][INFO ][psql                     ] [cratedb01] publish_address {172.20.0.4:5432}, bound_addresses {172.20.0.4:5432}
[2022-05-23T12:49:46,327][INFO ][o.e.h.n.Netty4HttpServerTransport] [cratedb01] publish_address {172.20.0.4:4200}, bound_addresses {172.20.0.4:4200}
[2022-05-23T12:49:46,343][INFO ][o.e.t.TransportService   ] [cratedb01] publish_address {172.20.0.4:4300}, bound_addresses {172.20.0.4:4300}
[2022-05-23T12:49:46,556][INFO ][o.e.b.BootstrapChecks    ] [cratedb01] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2022-05-23T12:49:46,559][INFO ][o.e.c.c.Coordinator      ] [cratedb01] cluster UUID [e3dUHzXjT_uButshYYm41g]
[2022-05-23T12:49:46,884][INFO ][o.e.c.s.ClusterApplierService] [cratedb01] master node changed {previous [], current [{cratedb02}{BvpxgumpQpyUDDdaVS_7Tw}{vIivVVfkSomN4JRrNFh8vg}{172.20.0.3}{172.20.0.3:4300}{http_address=172.20.0.3:4200}]}, added {{cratedb03}{4dJJb88aS767BA4ZZ43JFw}{IX0LUfdNT7iwbyVtsebnkg}{172.20.0.2}{172.20.0.2:4300}{http_address=172.20.0.2:4200},{cratedb02}{BvpxgumpQpyUDDdaVS_7Tw}{vIivVVfkSomN4JRrNFh8vg}{172.20.0.3}{172.20.0.3:4300}{http_address=172.20.0.3:4200},}, term: 71, version: 1262, reason: ApplyCommitRequest{term=71, version=1262, sourceNode={cratedb02}{BvpxgumpQpyUDDdaVS_7Tw}{vIivVVfkSomN4JRrNFh8vg}{172.20.0.3}{172.20.0.3:4300}{http_address=172.20.0.3:4200}}
[2022-05-23T12:49:46,906][INFO ][o.e.n.Node               ] [cratedb01] started
Raw
crate02.md 
[2022-05-23T12:49:36,912][INFO ][o.e.m.j.JvmGcMonitorService] [cratedb02] [gc][young][1844][44] duration [759ms], collections [1]/[1.6s], total [759ms]/[5s], memory [838.9mb]->[685.4mb]/[2gb], all_pools {[young] [177mb]->[4mb]/[0b]}{[old] [591.9mb]->[636.4mb]/[2gb]}{[survivor] [71mb]->[52mb]/[0b]}
[2022-05-23T12:49:36,922][INFO ][o.e.m.j.JvmGcMonitorService] [cratedb02] [gc][1844] overhead, spent [759ms] collecting in the last [1.6s]
[2022-05-23T12:49:37,378][INFO ][o.e.c.s.MasterService    ] [cratedb02] node-left[{cratedb01}{onjmxXu0Q5mGvEZqBYve8A}{Cm5XlwvrR0e4dvfH5H78EA}{172.20.0.4}{172.20.0.4:4300}{http_address=172.20.0.4:4200} disconnected], term: 71, version: 1258, reason: removed {{cratedb01}{onjmxXu0Q5mGvEZqBYve8A}{Cm5XlwvrR0e4dvfH5H78EA}{172.20.0.4}{172.20.0.4:4300}{http_address=172.20.0.4:4200},}
[2022-05-23T12:49:37,561][INFO ][o.e.c.s.ClusterApplierService] [cratedb02] removed {{cratedb01}{onjmxXu0Q5mGvEZqBYve8A}{Cm5XlwvrR0e4dvfH5H78EA}{172.20.0.4}{172.20.0.4:4300}{http_address=172.20.0.4:4200},}, term: 71, version: 1258, reason: Publication{term=71, version=1258}
[2022-05-23T12:49:37,576][INFO ][o.e.c.r.DelayedAllocationService] [cratedb02] scheduling reroute for delayed shards in [59.7s] (4 delayed shards)
[2022-05-23T12:49:37,585][WARN ][o.e.t.OutboundHandler    ] [cratedb02] send message failed [channel: Netty4TcpChannel{localAddress=/172.20.0.3:4300, remoteAddress=/172.20.0.4:39322}]
io.netty.channel.StacklessClosedChannelException: null
	at io.netty.channel.AbstractChannel$AbstractUnsafe.write(Object, ChannelPromise)(Unknown Source) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
[2022-05-23T12:49:37,775][WARN ][i.c.e.d.u.TransportShardUpsertAction] [cratedb02] [[followups][1]] failed to perform internal:crate:sql/data/write on replica [followups][1], node[onjmxXu0Q5mGvEZqBYve8A], [R], s[STARTED], a[id=ttmnxiA-QMOCS1F20084Aw]
org.elasticsearch.client.transport.NoNodeAvailableException: unknown node [onjmxXu0Q5mGvEZqBYve8A]
	at org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1023) [crate-server.jar:?]
	at org.elasticsearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:248) [crate-server.jar:?]
	at org.elasticsearch.action.support.RetryableAction$1.doRun(RetryableAction.java:100) [crate-server.jar:?]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [crate-server.jar:?]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
	Suppressed: org.elasticsearch.transport.NodeNotConnectedException: [cratedb01][172.20.0.4:4300] Node not connected
		at org.elasticsearch.transport.ClusterConnectionManager.getConnection(ClusterConnectionManager.java:189) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.getConnection(TransportService.java:525) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:496) ~[crate-server.jar:?]
		at org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1029) [crate-server.jar:?]
		at org.elasticsearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:248) [crate-server.jar:?]
		at org.elasticsearch.action.support.RetryableAction$1.doRun(RetryableAction.java:100) [crate-server.jar:?]
		at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [crate-server.jar:?]
		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
		at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
		at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
	Suppressed: org.elasticsearch.transport.NodeNotConnectedException: [cratedb01][172.20.0.4:4300] Node not connected
		at org.elasticsearch.transport.ClusterConnectionManager.getConnection(ClusterConnectionManager.java:189) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.getConnection(TransportService.java:525) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:496) ~[crate-server.jar:?]
		at org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1029) [crate-server.jar:?]
		at org.elasticsearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:248) [crate-server.jar:?]
		at org.elasticsearch.action.support.RetryableAction$1.doRun(RetryableAction.java:100) [crate-server.jar:?]
		at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [crate-server.jar:?]
		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
		at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
		at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
	Suppressed: org.elasticsearch.transport.NodeNotConnectedException: [cratedb01][172.20.0.4:4300] Node not connected
		at org.elasticsearch.transport.ClusterConnectionManager.getConnection(ClusterConnectionManager.java:189) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.getConnection(TransportService.java:525) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:496) ~[crate-server.jar:?]
		at org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1029) [crate-server.jar:?]
		at org.elasticsearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:248) [crate-server.jar:?]
		at org.elasticsearch.action.support.RetryableAction$1.doRun(RetryableAction.java:100) [crate-server.jar:?]
		at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [crate-server.jar:?]
		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
		at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
		at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
[2022-05-23T12:49:37,826][WARN ][o.e.c.r.a.AllocationService] [cratedb02] [followups][1] marking unavailable shards as stale: [ttmnxiA-QMOCS1F20084Aw]
[2022-05-23T12:49:38,080][WARN ][o.e.t.OutboundHandler    ] [cratedb02] send message failed [channel: Netty4TcpChannel{localAddress=/172.20.0.3:4300, remoteAddress=/172.20.0.4:39318}]
io.netty.channel.StacklessClosedChannelException: null
	at io.netty.channel.AbstractChannel$AbstractUnsafe.write(Object, ChannelPromise)(Unknown Source) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
[2022-05-23T12:49:39,071][WARN ][i.c.e.d.u.TransportShardUpsertAction] [cratedb02] [[followups][2]] failed to perform internal:crate:sql/data/write on replica [followups][2], node[onjmxXu0Q5mGvEZqBYve8A], [R], s[STARTED], a[id=J-mtHnQUQYyBWley2NcrNg]
org.elasticsearch.client.transport.NoNodeAvailableException: unknown node [onjmxXu0Q5mGvEZqBYve8A]
	at org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1023) [crate-server.jar:?]
	at org.elasticsearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:248) [crate-server.jar:?]
	at org.elasticsearch.action.support.RetryableAction$1.doRun(RetryableAction.java:100) [crate-server.jar:?]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [crate-server.jar:?]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
	Suppressed: org.elasticsearch.transport.NodeNotConnectedException: [cratedb01][172.20.0.4:4300] Node not connected
		at org.elasticsearch.transport.ClusterConnectionManager.getConnection(ClusterConnectionManager.java:189) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.getConnection(TransportService.java:525) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:496) ~[crate-server.jar:?]
		at org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1029) [crate-server.jar:?]
		at org.elasticsearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:248) [crate-server.jar:?]
		at org.elasticsearch.action.support.RetryableAction$1.doRun(RetryableAction.java:100) [crate-server.jar:?]
		at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [crate-server.jar:?]
		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
		at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
		at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
	Suppressed: org.elasticsearch.transport.NodeNotConnectedException: [cratedb01][172.20.0.4:4300] Node not connected
		at org.elasticsearch.transport.ClusterConnectionManager.getConnection(ClusterConnectionManager.java:189) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.getConnection(TransportService.java:525) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:496) ~[crate-server.jar:?]
		at org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1029) [crate-server.jar:?]
		at org.elasticsearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:248) [crate-server.jar:?]
		at org.elasticsearch.action.support.RetryableAction$1.doRun(RetryableAction.java:100) [crate-server.jar:?]
		at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [crate-server.jar:?]
		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
		at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
		at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
	Suppressed: org.elasticsearch.transport.NodeNotConnectedException: [cratedb01][172.20.0.4:4300] Node not connected
		at org.elasticsearch.transport.ClusterConnectionManager.getConnection(ClusterConnectionManager.java:189) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.getConnection(TransportService.java:525) ~[crate-server.jar:?]
		at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:496) ~[crate-server.jar:?]
		at org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1029) [crate-server.jar:?]
		at org.elasticsearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:248) [crate-server.jar:?]
		at org.elasticsearch.action.support.RetryableAction$1.doRun(RetryableAction.java:100) [crate-server.jar:?]
		at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [crate-server.jar:?]
		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
		at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
		at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
[2022-05-23T12:49:39,082][WARN ][o.e.c.r.a.AllocationService] [cratedb02] [followups][2] marking unavailable shards as stale: [J-mtHnQUQYyBWley2NcrNg]
[2022-05-23T12:49:39,142][WARN ][o.e.t.OutboundHandler    ] [cratedb02] send message failed [channel: Netty4TcpChannel{localAddress=/172.20.0.3:4300, remoteAddress=/172.20.0.4:39324}]
io.netty.channel.StacklessClosedChannelException: null
	at io.netty.channel.AbstractChannel$AbstractUnsafe.write(Object, ChannelPromise)(Unknown Source) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
[2022-05-23T12:49:45,777][WARN ][o.e.c.r.a.AllocationService] [cratedb02] [followups][5] marking unavailable shards as stale: [A-zVJqq-QVy8rwnMutjMFg]
[2022-05-23T12:49:46,774][INFO ][o.e.c.s.MasterService    ] [cratedb02] node-join[{cratedb01}{onjmxXu0Q5mGvEZqBYve8A}{T0Zs187KQNakww16MUesGA}{172.20.0.4}{172.20.0.4:4300}{http_address=172.20.0.4:4200} join existing leader], term: 71, version: 1262, reason: added {{cratedb01}{onjmxXu0Q5mGvEZqBYve8A}{T0Zs187KQNakww16MUesGA}{172.20.0.4}{172.20.0.4:4300}{http_address=172.20.0.4:4200},}
[2022-05-23T12:49:46,908][INFO ][o.e.c.s.ClusterApplierService] [cratedb02] added {{cratedb01}{onjmxXu0Q5mGvEZqBYve8A}{T0Zs187KQNakww16MUesGA}{172.20.0.4}{172.20.0.4:4300}{http_address=172.20.0.4:4200},}, term: 71, version: 1262, reason: Publication{term=71, version=1262}
[2022-05-23T12:50:17,310][INFO ][o.e.c.r.a.AllocationService] [cratedb02] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[followups][3]]]).
Raw
crate03.md 
[2022-05-23T12:49:37,264][INFO ][o.e.m.j.JvmGcMonitorService] [cratedb03] [gc][young][290][27] duration [734ms], collections [1]/[1.2s], total [734ms]/[1.9s], memory [1.2gb]->[689.9mb]/[2gb], all_pools {[young] [572mb]->[8mb]/[0b]}{[old] [602.4mb]->[636.4mb]/[2gb]}{[survivor] [67.4mb]->[63.5mb]/[0b]}
[2022-05-23T12:49:37,266][WARN ][o.e.m.j.JvmGcMonitorService] [cratedb03] [gc][290] overhead, spent [734ms] collecting in the last [1.2s]
[2022-05-23T12:49:37,503][INFO ][o.e.c.s.ClusterApplierService] [cratedb03] removed {{cratedb01}{onjmxXu0Q5mGvEZqBYve8A}{Cm5XlwvrR0e4dvfH5H78EA}{172.20.0.4}{172.20.0.4:4300}{http_address=172.20.0.4:4200},}, term: 71, version: 1258, reason: ApplyCommitRequest{term=71, version=1258, sourceNode={cratedb02}{BvpxgumpQpyUDDdaVS_7Tw}{vIivVVfkSomN4JRrNFh8vg}{172.20.0.3}{172.20.0.3:4300}{http_address=172.20.0.3:4200}}
[2022-05-23T12:49:39,169][INFO ][o.e.i.s.IndexShard       ] [cratedb03]  [followups][3]primary-replica resync completed with 1714 operations
[2022-05-23T12:49:46,780][INFO ][o.e.c.s.ClusterApplierService] [cratedb03] added {{cratedb01}{onjmxXu0Q5mGvEZqBYve8A}{T0Zs187KQNakww16MUesGA}{172.20.0.4}{172.20.0.4:4300}{http_address=172.20.0.4:4200},}, term: 71, version: 1262, reason: ApplyCommitRequest{term=71, version=1262, sourceNode={cratedb02}{BvpxgumpQpyUDDdaVS_7Tw}{vIivVVfkSomN4JRrNFh8vg}{172.20.0.3}{172.20.0.3:4300}{http_address=172.20.0.3:4200}}
Raw
test.py
from crate import client
import mysql.connector
import time
import numpy as np
mysqlconn = mysql.connector.connect(host="127.0.0.1", port=3306, user="root", password="talkbox", database="pws_dev")
mysqlcur = mysqlconn.cursor()
crateconn = client.connect([
'http://localhost:4201/',
], username='crate', password='')
cratecur = crateconn.cursor()
mysqlcur.execute("""
SELECT application_id, follow_up_number, follow_up_date, follow_up_date_string, follow_up_result, resulted_by, title_name
FROM untitled_name
LIMIT 10000000""")
batch_size = 10_000
while True:
s = time.time()
rows = mysqlcur.fetchmany(batch_size)
rowsa = tuple(np.array(rows).T.tolist())
print(f">>> MySQL: {round(time.time() - s, 2)}")
if len(rows) == 0:
break
s = time.time()
cratecur.execute("""
INSERT INTO followups (application_id, follow_up_number, follow_up_date, follow_up_date_string, follow_up_result, resulted_by, title_name)
(SELECT * FROM UNNEST(?, ?, ?, ?, ?, ?, ?))""",
rowsa)
print(f">>> CrateDB: {round(time.time() - s, 2)}")
mysqlconn.close()
crateconn.close()
Raw
test.py_logs.md 
➜  crate \time python3.9 test.py
>>> MySQL: 0.06
>>> CrateDB: 1.38
>>> MySQL: 0.07
>>> CrateDB: 0.83
>>> MySQL: 0.06
>>> CrateDB: 0.58
>>> MySQL: 0.06
>>> CrateDB: 0.51
>>> MySQL: 0.07
>>> CrateDB: 0.56
>>> MySQL: 0.05
>>> CrateDB: 0.47
>>> MySQL: 0.05
>>> CrateDB: 0.52
>>> MySQL: 0.05
>>> CrateDB: 0.45
>>> MySQL: 0.04
>>> CrateDB: 0.39
>>> MySQL: 0.05
>>> CrateDB: 0.47
>>> MySQL: 0.04
>>> CrateDB: 0.56
>>> MySQL: 0.05
>>> CrateDB: 0.42
>>> MySQL: 0.05
>>> CrateDB: 0.46
>>> MySQL: 0.06
>>> CrateDB: 0.4
>>> MySQL: 0.05
>>> CrateDB: 0.35
>>> MySQL: 0.06
>>> CrateDB: 0.37
>>> MySQL: 0.05
>>> CrateDB: 0.34
>>> MySQL: 0.05
>>> CrateDB: 0.37
>>> MySQL: 0.06
>>> CrateDB: 0.36
>>> MySQL: 0.05
>>> CrateDB: 0.38
>>> MySQL: 0.05
>>> CrateDB: 0.4
>>> MySQL: 0.05
>>> CrateDB: 0.34
>>> MySQL: 0.05
>>> CrateDB: 0.39
>>> MySQL: 0.04
>>> CrateDB: 0.31
>>> MySQL: 0.04
>>> CrateDB: 0.43
>>> MySQL: 0.05
>>> CrateDB: 0.36
>>> MySQL: 0.05
>>> CrateDB: 0.35
>>> MySQL: 0.05
>>> CrateDB: 0.35
>>> MySQL: 0.05
>>> CrateDB: 0.35
>>> MySQL: 0.06
>>> CrateDB: 0.42
>>> MySQL: 0.06
>>> CrateDB: 0.45
>>> MySQL: 0.05
>>> CrateDB: 0.37
>>> MySQL: 0.06
>>> CrateDB: 0.36
>>> MySQL: 0.05
>>> CrateDB: 0.37
>>> MySQL: 0.05
>>> CrateDB: 0.41
>>> MySQL: 0.05
>>> CrateDB: 0.4
>>> MySQL: 0.04
>>> CrateDB: 0.47
>>> MySQL: 0.05
>>> CrateDB: 0.4
>>> MySQL: 0.05
>>> CrateDB: 0.46
>>> MySQL: 0.06
>>> CrateDB: 0.6
>>> MySQL: 0.05
>>> CrateDB: 0.37
>>> MySQL: 0.04
>>> CrateDB: 0.36
>>> MySQL: 0.05
>>> CrateDB: 0.45
>>> MySQL: 0.04
>>> CrateDB: 0.34
>>> MySQL: 0.04
>>> CrateDB: 0.4
>>> MySQL: 0.05
>>> CrateDB: 0.62
>>> MySQL: 0.06
>>> CrateDB: 0.39
>>> MySQL: 0.05
>>> CrateDB: 0.34
>>> MySQL: 0.04
>>> CrateDB: 0.33
>>> MySQL: 0.04
>>> CrateDB: 0.34
>>> MySQL: 0.04
>>> CrateDB: 0.37
>>> MySQL: 0.05
>>> CrateDB: 0.41
>>> MySQL: 0.04
>>> CrateDB: 0.34
>>> MySQL: 0.05
>>> CrateDB: 0.37
>>> MySQL: 0.06
>>> CrateDB: 0.36
>>> MySQL: 0.05
>>> CrateDB: 0.43
>>> MySQL: 0.04
>>> CrateDB: 0.54
>>> MySQL: 0.05
>>> CrateDB: 0.36
>>> MySQL: 0.05
>>> CrateDB: 0.4
>>> MySQL: 0.05
>>> CrateDB: 0.4
>>> MySQL: 0.04
>>> CrateDB: 0.34
>>> MySQL: 0.04
>>> CrateDB: 0.37
>>> MySQL: 0.05
>>> CrateDB: 0.45
>>> MySQL: 0.05
>>> CrateDB: 0.37
>>> MySQL: 0.05
>>> CrateDB: 0.38
>>> MySQL: 0.05
>>> CrateDB: 0.51
>>> MySQL: 0.05
>>> CrateDB: 0.38
>>> MySQL: 0.05
>>> CrateDB: 0.44
>>> MySQL: 0.05
>>> CrateDB: 0.36
>>> MySQL: 0.05
>>> CrateDB: 0.36
>>> MySQL: 0.05
>>> CrateDB: 0.38
>>> MySQL: 0.04
Removed server http://localhost:4201 from active pool
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/local/Cellar/python@3.9/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/http/client.py", line 1377, in getresponse
    response.begin()
  File "/usr/local/Cellar/python@3.9/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/http/client.py", line 320, in begin
    version, status, reason = self._read_status()
  File "/usr/local/Cellar/python@3.9/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/http/client.py", line 289, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
http.client.RemoteDisconnected: Remote end closed connection without response

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/crate/client/http.py", line 473, in _request
    response = self.server_pool[next_server].request(
  File "/usr/local/lib/python3.9/site-packages/crate/client/http.py", line 154, in request
    return self.pool.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.9/site-packages/urllib3/packages/six.py", line 769, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/local/Cellar/python@3.9/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/http/client.py", line 1377, in getresponse
    response.begin()
  File "/usr/local/Cellar/python@3.9/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/http/client.py", line 320, in begin
    version, status, reason = self._read_status()
  File "/usr/local/Cellar/python@3.9/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/http/client.py", line 289, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/rafa/repos/crate/test.py", line 29, in <module>
    cratecur.execute("""
  File "/usr/local/lib/python3.9/site-packages/crate/client/cursor.py", line 53, in execute
    self._result = self.connection.client.sql(sql, parameters,
  File "/usr/local/lib/python3.9/site-packages/crate/client/http.py", line 396, in sql
    content = self._json_request('POST', self.path, data=data)
  File "/usr/local/lib/python3.9/site-packages/crate/client/http.py", line 522, in _json_request
    response = self._request(method, path, data=data)
  File "/usr/local/lib/python3.9/site-packages/crate/client/http.py", line 513, in _request
    self._drop_server(next_server, ex_message)
  File "/usr/local/lib/python3.9/site-packages/crate/client/http.py", line 581, in _drop_server
    raise ConnectionError(
crate.client.exceptions.ConnectionError: No more Servers available, exception from last server: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
       53.02 real         6.01 user         0.54 sys
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment