ts1|pid23143|:29749|http://127.112.184.38:17741 I0527 13:43:03.176445 23799 client-internal.cc:633] Deleted table 00004002000030008000000000004006 ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:03.385 PDT [23799] ERROR: relation "test_table" does not exist at character 15 ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:03.385 PDT [23799] STATEMENT: SELECT * FROM test_table 2020-05-27 13:43:03,399 (Time-limited test) [INFO - org.yb.pgsql.BasePgSQLTest.runInvalidQuery(BasePgSQLTest.java:1059)] Expected exception org.postgresql.util.PSQLException: ERROR: relation "test_table" does not exist Position: 15 at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) at org.yb.pgsql.BasePgSQLTest.runInvalidQuery(BasePgSQLTest.java:1055) at org.yb.pgsql.TestPgAuthorization.testMultiDatabaseOwnershipDrop(TestPgAuthorization.java:2607) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) ts1|pid23143|:29749|http://127.112.184.38:17741 W0527 13:43:03.500811 23551 tablet_rpc.cc:368] Query error (yb/tserver/tablet_service.cc:1651): Failed Read(tablet: f18370aeedfa445292aebcc8aac8fdc4, num_ops: 1, num_attempts: 1, txn: 00000000-0000-0000-0000-000000000000) to tablet f18370aeedfa445292aebcc8aac8fdc4 on tablet server { uuid: 2da2a574ac5f4eeea14b2f8f25bfffe8 private: [host: "127.252.11.115" port: 15673] cloud_info: placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" after 1 attempt(s): Catalog Version Mismatch: A DDL occurred while processing this query. Try Again. m1|pid23056|:14925|http://127.60.4.107:30802 W0527 13:43:03.819705 23141 scoped_leader_shared_lock.cc:114] Long lock of catalog manager: 0.138s m1|pid23056|:14925|http://127.60.4.107:30802 @ 0x7fdd3ca6ae6e yb::master::ScopedLeaderSharedLock::Unlock() (src/yb/master/scoped_leader_shared_lock.cc:115) m1|pid23056|:14925|http://127.60.4.107:30802 @ 0x7fdd3ca5ffa8 yb::master::CatalogManagerBgTasks::Run() (src/yb/master/catalog_manager_bg_tasks.cc:162) m1|pid23056|:14925|http://127.60.4.107:30802 @ 0x7fdd3ca61933 void std::_Mem_fn_base::operator()<, void>(yb::master::CatalogManagerBgTasks*) const (gcc/5.5.0_4/include/c++/5.5.0/functional:600) m1|pid23056|:14925|http://127.60.4.107:30802 @ 0x7fdd3ca61933 void std::_Bind (yb::master::CatalogManagerBgTasks*)>::__call(tuple<>&&, std::_Index_tuple<0ul>) (gcc/5.5.0_4/include/c++/5.5.0/functional:1074) m1|pid23056|:14925|http://127.60.4.107:30802 @ 0x7fdd3ca61933 void std::_Bind (yb::master::CatalogManagerBgTasks*)>::operator()<, void>() (gcc/5.5.0_4/include/c++/5.5.0/functional:1133) m1|pid23056|:14925|http://127.60.4.107:30802 @ 0x7fdd3ca61933 std::_Function_handler (yb::master::CatalogManagerBgTasks*)> >::_M_invoke(std::_Any_data const&) (gcc/5.5.0_4/include/c++/5.5.0/functional:1871) m1|pid23056|:14925|http://127.60.4.107:30802 @ 0x7fdd329dfba5 std::function::operator()() const (gcc/5.5.0_4/include/c++/5.5.0/functional:2267) m1|pid23056|:14925|http://127.60.4.107:30802 @ 0x7fdd329dfba5 yb::Thread::SuperviseThread(void*) (src/yb/util/thread.cc:744) m1|pid23056|:14925|http://127.60.4.107:30802 @ 0x7fdd2e29e693 start_thread (/tmp/glibc-20181130-26094-cs1x60/glibc-2.23/nptl/pthread_create.c:333) m1|pid23056|:14925|http://127.60.4.107:30802 @ 0x7fdd2dfe041c (unknown) (sysdeps/unix/sysv/linux/x86_64/clone.S:109) m1|pid23056|:14925|http://127.60.4.107:30802 @ 0xffffffffffffffff ts1|pid23143|:29749|http://127.112.184.38:17741 TRAP: FailedAssertion("!(portal)", File: "../../../../../../src/postgres/src/backend/tcop/postgres.c", Line: 4012) ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:04.460 PDT [23291] LOG: server process (PID 23542) was terminated by signal 6: Aborted ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:04.460 PDT [23291] DETAIL: Failed process was running: SELECT * FROM test_table ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:04.460 PDT [23291] LOG: terminating any other active server processes ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:04.500 PDT [23964] FATAL: the database system is in recovery mode 2020-05-27 13:43:04,506 (Time-limited test) [INFO - org.yb.pgsql.BasePgSQLTest$ConnectionBuilder.connect(BasePgSQLTest.java:1458)] Postgres is in recovery mode, waiting for 500 ms. Got message: FATAL: the database system is in recovery mode ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:04.508 PDT [23291] LOG: all server processes terminated; reinitializing ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:04.604 PDT [23983] LOG: database system was interrupted; last known up at 2020-05-27 13:43:00 PDT ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:05.022 PDT [23989] FATAL: the database system is in recovery mode 2020-05-27 13:43:05,030 (Time-limited test) [INFO - org.yb.pgsql.BasePgSQLTest$ConnectionBuilder.connect(BasePgSQLTest.java:1458)] Postgres is in recovery mode, waiting for 1000 ms. Got message: FATAL: the database system is in recovery mode ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:06.033 PDT [23991] FATAL: the database system is in recovery mode 2020-05-27 13:43:06,033 (Time-limited test) [INFO - org.yb.pgsql.BasePgSQLTest$ConnectionBuilder.connect(BasePgSQLTest.java:1458)] Postgres is in recovery mode, waiting for 1500 ms. Got message: FATAL: the database system is in recovery mode ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:06.130 PDT [23983] LOG: database system was not properly shut down; automatic recovery in progress ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:06.132 PDT [23983] LOG: redo starts at 0/10001B0 ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:06.161 PDT [23983] LOG: invalid record length at 0/1000258: wanted 24, got 0 ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:06.161 PDT [23983] LOG: redo done at 0/10001E8 ts1|pid23143|:29749|http://127.112.184.38:17741 2020-05-27 13:43:06.187 PDT [23291] LOG: database system is ready to accept connections