aag-cluster-log

0000243c.0000244c::2021/10/23-02:31:31.150 INFO  [RES] Network Name <mydb4_mydb4>: AccountAD: CheckIfPasswordIsInSync for mydb4returned 0
0000243c.000008ac::2021/10/23-02:31:31.169 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: CheckIfPasswordIsInSync for mydb3 returned 0
0000243c.000008ac::2021/10/23-02:31:31.272 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000243c.000008ac::2021/10/23-02:31:32.136 INFO  [RES] Network Name <mydb2_mydb2>: AccountAD: CheckIfPasswordIsInSync for mydb2 returned 0
0000023c.00001dc4::2021/10/23-02:32:24.640 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001dc4::2021/10/23-02:33:24.654 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000027b4::2021/10/23-02:34:24.682 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000225c::2021/10/23-02:34:28.667 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.0000225c::2021/10/23-02:34:28.667 INFO  [GEM] Node 1: ---- 0 Total Messages
000010a8.0000225c::2021/10/23-02:34:29.093 WARN  Unhandled exception on the thread 8796, exception The requested operation is not supported.
0000023c.000027b4::2021/10/23-02:35:24.682 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001dc4::2021/10/23-02:36:24.698 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001d64::2021/10/23-02:37:24.711 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001dc4::2021/10/23-02:38:24.731 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001d64::2021/10/23-02:39:24.753 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000010d8::2021/10/23-02:39:29.127 WARN  Unhandled exception on the thread 4312, exception The requested operation is not supported.
0000023c.00002a10::2021/10/23-02:40:24.781 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002a10::2021/10/23-02:41:24.816 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001dc4::2021/10/23-02:42:24.835 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001dc4::2021/10/23-02:43:24.847 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001dc4::2021/10/23-02:44:24.887 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000010d8::2021/10/23-02:44:29.147 WARN  Unhandled exception on the thread 4312, exception The requested operation is not supported.
0000023c.00000b48::2021/10/23-02:45:24.874 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001dc4::2021/10/23-02:46:24.896 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000246c::2021/10/23-02:47:24.914 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001dc4::2021/10/23-02:48:24.950 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000016bc::2021/10/23-02:49:24.949 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000010d8::2021/10/23-02:49:29.176 WARN  Unhandled exception on the thread 4312, exception The requested operation is not supported.
0000023c.00001ae0::2021/10/23-02:50:24.978 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000016bc::2021/10/23-02:51:24.986 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000016bc::2021/10/23-02:52:25.010 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000016bc::2021/10/23-02:53:25.012 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001fc0::2021/10/23-02:54:25.033 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002204::2021/10/23-02:54:29.212 WARN  Unhandled exception on the thread 8708, exception The requested operation is not supported.
0000023c.000016bc::2021/10/23-02:55:25.040 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ae0::2021/10/23-02:56:25.074 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001320::2021/10/23-02:57:25.071 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001320::2021/10/23-02:58:25.096 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002818::2021/10/23-02:59:25.105 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000009c::2021/10/23-02:59:29.228 WARN  Unhandled exception on the thread 156, exception The requested operation is not supported.
0000023c.00002818::2021/10/23-03:00:25.128 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002818::2021/10/23-03:01:25.143 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001320::2021/10/23-03:02:25.178 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000f7c::2021/10/23-03:03:25.171 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000f7c::2021/10/23-03:04:25.204 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002204::2021/10/23-03:04:29.258 WARN  Unhandled exception on the thread 8708, exception The requested operation is not supported.
0000023c.00002b74::2021/10/23-03:05:25.204 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b74::2021/10/23-03:06:25.213 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b74::2021/10/23-03:07:25.225 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002818::2021/10/23-03:08:25.257 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000000d4::2021/10/23-03:09:25.252 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002204::2021/10/23-03:09:29.278 WARN  Unhandled exception on the thread 8708, exception The requested operation is not supported.
0000023c.0000283c::2021/10/23-03:10:25.258 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000000d4::2021/10/23-03:11:25.274 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002648::2021/10/23-03:12:25.309 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000283c::2021/10/23-03:13:25.311 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000283c::2021/10/23-03:14:25.343 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000009c::2021/10/23-03:14:29.533 WARN  Unhandled exception on the thread 156, exception The requested operation is not supported.
0000023c.0000283c::2021/10/23-03:15:25.346 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000016cc::2021/10/23-03:16:25.363 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000283c::2021/10/23-03:17:25.361 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000016cc::2021/10/23-03:18:25.392 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000016cc::2021/10/23-03:19:25.401 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000009c::2021/10/23-03:19:29.330 WARN  Unhandled exception on the thread 156, exception The requested operation is not supported.
0000023c.0000283c::2021/10/23-03:20:25.430 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001350::2021/10/23-03:21:25.439 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000283c::2021/10/23-03:22:25.470 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000283c::2021/10/23-03:23:25.466 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000283c::2021/10/23-03:24:25.501 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000009c::2021/10/23-03:24:29.350 WARN  Unhandled exception on the thread 156, exception The requested operation is not supported.
0000023c.00002048::2021/10/23-03:25:25.505 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000283c::2021/10/23-03:26:25.519 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000283c::2021/10/23-03:27:25.517 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008e8::2021/10/23-03:28:25.532 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000024a4::2021/10/23-03:29:25.539 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001be0::2021/10/23-03:29:29.377 WARN  Unhandled exception on the thread 7136, exception The requested operation is not supported.
0000023c.000024a4::2021/10/23-03:30:25.545 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008e8::2021/10/23-03:31:25.562 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.00000624::2021/10/23-03:31:31.462 INFO  [RES] Network Name <mydb4_mydb4>: AccountAD: CheckIfPasswordIsInSync for mydb4returned 0
0000243c.000008c8::2021/10/23-03:31:31.476 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: CheckIfPasswordIsInSync for mydb3 returned 0
0000243c.000008c8::2021/10/23-03:31:31.587 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000243c.000008c8::2021/10/23-03:31:32.450 INFO  [RES] Network Name <mydb2_mydb2>: AccountAD: CheckIfPasswordIsInSync for mydb2 returned 0
0000023c.000008e8::2021/10/23-03:32:25.593 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000024a4::2021/10/23-03:33:25.593 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000d58::2021/10/23-03:34:25.629 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000026c4::2021/10/23-03:34:28.958 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.000026c4::2021/10/23-03:34:28.958 INFO  [GEM] Node 1: ---- 0 Total Messages
000010a8.000021fc::2021/10/23-03:34:29.413 WARN  Unhandled exception on the thread 8700, exception The requested operation is not supported.
0000023c.00000878::2021/10/23-03:35:25.621 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000878::2021/10/23-03:36:25.654 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000d58::2021/10/23-03:37:25.645 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000d58::2021/10/23-03:38:25.656 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001cec::2021/10/23-03:39:25.665 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000026c4::2021/10/23-03:39:29.423 WARN  Unhandled exception on the thread 9924, exception The requested operation is not supported.
0000023c.00000550::2021/10/23-03:40:25.672 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000508::2021/10/23-03:41:25.680 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000508::2021/10/23-03:42:25.686 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000508::2021/10/23-03:43:25.690 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000550::2021/10/23-03:44:25.712 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001be0::2021/10/23-03:44:29.445 WARN  Unhandled exception on the thread 7136, exception The requested operation is not supported.
00000054.000027f8::2021/10/23-03:44:45.118 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-22 22:44:45.110
00000054.000027f8::2021/10/23-03:44:55.125 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-22 22:44:55.117
0000023c.00000508::2021/10/23-03:45:25.704 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001be0::2021/10/23-03:46:20.097 INFO  [CSVREMPRV] ClusterGetAllSnapshotsFromDatabase, EXIT, status:0
000010a8.00001be0::2021/10/23-03:46:20.097 INFO  [CSVPRV] ClusterGetAllSnapshotsFromDatabase: status 0
0000023c.00000fb0::2021/10/23-03:46:25.737 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000fb0::2021/10/23-03:47:25.742 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000fb0::2021/10/23-03:48:25.770 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001fa4::2021/10/23-03:49:20.181 INFO  [CSVPRV] ClusterPurgeSnapshots, EXIT
0000023c.00000fb0::2021/10/23-03:49:25.774 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001be0::2021/10/23-03:49:29.473 WARN  Unhandled exception on the thread 7136, exception The requested operation is not supported.
0000023c.000028b8::2021/10/23-03:50:25.795 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000fb0::2021/10/23-03:51:25.808 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000668::2021/10/23-03:52:25.823 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000668::2021/10/23-03:53:25.826 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b60::2021/10/23-03:54:25.851 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000025e0::2021/10/23-03:54:29.508 WARN  Unhandled exception on the thread 9696, exception The requested operation is not supported.
0000023c.00000fb0::2021/10/23-03:55:25.857 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000970::2021/10/23-03:56:25.879 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028d8::2021/10/23-03:57:25.890 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000970::2021/10/23-03:58:25.899 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000006d8::2021/10/23-03:59:25.915 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002878::2021/10/23-03:59:29.526 WARN  Unhandled exception on the thread 10360, exception The requested operation is not supported.
0000023c.00000fb0::2021/10/23-04:00:25.942 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028d8::2021/10/23-04:01:25.953 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000000d4::2021/10/23-04:02:25.960 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000000d4::2021/10/23-04:03:25.978 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028d8::2021/10/23-04:04:26.014 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002878::2021/10/23-04:04:29.792 WARN  Unhandled exception on the thread 10360, exception The requested operation is not supported.
0000023c.00002448::2021/10/23-04:05:26.013 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002448::2021/10/23-04:06:26.024 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000280::2021/10/23-04:07:26.036 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000280::2021/10/23-04:08:26.065 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028d8::2021/10/23-04:09:26.066 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002ab4::2021/10/23-04:09:29.581 WARN  Unhandled exception on the thread 10932, exception The requested operation is not supported.
0000023c.000019d4::2021/10/23-04:10:26.089 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028d8::2021/10/23-04:11:26.103 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002978::2021/10/23-04:12:26.141 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-04:13:16.615 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-22 23:13:16.607
0000023c.000028d8::2021/10/23-04:13:26.135 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-04:13:26.623 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-22 23:13:26.607
0000023c.00000500::2021/10/23-04:14:26.148 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002878::2021/10/23-04:14:29.602 WARN  Unhandled exception on the thread 10360, exception The requested operation is not supported.
0000023c.00000a68::2021/10/23-04:15:26.156 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000019d4::2021/10/23-04:16:26.181 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000019d4::2021/10/23-04:17:26.185 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-04:17:46.876 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-22 23:17:46.863
00000054.000027f8::2021/10/23-04:17:56.889 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-22 23:17:56.877
0000023c.00000500::2021/10/23-04:18:26.205 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002a60::2021/10/23-04:19:26.217 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000005f0::2021/10/23-04:19:29.635 WARN  Unhandled exception on the thread 1520, exception The requested operation is not supported.
0000023c.00000884::2021/10/23-04:20:26.240 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000500::2021/10/23-04:21:26.244 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000884::2021/10/23-04:22:26.274 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000006e0::2021/10/23-04:23:26.276 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000500::2021/10/23-04:24:26.312 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000005f0::2021/10/23-04:24:29.652 WARN  Unhandled exception on the thread 1520, exception The requested operation is not supported.
0000023c.00000884::2021/10/23-04:25:26.304 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000500::2021/10/23-04:26:26.309 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000500::2021/10/23-04:27:26.332 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000500::2021/10/23-04:27:26.338 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000500::2021/10/23-04:28:26.354 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000500::2021/10/23-04:29:26.369 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000074c::2021/10/23-04:29:29.681 WARN  Unhandled exception on the thread 1868, exception The requested operation is not supported.
0000023c.00000500::2021/10/23-04:30:26.380 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-04:30:57.566 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-22 23:30:57.557
00000054.000027f8::2021/10/23-04:31:07.574 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-22 23:31:07.567
0000023c.000008e0::2021/10/23-04:31:26.390 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.000029bc::2021/10/23-04:31:31.785 INFO  [RES] Network Name <mydb4_mydb4>: AccountAD: CheckIfPasswordIsInSync for mydb4returned 0
0000243c.0000244c::2021/10/23-04:31:31.800 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: CheckIfPasswordIsInSync for mydb3 returned 0
0000243c.0000244c::2021/10/23-04:31:31.909 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000243c.0000244c::2021/10/23-04:31:32.768 INFO  [RES] Network Name <mydb2_mydb2>: AccountAD: CheckIfPasswordIsInSync for mydb2 returned 0
0000023c.00000758::2021/10/23-04:32:26.418 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000758::2021/10/23-04:33:26.421 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008e0::2021/10/23-04:34:26.456 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000df0::2021/10/23-04:34:29.285 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.00000df0::2021/10/23-04:34:29.285 INFO  [GEM] Node 1: ---- 0 Total Messages
000010a8.00000df0::2021/10/23-04:34:29.710 WARN  Unhandled exception on the thread 3568, exception The requested operation is not supported.
0000023c.00002988::2021/10/23-04:35:26.449 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008e0::2021/10/23-04:36:26.471 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000560::2021/10/23-04:37:26.479 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000758::2021/10/23-04:38:26.502 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000758::2021/10/23-04:39:26.504 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000292c::2021/10/23-04:39:29.746 WARN  Unhandled exception on the thread 10540, exception The requested operation is not supported.
0000023c.000029e0::2021/10/23-04:40:26.512 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008e0::2021/10/23-04:41:26.523 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000758::2021/10/23-04:42:26.554 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008e0::2021/10/23-04:43:26.550 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000758::2021/10/23-04:44:26.581 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000292c::2021/10/23-04:44:29.776 WARN  Unhandled exception on the thread 10540, exception The requested operation is not supported.
0000023c.000008e0::2021/10/23-04:45:26.581 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008e0::2021/10/23-04:46:26.619 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b0c::2021/10/23-04:47:26.622 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028b4::2021/10/23-04:48:26.652 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000388::2021/10/23-04:49:26.648 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000292c::2021/10/23-04:49:29.795 WARN  Unhandled exception on the thread 10540, exception The requested operation is not supported.
00000054.000027f8::2021/10/23-04:50:18.744 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-22 23:50:18.727
0000023c.00002b0c::2021/10/23-04:50:26.683 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-04:50:28.746 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-22 23:50:28.737
0000023c.00000388::2021/10/23-04:51:26.685 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028b4::2021/10/23-04:52:26.713 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000388::2021/10/23-04:53:26.725 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000388::2021/10/23-04:54:26.751 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000292c::2021/10/23-04:54:29.822 WARN  Unhandled exception on the thread 10540, exception The requested operation is not supported.
0000023c.00002adc::2021/10/23-04:55:26.758 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000018b0::2021/10/23-04:56:26.792 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a54::2021/10/23-04:57:26.797 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-04:57:49.105 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-22 23:57:49.087
00000054.000027f8::2021/10/23-04:57:59.117 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-22 23:57:59.103
0000023c.00002adc::2021/10/23-04:58:26.819 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002adc::2021/10/23-04:59:26.821 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000df0::2021/10/23-04:59:29.842 WARN  Unhandled exception on the thread 3568, exception The requested operation is not supported.
00000054.000027f8::2021/10/23-05:00:09.243 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 00:00:09.227
00000054.000027f8::2021/10/23-05:00:19.249 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 00:00:19.237
0000023c.0000232c::2021/10/23-05:00:26.849 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000232c::2021/10/23-05:01:26.847 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000018b0::2021/10/23-05:02:26.870 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000018b0::2021/10/23-05:03:26.877 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a54::2021/10/23-05:04:26.908 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000638::2021/10/23-05:04:29.863 WARN  Unhandled exception on the thread 1592, exception The requested operation is not supported.
0000023c.00000970::2021/10/23-05:05:26.904 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000970::2021/10/23-05:06:26.914 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a54::2021/10/23-05:07:26.921 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a54::2021/10/23-05:08:26.944 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000090c::2021/10/23-05:09:26.951 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001544::2021/10/23-05:09:30.109 WARN  Unhandled exception on the thread 5444, exception The requested operation is not supported.
0000023c.00000970::2021/10/23-05:10:26.966 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ed0::2021/10/23-05:11:26.961 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ed0::2021/10/23-05:12:26.979 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000145c::2021/10/23-05:13:26.976 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000145c::2021/10/23-05:14:26.985 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000291c::2021/10/23-05:14:29.910 WARN  Unhandled exception on the thread 10524, exception The requested operation is not supported.
0000023c.0000145c::2021/10/23-05:15:26.993 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000145c::2021/10/23-05:16:27.025 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000888::2021/10/23-05:17:27.029 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000970::2021/10/23-05:18:27.053 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000970::2021/10/23-05:19:27.067 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002134::2021/10/23-05:19:29.934 WARN  Unhandled exception on the thread 8500, exception The requested operation is not supported.
0000023c.00000970::2021/10/23-05:20:27.097 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000970::2021/10/23-05:21:27.102 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000634::2021/10/23-05:22:27.134 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-05:23:20.520 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 00:23:20.510
0000023c.00002a80::2021/10/23-05:23:27.128 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-05:23:30.528 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 00:23:30.510
0000023c.00000634::2021/10/23-05:24:27.151 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002134::2021/10/23-05:24:29.960 WARN  Unhandled exception on the thread 8500, exception The requested operation is not supported.
0000023c.00002a80::2021/10/23-05:25:27.162 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000117c::2021/10/23-05:26:27.181 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000020b4::2021/10/23-05:27:27.196 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000020b4::2021/10/23-05:28:27.218 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000634::2021/10/23-05:29:27.228 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000ae0::2021/10/23-05:29:29.983 WARN  Unhandled exception on the thread 2784, exception The requested operation is not supported.
0000023c.00001704::2021/10/23-05:30:27.239 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-05:31:00.951 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 00:31:00.940
00000054.000027f8::2021/10/23-05:31:10.966 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 00:31:10.957
0000023c.00000634::2021/10/23-05:31:27.251 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.000029bc::2021/10/23-05:31:32.183 INFO  [RES] Network Name <mydb4_mydb4>: AccountAD: CheckIfPasswordIsInSync for mydb4returned 0
0000243c.000008ac::2021/10/23-05:31:32.199 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: CheckIfPasswordIsInSync for mydb3 returned 0
0000243c.00000624::2021/10/23-05:31:32.201 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000243c.00000624::2021/10/23-05:31:33.055 INFO  [RES] Network Name <mydb2_mydb2>: AccountAD: CheckIfPasswordIsInSync for mydb2 returned 0
0000023c.0000117c::2021/10/23-05:32:27.276 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000012c4::2021/10/23-05:33:27.275 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b78::2021/10/23-05:34:27.299 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000ae0::2021/10/23-05:34:29.580 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.00000ae0::2021/10/23-05:34:29.580 INFO  [GEM] Node 1: ---- 0 Total Messages
000010a8.00000ae0::2021/10/23-05:34:30.008 WARN  Unhandled exception on the thread 2784, exception The requested operation is not supported.
0000023c.000013e0::2021/10/23-05:35:27.302 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b78::2021/10/23-05:36:27.329 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b78::2021/10/23-05:37:27.343 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000013e0::2021/10/23-05:38:27.353 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ce8::2021/10/23-05:39:27.365 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000029cc::2021/10/23-05:39:30.040 WARN  Unhandled exception on the thread 10700, exception The requested operation is not supported.
0000023c.00002474::2021/10/23-05:40:27.377 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000013e0::2021/10/23-05:41:27.391 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ce8::2021/10/23-05:42:27.401 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002474::2021/10/23-05:43:27.413 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ce8::2021/10/23-05:44:27.441 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000ae0::2021/10/23-05:44:30.074 WARN  Unhandled exception on the thread 2784, exception The requested operation is not supported.
0000023c.000029e8::2021/10/23-05:45:27.442 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002474::2021/10/23-05:46:27.459 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000254c::2021/10/23-05:47:27.468 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ce8::2021/10/23-05:48:27.492 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000254c::2021/10/23-05:49:27.494 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000ae0::2021/10/23-05:49:30.095 WARN  Unhandled exception on the thread 2784, exception The requested operation is not supported.
0000023c.00001ce8::2021/10/23-05:50:27.517 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ce8::2021/10/23-05:51:27.530 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ce8::2021/10/23-05:52:27.556 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000285c::2021/10/23-05:53:27.559 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000285c::2021/10/23-05:54:27.587 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000ae0::2021/10/23-05:54:30.125 WARN  Unhandled exception on the thread 2784, exception The requested operation is not supported.
0000023c.00001d54::2021/10/23-05:55:27.587 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ce8::2021/10/23-05:56:27.615 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ce8::2021/10/23-05:57:27.632 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a40::2021/10/23-05:58:27.661 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001d54::2021/10/23-05:59:27.665 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000ae0::2021/10/23-05:59:30.139 WARN  Unhandled exception on the thread 2784, exception The requested operation is not supported.
0000023c.00002b34::2021/10/23-06:00:27.677 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ce8::2021/10/23-06:01:27.681 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ce8::2021/10/23-06:02:27.695 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002aec::2021/10/23-06:03:27.695 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b34::2021/10/23-06:04:27.717 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000ae0::2021/10/23-06:04:30.174 WARN  Unhandled exception on the thread 2784, exception The requested operation is not supported.
0000023c.00002aec::2021/10/23-06:05:27.728 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002ba0::2021/10/23-06:06:27.747 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b34::2021/10/23-06:07:27.748 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002840::2021/10/23-06:08:27.775 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002840::2021/10/23-06:09:27.769 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000024e8::2021/10/23-06:09:30.197 WARN  Unhandled exception on the thread 9448, exception The requested operation is not supported.
0000023c.00002840::2021/10/23-06:10:27.778 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000177c::2021/10/23-06:11:27.788 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b34::2021/10/23-06:12:27.822 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002840::2021/10/23-06:13:27.812 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000177c::2021/10/23-06:14:27.827 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002384::2021/10/23-06:14:30.445 WARN  Unhandled exception on the thread 9092, exception The requested operation is not supported.
0000023c.0000177c::2021/10/23-06:15:27.836 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000015f4::2021/10/23-06:16:27.854 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000015f4::2021/10/23-06:17:27.872 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000090::2021/10/23-06:18:27.907 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000090::2021/10/23-06:19:27.911 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002384::2021/10/23-06:19:30.245 WARN  Unhandled exception on the thread 9092, exception The requested operation is not supported.
0000023c.000029b0::2021/10/23-06:20:27.938 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000015f4::2021/10/23-06:21:27.938 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000125c::2021/10/23-06:22:27.966 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-06:23:14.175 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 01:23:14.160
00000054.000027f8::2021/10/23-06:23:24.179 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 01:23:24.177
0000023c.00000df8::2021/10/23-06:23:27.974 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000106c::2021/10/23-06:24:27.993 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002658::2021/10/23-06:24:30.264 WARN  Unhandled exception on the thread 9816, exception The requested operation is not supported.
0000023c.0000125c::2021/10/23-06:25:27.996 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-06:26:24.359 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 01:26:24.343
0000023c.000029b0::2021/10/23-06:26:28.029 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-06:26:34.367 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 01:26:34.357
0000023c.0000106c::2021/10/23-06:27:28.035 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b28::2021/10/23-06:28:28.061 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b28::2021/10/23-06:29:28.061 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000a1c::2021/10/23-06:29:30.301 WARN  Unhandled exception on the thread 2588, exception The requested operation is not supported.
0000023c.00002b28::2021/10/23-06:30:28.093 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ed0::2021/10/23-06:31:28.100 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.000008c8::2021/10/23-06:31:32.372 INFO  [RES] Network Name <mydb4_mydb4>: AccountAD: CheckIfPasswordIsInSync for mydb4returned 0
0000243c.00002994::2021/10/23-06:31:32.389 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: CheckIfPasswordIsInSync for mydb3 returned 0
0000243c.00002994::2021/10/23-06:31:32.501 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000243c.00002994::2021/10/23-06:31:33.353 INFO  [RES] Network Name <mydb2_mydb2>: AccountAD: CheckIfPasswordIsInSync for mydb2 returned 0
0000023c.000020c8::2021/10/23-06:32:28.131 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000272c::2021/10/23-06:33:28.130 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000272c::2021/10/23-06:34:28.157 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002658::2021/10/23-06:34:29.877 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.00002658::2021/10/23-06:34:29.877 INFO  [GEM] Node 1: ---- 0 Total Messages
000010a8.000028c0::2021/10/23-06:34:30.320 WARN  Unhandled exception on the thread 10432, exception The requested operation is not supported.
0000023c.000020c8::2021/10/23-06:35:28.156 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001a90::2021/10/23-06:36:28.181 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001a90::2021/10/23-06:37:28.196 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000125c::2021/10/23-06:38:28.227 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001cf0::2021/10/23-06:39:28.241 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002658::2021/10/23-06:39:30.338 WARN  Unhandled exception on the thread 9816, exception The requested operation is not supported.
0000023c.0000218c::2021/10/23-06:40:28.262 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001cf0::2021/10/23-06:41:28.263 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001cf0::2021/10/23-06:42:28.289 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000125c::2021/10/23-06:43:28.294 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b9c::2021/10/23-06:44:28.325 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002384::2021/10/23-06:44:30.364 WARN  Unhandled exception on the thread 9092, exception The requested operation is not supported.
0000023c.000006e0::2021/10/23-06:45:28.331 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000006e0::2021/10/23-06:46:28.353 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000024bc::2021/10/23-06:47:28.369 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000006e0::2021/10/23-06:48:28.393 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000006e0::2021/10/23-06:49:28.394 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002384::2021/10/23-06:49:30.399 WARN  Unhandled exception on the thread 9092, exception The requested operation is not supported.
0000023c.00002b9c::2021/10/23-06:50:28.426 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b9c::2021/10/23-06:51:28.432 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b9c::2021/10/23-06:52:28.462 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b9c::2021/10/23-06:53:28.470 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000006a0::2021/10/23-06:54:28.499 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002384::2021/10/23-06:54:30.412 WARN  Unhandled exception on the thread 9092, exception The requested operation is not supported.
0000023c.000006a0::2021/10/23-06:55:28.510 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000025b8::2021/10/23-06:56:28.531 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001a00::2021/10/23-06:57:28.523 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000930::2021/10/23-06:58:28.553 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000930::2021/10/23-06:59:28.550 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000020b4::2021/10/23-06:59:30.447 WARN  Unhandled exception on the thread 8372, exception The requested operation is not supported.
0000023c.00001a00::2021/10/23-07:00:28.577 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001a00::2021/10/23-07:01:28.583 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000027f0::2021/10/23-07:02:28.605 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001a00::2021/10/23-07:03:28.611 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001a00::2021/10/23-07:04:28.642 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000010d0::2021/10/23-07:04:30.477 WARN  Unhandled exception on the thread 4304, exception The requested operation is not supported.
0000023c.00002590::2021/10/23-07:05:28.644 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a58::2021/10/23-07:06:28.680 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000388::2021/10/23-07:07:28.681 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000388::2021/10/23-07:08:28.693 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002590::2021/10/23-07:09:28.706 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002384::2021/10/23-07:09:30.719 WARN  Unhandled exception on the thread 9092, exception The requested operation is not supported.
0000023c.00000388::2021/10/23-07:10:28.739 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002590::2021/10/23-07:11:28.736 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000f88::2021/10/23-07:12:28.760 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000109c::2021/10/23-07:13:28.764 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000109c::2021/10/23-07:14:28.798 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000010d0::2021/10/23-07:14:30.525 WARN  Unhandled exception on the thread 4304, exception The requested operation is not supported.
0000023c.00002590::2021/10/23-07:15:28.798 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000029a8::2021/10/23-07:16:28.816 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002598::2021/10/23-07:17:28.812 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000794::2021/10/23-07:18:28.835 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000029a8::2021/10/23-07:19:28.853 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002b9c::2021/10/23-07:19:30.549 WARN  Unhandled exception on the thread 11164, exception The requested operation is not supported.
0000023c.000012a4::2021/10/23-07:20:28.882 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000109c::2021/10/23-07:21:28.886 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000109c::2021/10/23-07:22:28.909 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000012a4::2021/10/23-07:23:28.901 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000bc0::2021/10/23-07:24:28.923 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002b9c::2021/10/23-07:24:30.571 WARN  Unhandled exception on the thread 11164, exception The requested operation is not supported.
0000023c.00000bc0::2021/10/23-07:25:28.930 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000bc0::2021/10/23-07:26:28.962 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000024d8::2021/10/23-07:27:28.963 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000024d8::2021/10/23-07:28:28.997 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000012a4::2021/10/23-07:29:28.998 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000029d8::2021/10/23-07:29:30.597 WARN  Unhandled exception on the thread 10712, exception The requested operation is not supported.
0000023c.000024d8::2021/10/23-07:30:29.021 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b64::2021/10/23-07:31:29.023 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.000029bc::2021/10/23-07:31:32.684 INFO  [RES] Network Name <mydb4_mydb4>: AccountAD: CheckIfPasswordIsInSync for mydb4returned 0
0000243c.00000a98::2021/10/23-07:31:32.700 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: CheckIfPasswordIsInSync for mydb3 returned 0
0000243c.00000a98::2021/10/23-07:31:32.814 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000243c.00000a98::2021/10/23-07:31:33.677 INFO  [RES] Network Name <mydb2_mydb2>: AccountAD: CheckIfPasswordIsInSync for mydb2 returned 0
0000023c.00002690::2021/10/23-07:32:29.044 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b64::2021/10/23-07:33:29.045 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000012a4::2021/10/23-07:34:29.063 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000029d8::2021/10/23-07:34:30.191 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.000029d8::2021/10/23-07:34:30.191 INFO  [GEM] Node 1: ---- 0 Total Messages
000010a8.000011e4::2021/10/23-07:34:30.633 WARN  Unhandled exception on the thread 4580, exception The requested operation is not supported.
0000023c.000012a4::2021/10/23-07:35:29.071 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b64::2021/10/23-07:36:29.102 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002258::2021/10/23-07:37:29.113 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001708::2021/10/23-07:38:29.140 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000027b4::2021/10/23-07:39:29.155 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002bac::2021/10/23-07:39:30.659 WARN  Unhandled exception on the thread 11180, exception The requested operation is not supported.
0000023c.00000270::2021/10/23-07:40:29.181 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001708::2021/10/23-07:41:29.190 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001708::2021/10/23-07:42:31.533 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001708::2021/10/23-07:43:29.229 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002734::2021/10/23-07:44:29.250 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002bac::2021/10/23-07:44:30.679 WARN  Unhandled exception on the thread 11180, exception The requested operation is not supported.
0000023c.000028d4::2021/10/23-07:45:29.261 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000056c::2021/10/23-07:46:29.277 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002734::2021/10/23-07:47:29.271 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002598::2021/10/23-07:48:29.287 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000056c::2021/10/23-07:49:29.292 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002bac::2021/10/23-07:49:30.922 WARN  Unhandled exception on the thread 11180, exception The requested operation is not supported.
0000023c.00000754::2021/10/23-07:50:29.323 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028d4::2021/10/23-07:51:29.318 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000754::2021/10/23-07:52:29.349 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000754::2021/10/23-07:53:29.663 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000056c::2021/10/23-07:54:29.686 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001318::2021/10/23-07:54:30.741 WARN  Unhandled exception on the thread 4888, exception The requested operation is not supported.
0000023c.00001fa4::2021/10/23-07:55:29.688 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b14::2021/10/23-07:56:29.711 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b14::2021/10/23-07:57:29.722 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b14::2021/10/23-07:58:29.727 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001fe0::2021/10/23-07:59:29.739 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000560::2021/10/23-07:59:30.760 WARN  Unhandled exception on the thread 1376, exception The requested operation is not supported.
0000023c.00001fa4::2021/10/23-08:00:29.773 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001fa4::2021/10/23-08:01:29.782 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001fa4::2021/10/23-08:02:29.805 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001fe0::2021/10/23-08:03:29.813 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000179c::2021/10/23-08:04:31.071 WARN  Unhandled exception on the thread 6044, exception The requested operation is not supported.
0000023c.00001fa4::2021/10/23-08:04:33.261 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001794::2021/10/23-08:05:33.437 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001368::2021/10/23-08:06:36.872 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-08:06:39.939 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 03:06:39.873
00000054.000027f8::2021/10/23-08:06:49.895 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 03:06:49.883
00000054.000027f8::2021/10/23-08:07:10.066 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 03:07:09.927
0000023c.000026c8::2021/10/23-08:07:38.432 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000019b8::2021/10/23-08:07:47.523 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~56122~.
000010a8.0000179c::2021/10/23-08:07:47.524 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~56122~).
000010a8.0000179c::2021/10/23-08:07:47.524 INFO  [SV] Got a new incoming stream from 10.16.1.75:~56122~
000010a8.000019b8::2021/10/23-08:07:50.568 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~32880~.
000010a8.00000560::2021/10/23-08:07:50.572 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~32880~).
000010a8.00000560::2021/10/23-08:07:50.572 INFO  [SV] Got a new incoming stream from 10.16.1.75:~32880~
000010a8.000019b8::2021/10/23-08:07:55.912 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~46756~.
000010a8.00001c70::2021/10/23-08:07:55.914 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~46756~).
000010a8.00001c70::2021/10/23-08:07:55.914 INFO  [SV] Got a new incoming stream from 10.16.1.75:~46756~
000010a8.0000179c::2021/10/23-08:07:57.018 WARN  [CHANNEL 10.16.1.75:~56122~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.0000179c::2021/10/23-08:07:57.018 WARN  [CHANNEL 10.16.1.75:~56122~] failure, status 10054
000010a8.0000179c::2021/10/23-08:07:57.018 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~56122~ has failed with status 10054'
000010a8.0000179c::2021/10/23-08:07:57.018 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:07:58.256 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~36962~.
000010a8.0000179c::2021/10/23-08:07:58.257 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~36962~).
000010a8.0000179c::2021/10/23-08:07:58.257 INFO  [SV] Got a new incoming stream from 10.16.1.75:~36962~
000010a8.00000560::2021/10/23-08:08:00.101 WARN  [CHANNEL 10.16.1.75:~32880~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00000560::2021/10/23-08:08:00.101 WARN  [CHANNEL 10.16.1.75:~32880~] failure, status 10054
000010a8.00000560::2021/10/23-08:08:00.101 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~32880~ has failed with status 10054'
000010a8.00000560::2021/10/23-08:08:00.101 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.0000179c::2021/10/23-08:08:02.007 WARN  [CHANNEL 10.16.1.75:~36962~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.0000179c::2021/10/23-08:08:02.007 WARN  [CHANNEL 10.16.1.75:~36962~] failure, status 10054
000010a8.0000179c::2021/10/23-08:08:02.007 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~36962~ has failed with status 10054'
000010a8.0000179c::2021/10/23-08:08:02.007 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:03.414 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~41814~.
000010a8.0000179c::2021/10/23-08:08:03.414 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~41814~).
000010a8.0000179c::2021/10/23-08:08:03.414 INFO  [SV] Got a new incoming stream from 10.16.1.75:~41814~
000010a8.0000179c::2021/10/23-08:08:03.466 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 369098752, 1282696551, 65536'
000010a8.0000179c::2021/10/23-08:08:03.466 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:03.476 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~57380~.
000010a8.0000179c::2021/10/23-08:08:03.476 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~57380~).
000010a8.0000179c::2021/10/23-08:08:03.476 INFO  [SV] Got a new incoming stream from 10.16.1.75:~57380~
000010a8.000019b8::2021/10/23-08:08:03.752 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~44648~.
000010a8.000025f0::2021/10/23-08:08:03.752 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~44648~).
000010a8.000025f0::2021/10/23-08:08:03.752 INFO  [SV] Got a new incoming stream from 10.16.1.75:~44648~
000010a8.000019b8::2021/10/23-08:08:03.849 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~39374~.
000010a8.00000560::2021/10/23-08:08:03.849 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~39374~).
000010a8.00000560::2021/10/23-08:08:03.849 INFO  [SV] Got a new incoming stream from 10.16.1.75:~39374~
000010a8.00001c70::2021/10/23-08:08:05.002 WARN  [CHANNEL 10.16.1.75:~46756~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00001c70::2021/10/23-08:08:05.002 WARN  [CHANNEL 10.16.1.75:~46756~] failure, status 10054
000010a8.00001c70::2021/10/23-08:08:05.002 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~46756~ has failed with status 10054'
000010a8.00001c70::2021/10/23-08:08:05.002 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:05.022 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~43448~.
000010a8.00001c70::2021/10/23-08:08:05.022 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~43448~).
000010a8.00001c70::2021/10/23-08:08:05.022 INFO  [SV] Got a new incoming stream from 10.16.1.75:~43448~
000010a8.000019b8::2021/10/23-08:08:05.679 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~55930~.
000010a8.00000668::2021/10/23-08:08:05.679 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~55930~).
000010a8.00000668::2021/10/23-08:08:05.679 INFO  [SV] Got a new incoming stream from 10.16.1.75:~55930~
000010a8.000019b8::2021/10/23-08:08:06.728 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~47912~.
000010a8.000028f4::2021/10/23-08:08:06.728 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~47912~).
000010a8.000028f4::2021/10/23-08:08:06.728 INFO  [SV] Got a new incoming stream from 10.16.1.75:~47912~
000010a8.000019b8::2021/10/23-08:08:07.055 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~57408~.
000010a8.0000115c::2021/10/23-08:08:07.055 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~57408~).
000010a8.0000115c::2021/10/23-08:08:07.055 INFO  [SV] Got a new incoming stream from 10.16.1.75:~57408~
000010a8.0000115c::2021/10/23-08:08:07.055 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 369098752, 1282696551, 65536'
000010a8.0000115c::2021/10/23-08:08:07.055 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000025f0::2021/10/23-08:08:07.097 WARN  [CHANNEL 10.16.1.75:~44648~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.000025f0::2021/10/23-08:08:07.097 WARN  [CHANNEL 10.16.1.75:~44648~] failure, status 10054
000010a8.000025f0::2021/10/23-08:08:07.097 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~44648~ has failed with status 10054'
000010a8.000025f0::2021/10/23-08:08:07.097 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:07.253 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~48490~.
000010a8.000025f0::2021/10/23-08:08:07.253 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~48490~).
000010a8.000025f0::2021/10/23-08:08:07.253 INFO  [SV] Got a new incoming stream from 10.16.1.75:~48490~
000010a8.000025f0::2021/10/23-08:08:07.255 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 369098752, 1282696551, 65536'
000010a8.000025f0::2021/10/23-08:08:07.255 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00000668::2021/10/23-08:08:09.009 WARN  [CHANNEL 10.16.1.75:~55930~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00000668::2021/10/23-08:08:09.009 WARN  [CHANNEL 10.16.1.75:~55930~] failure, status 10054
000010a8.00000668::2021/10/23-08:08:09.009 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~55930~ has failed with status 10054'
000010a8.00000668::2021/10/23-08:08:09.009 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00001c70::2021/10/23-08:08:10.043 WARN  [CHANNEL 10.16.1.75:~43448~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00001c70::2021/10/23-08:08:10.043 WARN  [CHANNEL 10.16.1.75:~43448~] failure, status 10054
000010a8.00001c70::2021/10/23-08:08:10.043 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~43448~ has failed with status 10054'
000010a8.00001c70::2021/10/23-08:08:10.043 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:10.376 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~49480~.
000010a8.00001c70::2021/10/23-08:08:10.376 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~49480~).
000010a8.00001c70::2021/10/23-08:08:10.376 INFO  [SV] Got a new incoming stream from 10.16.1.75:~49480~
000010a8.00001c70::2021/10/23-08:08:10.379 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 655619, 0, 65536'
000010a8.00001c70::2021/10/23-08:08:10.379 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:11.492 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~34122~.
000010a8.00001c70::2021/10/23-08:08:11.492 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~34122~).
000010a8.00001c70::2021/10/23-08:08:11.492 INFO  [SV] Got a new incoming stream from 10.16.1.75:~34122~
000010a8.000028f4::2021/10/23-08:08:11.730 WARN  [CHANNEL 10.16.1.75:~47912~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.000028f4::2021/10/23-08:08:11.730 WARN  [CHANNEL 10.16.1.75:~47912~] failure, status 10054
000010a8.000028f4::2021/10/23-08:08:11.730 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~47912~ has failed with status 10054'
000010a8.000028f4::2021/10/23-08:08:11.730 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.0000179c::2021/10/23-08:08:13.000 WARN  [CHANNEL 10.16.1.75:~57380~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.0000179c::2021/10/23-08:08:13.000 WARN  [CHANNEL 10.16.1.75:~57380~] failure, status 10054
000010a8.0000179c::2021/10/23-08:08:13.000 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~57380~ has failed with status 10054'
000010a8.0000179c::2021/10/23-08:08:13.000 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00000560::2021/10/23-08:08:13.000 WARN  [CHANNEL 10.16.1.75:~39374~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00000560::2021/10/23-08:08:13.000 WARN  [CHANNEL 10.16.1.75:~39374~] failure, status 10054
000010a8.00000560::2021/10/23-08:08:13.000 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~39374~ has failed with status 10054'
000010a8.00000560::2021/10/23-08:08:13.000 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:13.436 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~54946~.
000010a8.00000560::2021/10/23-08:08:13.436 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~54946~).
000010a8.00000560::2021/10/23-08:08:13.436 INFO  [SV] Got a new incoming stream from 10.16.1.75:~54946~
000010a8.00000560::2021/10/23-08:08:13.436 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 655619, 0, 65536'
000010a8.00000560::2021/10/23-08:08:13.436 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:15.093 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~51122~.
000010a8.0000179c::2021/10/23-08:08:15.093 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~51122~).
000010a8.0000179c::2021/10/23-08:08:15.093 INFO  [SV] Got a new incoming stream from 10.16.1.75:~51122~
000010a8.000019b8::2021/10/23-08:08:15.099 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~41296~.
000010a8.00000560::2021/10/23-08:08:15.099 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~41296~).
000010a8.00000560::2021/10/23-08:08:15.099 INFO  [SV] Got a new incoming stream from 10.16.1.75:~41296~
000010a8.000019b8::2021/10/23-08:08:15.165 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~37552~.
000010a8.000028f4::2021/10/23-08:08:15.165 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~37552~).
000010a8.000028f4::2021/10/23-08:08:15.165 INFO  [SV] Got a new incoming stream from 10.16.1.75:~37552~
000010a8.000028f4::2021/10/23-08:08:15.166 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 655619, 0, 65536'
000010a8.000028f4::2021/10/23-08:08:15.166 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:15.737 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~41928~.
000010a8.000028f4::2021/10/23-08:08:15.737 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~41928~).
000010a8.000028f4::2021/10/23-08:08:15.737 INFO  [SV] Got a new incoming stream from 10.16.1.75:~41928~
000010a8.000028f4::2021/10/23-08:08:15.783 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 369098752, 1282696551, 65536'
000010a8.000028f4::2021/10/23-08:08:15.783 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:15.784 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~51812~.
000010a8.000028f4::2021/10/23-08:08:15.784 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~51812~).
000010a8.000028f4::2021/10/23-08:08:15.785 INFO  [SV] Got a new incoming stream from 10.16.1.75:~51812~
000010a8.000028f4::2021/10/23-08:08:15.941 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 369098752, 1282696551, 65536'
000010a8.000028f4::2021/10/23-08:08:15.941 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00001c70::2021/10/23-08:08:16.509 WARN  [CHANNEL 10.16.1.75:~34122~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00001c70::2021/10/23-08:08:16.509 WARN  [CHANNEL 10.16.1.75:~34122~] failure, status 10054
000010a8.00001c70::2021/10/23-08:08:16.509 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~34122~ has failed with status 10054'
000010a8.00001c70::2021/10/23-08:08:16.509 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:18.009 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~53980~.
000010a8.00001c70::2021/10/23-08:08:18.009 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~53980~).
000010a8.00001c70::2021/10/23-08:08:18.009 INFO  [SV] Got a new incoming stream from 10.16.1.75:~53980~
000010a8.000019b8::2021/10/23-08:08:18.888 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~54446~.
000010a8.00000668::2021/10/23-08:08:18.889 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~54446~).
000010a8.00000668::2021/10/23-08:08:18.889 INFO  [SV] Got a new incoming stream from 10.16.1.75:~54446~
000010a8.0000179c::2021/10/23-08:08:19.001 WARN  [CHANNEL 10.16.1.75:~51122~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.0000179c::2021/10/23-08:08:19.001 WARN  [CHANNEL 10.16.1.75:~51122~] failure, status 10054
000010a8.0000179c::2021/10/23-08:08:19.001 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~51122~ has failed with status 10054'
000010a8.0000179c::2021/10/23-08:08:19.001 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00000560::2021/10/23-08:08:19.002 WARN  [CHANNEL 10.16.1.75:~41296~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00000560::2021/10/23-08:08:19.002 WARN  [CHANNEL 10.16.1.75:~41296~] failure, status 10054
000010a8.00000560::2021/10/23-08:08:19.002 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~41296~ has failed with status 10054'
000010a8.00000560::2021/10/23-08:08:19.002 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:19.400 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~45010~.
000010a8.00000560::2021/10/23-08:08:19.400 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~45010~).
000010a8.00000560::2021/10/23-08:08:19.400 INFO  [SV] Got a new incoming stream from 10.16.1.75:~45010~
000010a8.00000668::2021/10/23-08:08:23.961 WARN  [CHANNEL 10.16.1.75:~54446~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00000668::2021/10/23-08:08:23.961 WARN  [CHANNEL 10.16.1.75:~54446~] failure, status 10054
000010a8.00000668::2021/10/23-08:08:23.961 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~54446~ has failed with status 10054'
000010a8.00000668::2021/10/23-08:08:23.961 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00000560::2021/10/23-08:08:25.261 WARN  [CHANNEL 10.16.1.75:~45010~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00000560::2021/10/23-08:08:25.261 WARN  [CHANNEL 10.16.1.75:~45010~] failure, status 10054
000010a8.00000560::2021/10/23-08:08:25.261 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~45010~ has failed with status 10054'
000010a8.00000560::2021/10/23-08:08:25.261 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:26.534 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~34532~.
000010a8.00000560::2021/10/23-08:08:26.534 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~34532~).
000010a8.00000560::2021/10/23-08:08:26.534 INFO  [SV] Got a new incoming stream from 10.16.1.75:~34532~
000010a8.000019b8::2021/10/23-08:08:26.534 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~52924~.
000010a8.000028f4::2021/10/23-08:08:26.534 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~52924~).
000010a8.000028f4::2021/10/23-08:08:26.534 INFO  [SV] Got a new incoming stream from 10.16.1.75:~52924~
000010a8.00000560::2021/10/23-08:08:27.054 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 655619, 0, 65536'
000010a8.000028f4::2021/10/23-08:08:27.054 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 655619, 0, 65536'
000010a8.000028f4::2021/10/23-08:08:27.054 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00000560::2021/10/23-08:08:27.054 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00001c70::2021/10/23-08:08:28.003 WARN  [CHANNEL 10.16.1.75:~53980~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00001c70::2021/10/23-08:08:28.003 WARN  [CHANNEL 10.16.1.75:~53980~] failure, status 10054
000010a8.00001c70::2021/10/23-08:08:28.003 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~53980~ has failed with status 10054'
000010a8.00001c70::2021/10/23-08:08:28.003 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:28.917 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~38256~.
000010a8.00001c70::2021/10/23-08:08:28.917 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~38256~).
000010a8.00001c70::2021/10/23-08:08:28.917 INFO  [SV] Got a new incoming stream from 10.16.1.75:~38256~
000010a8.000019b8::2021/10/23-08:08:29.204 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~38626~.
000010a8.000028f4::2021/10/23-08:08:29.204 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~38626~).
000010a8.000028f4::2021/10/23-08:08:29.204 INFO  [SV] Got a new incoming stream from 10.16.1.75:~38626~
000010a8.000028f4::2021/10/23-08:08:29.204 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 369098752, 1282696551, 65536'
000010a8.000028f4::2021/10/23-08:08:29.204 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
00000054.000027f8::2021/10/23-08:08:30.735 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 03:08:30.720
000010a8.00001c70::2021/10/23-08:08:31.999 WARN  [CHANNEL 10.16.1.75:~38256~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00001c70::2021/10/23-08:08:31.999 WARN  [CHANNEL 10.16.1.75:~38256~] failure, status 10054
000010a8.00001c70::2021/10/23-08:08:31.999 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~38256~ has failed with status 10054'
000010a8.00001c70::2021/10/23-08:08:31.999 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:33.253 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~43840~.
000010a8.000028f4::2021/10/23-08:08:33.253 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~43840~).
000010a8.000028f4::2021/10/23-08:08:33.253 INFO  [SV] Got a new incoming stream from 10.16.1.75:~43840~
000010a8.000019b8::2021/10/23-08:08:37.512 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~48166~.
000010a8.00000560::2021/10/23-08:08:37.513 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~48166~).
000010a8.00000560::2021/10/23-08:08:37.513 INFO  [SV] Got a new incoming stream from 10.16.1.75:~48166~
000010a8.00000560::2021/10/23-08:08:37.520 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 655619, 0, 65536'
000010a8.00000560::2021/10/23-08:08:37.520 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000028f4::2021/10/23-08:08:38.252 WARN  [CHANNEL 10.16.1.75:~43840~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.000028f4::2021/10/23-08:08:38.252 WARN  [CHANNEL 10.16.1.75:~43840~] failure, status 10054
000010a8.000028f4::2021/10/23-08:08:38.252 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~43840~ has failed with status 10054'
000010a8.000028f4::2021/10/23-08:08:38.252 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:39.870 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~55848~.
000010a8.000028f4::2021/10/23-08:08:39.870 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~55848~).
000010a8.000028f4::2021/10/23-08:08:39.870 INFO  [SV] Got a new incoming stream from 10.16.1.75:~55848~
000010a8.000028f4::2021/10/23-08:08:39.870 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 3497563130, 65536'
000010a8.000028f4::2021/10/23-08:08:39.870 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
00000054.000027f8::2021/10/23-08:08:40.934 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 03:08:40.757
0000023c.000026c8::2021/10/23-08:08:42.384 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000019b8::2021/10/23-08:08:49.653 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~51612~.
000010a8.00000560::2021/10/23-08:08:49.653 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~51612~).
000010a8.00000560::2021/10/23-08:08:49.653 INFO  [SV] Got a new incoming stream from 10.16.1.75:~51612~
000010a8.00000560::2021/10/23-08:08:49.657 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 2375812106, 65536'
000010a8.00000560::2021/10/23-08:08:49.657 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
00000054.000027f8::2021/10/23-08:08:50.902 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 03:08:50.763
000010a8.000019b8::2021/10/23-08:08:53.161 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~48212~.
000010a8.00000560::2021/10/23-08:08:53.161 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~48212~).
000010a8.00000560::2021/10/23-08:08:53.161 INFO  [SV] Got a new incoming stream from 10.16.1.75:~48212~
000010a8.00000560::2021/10/23-08:08:53.161 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00000560::2021/10/23-08:08:53.161 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:53.201 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~48282~.
000010a8.00000560::2021/10/23-08:08:53.201 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~48282~).
000010a8.00000560::2021/10/23-08:08:53.201 INFO  [SV] Got a new incoming stream from 10.16.1.75:~48282~
000010a8.00000560::2021/10/23-08:08:53.204 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 1029990759, 65536'
000010a8.00000560::2021/10/23-08:08:53.205 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:57.592 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~37244~.
000010a8.000028f4::2021/10/23-08:08:57.592 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~37244~).
000010a8.000028f4::2021/10/23-08:08:57.592 INFO  [SV] Got a new incoming stream from 10.16.1.75:~37244~
000010a8.000028f4::2021/10/23-08:08:57.592 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.000028f4::2021/10/23-08:08:57.592 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:57.596 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~37248~.
000010a8.000028f4::2021/10/23-08:08:57.596 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~37248~).
000010a8.000028f4::2021/10/23-08:08:57.596 INFO  [SV] Got a new incoming stream from 10.16.1.75:~37248~
000010a8.000028f4::2021/10/23-08:08:57.597 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 1029990759, 65536'
000010a8.000028f4::2021/10/23-08:08:57.597 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:08:59.152 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~56362~.
000010a8.000028f4::2021/10/23-08:08:59.152 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~56362~).
000010a8.000028f4::2021/10/23-08:08:59.152 INFO  [SV] Got a new incoming stream from 10.16.1.75:~56362~
000010a8.000028f4::2021/10/23-08:08:59.155 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 2217682469, 65536'
000010a8.000028f4::2021/10/23-08:08:59.155 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:01.194 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~33644~.
000010a8.000028f4::2021/10/23-08:09:01.194 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~33644~).
000010a8.000028f4::2021/10/23-08:09:01.194 INFO  [SV] Got a new incoming stream from 10.16.1.75:~33644~
000010a8.000028f4::2021/10/23-08:09:01.206 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.000028f4::2021/10/23-08:09:01.206 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:01.220 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~33654~.
000010a8.000028f4::2021/10/23-08:09:01.220 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~33654~).
000010a8.000028f4::2021/10/23-08:09:01.220 INFO  [SV] Got a new incoming stream from 10.16.1.75:~33654~
000010a8.000028f4::2021/10/23-08:09:01.228 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 297734388, 65536'
000010a8.000028f4::2021/10/23-08:09:01.228 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:03.528 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~33628~.
000010a8.000028f4::2021/10/23-08:09:03.528 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~33628~).
000010a8.000028f4::2021/10/23-08:09:03.528 INFO  [SV] Got a new incoming stream from 10.16.1.75:~33628~
000010a8.000019b8::2021/10/23-08:09:05.009 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~51288~.
000010a8.00000560::2021/10/23-08:09:05.009 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~51288~).
000010a8.00000560::2021/10/23-08:09:05.009 INFO  [SV] Got a new incoming stream from 10.16.1.75:~51288~
000010a8.00000560::2021/10/23-08:09:05.010 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 3431972964, 65536'
000010a8.00000560::2021/10/23-08:09:05.010 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:05.347 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~33856~.
000010a8.00000560::2021/10/23-08:09:05.347 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~33856~).
000010a8.00000560::2021/10/23-08:09:05.347 INFO  [SV] Got a new incoming stream from 10.16.1.75:~33856~
000010a8.00000560::2021/10/23-08:09:05.347 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 3785717419, 65536'
000010a8.00000560::2021/10/23-08:09:05.347 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:05.630 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~33842~.
000010a8.00000560::2021/10/23-08:09:05.630 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~33842~).
000010a8.00000560::2021/10/23-08:09:05.630 INFO  [SV] Got a new incoming stream from 10.16.1.75:~33842~
000010a8.00000560::2021/10/23-08:09:05.633 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 38437535, 65536'
000010a8.00000560::2021/10/23-08:09:05.633 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:05.703 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~48560~.
000010a8.00000560::2021/10/23-08:09:05.703 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~48560~).
000010a8.00000560::2021/10/23-08:09:05.703 INFO  [SV] Got a new incoming stream from 10.16.1.75:~48560~
000010a8.00000560::2021/10/23-08:09:05.715 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00000560::2021/10/23-08:09:05.715 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:05.717 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~48580~.
000010a8.00000560::2021/10/23-08:09:05.717 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~48580~).
000010a8.00000560::2021/10/23-08:09:05.717 INFO  [SV] Got a new incoming stream from 10.16.1.75:~48580~
000010a8.00000560::2021/10/23-08:09:05.717 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 2848327233, 65536'
000010a8.00000560::2021/10/23-08:09:05.717 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:07.432 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~42122~.
000010a8.00000560::2021/10/23-08:09:07.433 INFO  [SV] New real route: local (10.16.1.166:~3343~) to remote  (10.16.1.75:~42122~).
000010a8.00000560::2021/10/23-08:09:07.433 INFO  [SV] Got a new incoming stream from 10.16.1.75:~42122~
000010a8.000019b8::2021/10/23-08:09:09.398 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~53490~.
000010a8.00001c70::2021/10/23-08:09:09.398 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~53490~).
000010a8.00001c70::2021/10/23-08:09:09.398 INFO  [SV] Got a new incoming stream from 10.16.1.75:~53490~
00000054.000027f8::2021/10/23-08:09:11.042 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 03:09:10.823
000010a8.000019b8::2021/10/23-08:09:14.084 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~46148~.
000010a8.0000179c::2021/10/23-08:09:14.084 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~46148~).
000010a8.0000179c::2021/10/23-08:09:14.084 INFO  [SV] Got a new incoming stream from 10.16.1.75:~46148~
000010a8.0000179c::2021/10/23-08:09:14.090 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.0000179c::2021/10/23-08:09:14.090 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:14.110 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~46212~.
000010a8.0000179c::2021/10/23-08:09:14.111 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~46212~).
000010a8.0000179c::2021/10/23-08:09:14.111 INFO  [SV] Got a new incoming stream from 10.16.1.75:~46212~
000010a8.0000179c::2021/10/23-08:09:14.111 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 1029990759, 65536'
000010a8.0000179c::2021/10/23-08:09:14.111 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:19.669 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~55414~.
000010a8.0000179c::2021/10/23-08:09:19.669 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~55414~).
000010a8.000019b8::2021/10/23-08:09:19.669 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~45572~.
000010a8.0000179c::2021/10/23-08:09:19.669 INFO  [SV] Got a new incoming stream from 10.16.1.75:~55414~
000010a8.000025f0::2021/10/23-08:09:19.669 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~45572~).
000010a8.000025f0::2021/10/23-08:09:19.669 INFO  [SV] Got a new incoming stream from 10.16.1.75:~45572~
00000054.000027f8::2021/10/23-08:09:21.027 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 03:09:20.863
000010a8.000019b8::2021/10/23-08:09:21.761 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~58610~.
000010a8.00002bfc::2021/10/23-08:09:21.762 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~58610~).
000010a8.00002bfc::2021/10/23-08:09:21.762 INFO  [SV] Got a new incoming stream from 10.16.1.75:~58610~
000010a8.00002bfc::2021/10/23-08:09:21.763 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00002bfc::2021/10/23-08:09:21.763 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:21.777 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~58642~.
000010a8.00002bfc::2021/10/23-08:09:21.777 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~58642~).
000010a8.00002bfc::2021/10/23-08:09:21.777 INFO  [SV] Got a new incoming stream from 10.16.1.75:~58642~
000010a8.00002bfc::2021/10/23-08:09:21.777 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 3997904168, 65536'
000010a8.00002bfc::2021/10/23-08:09:21.777 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:22.003 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~33116~.
000010a8.00002bfc::2021/10/23-08:09:22.003 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~33116~).
000010a8.00002bfc::2021/10/23-08:09:22.003 INFO  [SV] Got a new incoming stream from 10.16.1.75:~33116~
000010a8.00002bfc::2021/10/23-08:09:22.006 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00002bfc::2021/10/23-08:09:22.006 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:22.019 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~33138~.
000010a8.00002bfc::2021/10/23-08:09:22.019 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~33138~).
000010a8.00002bfc::2021/10/23-08:09:22.019 INFO  [SV] Got a new incoming stream from 10.16.1.75:~33138~
000010a8.00002bfc::2021/10/23-08:09:22.020 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 2154831575, 65536'
000010a8.00002bfc::2021/10/23-08:09:22.020 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:22.960 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~34498~.
000010a8.00002bfc::2021/10/23-08:09:22.961 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~34498~).
000010a8.00002bfc::2021/10/23-08:09:22.961 INFO  [SV] Got a new incoming stream from 10.16.1.75:~34498~
000010a8.00002bfc::2021/10/23-08:09:23.013 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00002bfc::2021/10/23-08:09:23.013 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:23.018 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~34616~.
000010a8.00002bfc::2021/10/23-08:09:23.018 INFO  [SV] New real route: local (10.16.1.164:~3343~) to remote  (10.16.1.75:~34616~).
000010a8.00002bfc::2021/10/23-08:09:23.018 INFO  [SV] Got a new incoming stream from 10.16.1.75:~34616~
000010a8.00002bfc::2021/10/23-08:09:23.044 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 1029990759, 65536'
000010a8.00002bfc::2021/10/23-08:09:23.044 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:23.438 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~50720~.
000010a8.00002bfc::2021/10/23-08:09:23.438 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~50720~).
000010a8.00002bfc::2021/10/23-08:09:23.438 INFO  [SV] Got a new incoming stream from 10.16.1.75:~50720~
000010a8.00002bfc::2021/10/23-08:09:23.438 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00002bfc::2021/10/23-08:09:23.438 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:23.477 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~50770~.
000010a8.00002bfc::2021/10/23-08:09:23.477 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~50770~).
000010a8.00002bfc::2021/10/23-08:09:23.477 INFO  [SV] Got a new incoming stream from 10.16.1.75:~50770~
000010a8.00002bfc::2021/10/23-08:09:23.484 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 1029990759, 65536'
000010a8.00002bfc::2021/10/23-08:09:23.484 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:23.839 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~32952~.
000010a8.00002bfc::2021/10/23-08:09:23.839 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~32952~).
000010a8.00002bfc::2021/10/23-08:09:23.839 INFO  [SV] Got a new incoming stream from 10.16.1.75:~32952~
000010a8.00002bfc::2021/10/23-08:09:23.841 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00002bfc::2021/10/23-08:09:23.841 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:23.845 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~32964~.
000010a8.00002bfc::2021/10/23-08:09:23.845 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~32964~).
000010a8.00002bfc::2021/10/23-08:09:23.845 INFO  [SV] Got a new incoming stream from 10.16.1.75:~32964~
000010a8.00002bfc::2021/10/23-08:09:23.846 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 1029990759, 65536'
000010a8.00002bfc::2021/10/23-08:09:23.846 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:25.733 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~53570~.
000010a8.00002bfc::2021/10/23-08:09:25.734 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~53570~).
000010a8.00002bfc::2021/10/23-08:09:25.734 INFO  [SV] Got a new incoming stream from 10.16.1.75:~53570~
000010a8.00002bfc::2021/10/23-08:09:25.734 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00002bfc::2021/10/23-08:09:25.734 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:25.736 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~53572~.
000010a8.00002bfc::2021/10/23-08:09:25.736 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~53572~).
000010a8.00002bfc::2021/10/23-08:09:25.736 INFO  [SV] Got a new incoming stream from 10.16.1.75:~53572~
000010a8.00002bfc::2021/10/23-08:09:25.736 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 3479258706, 65536'
000010a8.00002bfc::2021/10/23-08:09:25.736 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:26.484 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~36058~.
000010a8.00002bfc::2021/10/23-08:09:26.484 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~36058~).
000010a8.00002bfc::2021/10/23-08:09:26.484 INFO  [SV] Got a new incoming stream from 10.16.1.75:~36058~
000010a8.00002bfc::2021/10/23-08:09:26.484 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00002bfc::2021/10/23-08:09:26.484 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:09:26.486 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~36060~.
000010a8.00002bfc::2021/10/23-08:09:26.487 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~36060~).
000010a8.00002bfc::2021/10/23-08:09:26.487 INFO  [SV] Got a new incoming stream from 10.16.1.75:~36060~
000010a8.00002bfc::2021/10/23-08:09:26.487 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 33620758, 2854666091, 65536'
000010a8.00002bfc::2021/10/23-08:09:26.487 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00002bfc::2021/10/23-08:09:30.832 WARN  Unhandled exception on the thread 11260, exception The requested operation is not supported.
00000054.000027f8::2021/10/23-08:09:31.043 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 03:09:30.877
000010a8.000019b8::2021/10/23-08:09:32.381 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~41220~.
000010a8.00000668::2021/10/23-08:09:32.381 INFO  [SV] New real route: local (10.16.1.165:~3343~) to remote  (10.16.1.75:~41220~).
000010a8.00000668::2021/10/23-08:09:32.381 INFO  [SV] Got a new incoming stream from 10.16.1.75:~41220~
0000023c.0000131c::2021/10/23-08:09:41.847 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000115c::2021/10/23-08:10:03.533 WARN  [Schannel] Authentication timed out (60 sec), closing stream...
000010a8.000028f4::2021/10/23-08:10:03.533 INFO  [CHANNEL 10.16.1.75:~33628~] graceful close, status (of previous failure, may not indicate problem) (0)
000010a8.000028f4::2021/10/23-08:10:03.533 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: GracefulClose(1226)' because of 'channel to remote endpoint 10.16.1.75:~33628~ is closed'
000010a8.000028f4::2021/10/23-08:10:03.533 WARN  mscs::ListenerWorker::operator (): HrError(0x000004ca)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000028f4::2021/10/23-08:10:07.442 WARN  [Schannel] Authentication timed out (60 sec), closing stream...
000010a8.00000560::2021/10/23-08:10:07.442 INFO  [CHANNEL 10.16.1.75:~42122~] graceful close, status (of previous failure, may not indicate problem) (0)
000010a8.00000560::2021/10/23-08:10:07.442 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: GracefulClose(1226)' because of 'channel to remote endpoint 10.16.1.75:~42122~ is closed'
000010a8.00000560::2021/10/23-08:10:07.442 WARN  mscs::ListenerWorker::operator (): HrError(0x000004ca)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00001c70::2021/10/23-08:10:09.402 WARN  [CHANNEL 10.16.1.75:~53490~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00001c70::2021/10/23-08:10:09.402 WARN  [CHANNEL 10.16.1.75:~53490~] failure, status 10054
000010a8.00001c70::2021/10/23-08:10:09.402 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~53490~ has failed with status 10054'
000010a8.00001c70::2021/10/23-08:10:09.402 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.0000179c::2021/10/23-08:10:19.669 WARN  [CHANNEL 10.16.1.75:~55414~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.0000179c::2021/10/23-08:10:19.669 WARN  [CHANNEL 10.16.1.75:~55414~] failure, status 10054
000010a8.0000179c::2021/10/23-08:10:19.669 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~55414~ has failed with status 10054'
000010a8.0000179c::2021/10/23-08:10:19.669 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000025f0::2021/10/23-08:10:19.669 WARN  [CHANNEL 10.16.1.75:~45572~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.000025f0::2021/10/23-08:10:19.669 WARN  [CHANNEL 10.16.1.75:~45572~] failure, status 10054
000010a8.000025f0::2021/10/23-08:10:19.669 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~45572~ has failed with status 10054'
000010a8.000025f0::2021/10/23-08:10:19.669 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00000668::2021/10/23-08:10:32.383 WARN  [CHANNEL 10.16.1.75:~41220~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00000668::2021/10/23-08:10:32.383 WARN  [CHANNEL 10.16.1.75:~41220~] failure, status 10054
000010a8.00000668::2021/10/23-08:10:32.385 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~41220~ has failed with status 10054'
000010a8.00000668::2021/10/23-08:10:32.385 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00000668::2021/10/23-08:10:33.083 INFO  [GUM] Node 1: executing request locally, gumId:25642, my action: /dm/update, # of updates: 1
000010a8.00000668::2021/10/23-08:10:33.084 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:343 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:10:34.426 INFO  [GUM] Node 1: executing request locally, gumId:25643, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:10:34.427 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:344 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:10:34.921 INFO  [GUM] Node 1: executing request locally, gumId:25644, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:10:34.922 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:345 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:10:34.964 INFO  [GUM] Node 1: executing request locally, gumId:25645, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:10:34.965 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:346 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:10:35.054 INFO  [GUM] Node 1: executing request locally, gumId:25646, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:10:35.054 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:347 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000179c::2021/10/23-08:10:36.097 INFO  [GUM] Node 1: executing request locally, gumId:25647, my action: /dm/update, # of updates: 1
000010a8.0000179c::2021/10/23-08:10:36.097 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:348 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000179c::2021/10/23-08:10:36.326 INFO  [GUM] Node 1: executing request locally, gumId:25648, my action: /dm/update, # of updates: 1
000010a8.0000179c::2021/10/23-08:10:36.326 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:349 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:10:36.367 INFO  [GUM] Node 1: executing request locally, gumId:25649, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:10:36.367 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:350 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000179c::2021/10/23-08:10:36.408 INFO  [GUM] Node 1: executing request locally, gumId:25650, my action: /dm/update, # of updates: 2
000010a8.0000179c::2021/10/23-08:10:36.409 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:351 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000179c::2021/10/23-08:10:37.071 INFO  [GUM] Node 1: executing request locally, gumId:25651, my action: /dm/update, # of updates: 1
000010a8.0000179c::2021/10/23-08:10:37.072 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:352 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000179c::2021/10/23-08:10:37.537 INFO  [GUM] Node 1: executing request locally, gumId:25652, my action: /dm/update, # of updates: 1
000010a8.0000179c::2021/10/23-08:10:37.538 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:353 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000179c::2021/10/23-08:10:38.001 INFO  [GUM] Node 1: executing request locally, gumId:25653, my action: /dm/update, # of updates: 1
000010a8.0000179c::2021/10/23-08:10:38.002 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:354 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:10:38.044 INFO  [GUM] Node 1: executing request locally, gumId:25654, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:10:38.044 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:355 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000179c::2021/10/23-08:10:38.085 INFO  [GUM] Node 1: executing request locally, gumId:25655, my action: /dm/update, # of updates: 1
000010a8.0000179c::2021/10/23-08:10:38.086 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:356 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000179c::2021/10/23-08:10:38.171 INFO  [GUM] Node 1: executing request locally, gumId:25656, my action: /dm/update, # of updates: 1
000010a8.0000179c::2021/10/23-08:10:38.172 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:357 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001c70::2021/10/23-08:10:38.214 INFO  [GUM] Node 1: executing request locally, gumId:25657, my action: /dm/update, # of updates: 1
000010a8.00001c70::2021/10/23-08:10:38.215 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:358 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000179c::2021/10/23-08:10:38.309 INFO  [GUM] Node 1: executing request locally, gumId:25658, my action: /dm/update, # of updates: 1
000010a8.0000179c::2021/10/23-08:10:38.310 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:359 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001c70::2021/10/23-08:10:38.351 INFO  [GUM] Node 1: executing request locally, gumId:25659, my action: /dm/update, # of updates: 2
000010a8.00001c70::2021/10/23-08:10:38.352 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:360 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:10:38.413 INFO  [GUM] Node 1: executing request locally, gumId:25660, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:10:38.413 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:361 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:10:38.493 INFO  [GUM] Node 1: executing request locally, gumId:25661, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:10:38.494 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:362 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:10:38.598 INFO  [GUM] Node 1: executing request locally, gumId:25662, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:10:38.599 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:363 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:10:38.826 INFO  [GUM] Node 1: executing request locally, gumId:25663, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:10:38.826 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:364 from node 1. Action: gum/do-update, Target: GUMA
0000023c.00000678::2021/10/23-08:10:45.385 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-08:10:49.897 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 03:10:49.853
00000054.000027f8::2021/10/23-08:11:00.172 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 03:10:59.893
00000054.000027f8::2021/10/23-08:11:40.147 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 03:11:39.973
0000023c.000026c8::2021/10/23-08:11:42.391 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-08:12:01.702 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 03:12:00.393
0000243c.000008ac::2021/10/23-08:12:04.017 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Re-registering DNS records because time '86407' between previous registration and now is greater than '86400'
0000243c.000008ac::2021/10/23-08:12:04.017 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Stopping health check because DNS recheck configuration is needed
0000243c.000008ac::2021/10/23-08:12:04.017 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Dns - Rechecking config internally
0000243c.000008ac::2021/10/23-08:12:04.395 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000008ac::2021/10/23-08:12:04.395 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000008ac::2021/10/23-08:12:04.395 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:12:04.395 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.166 Prefix: 10.16.1.166/24 (Actual address: 10.16.1.166), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.166 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.166 Prefix: 10.30.0.166/24)
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.166
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.166
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.164
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.165
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.166
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.000008ac::2021/10/23-08:12:04.396 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Registering into DNS Name: mydb4(Type: Singleton)...
0000243c.000008ac::2021/10/23-08:12:04.403 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Impersonating VCO User 'mydb4$' to Update DNS registration.  IsCore? false
0000243c.00002994::2021/10/23-08:12:04.403 INFO  [RES] Network Name <mydb4_mydb4>: Identity: Get Token Request, currently has a token
0000243c.000008ac::2021/10/23-08:12:04.403 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.000008ac::2021/10/23-08:12:04.403 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.000008ac::2021/10/23-08:12:04.403 INFO  [RES] Network Name: [NNLIB] Registering name mydb4on DNS Network: Cluster Network 1, with 2 DNS Servers, 2 Virtual Addresses, 1 Domain Names
0000243c.000008ac::2021/10/23-08:12:04.403 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.000008ac::2021/10/23-08:12:04.403 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.000008ac::2021/10/23-08:12:04.403 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.166
0000243c.000008ac::2021/10/23-08:12:04.403 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.166
0000243c.000008ac::2021/10/23-08:12:04.403 INFO  [RES] Network Name: [NNLIB] Registering: mydb4.domain.local
0000243c.000008ac::2021/10/23-08:12:04.482 INFO  [RES] Network Name: [NNLIB] DNS Record there for mydb4.domain.local, proceeding
0000243c.000008ac::2021/10/23-08:12:04.643 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn mydb4.domain.local (ipv4Count 2, ipv6Count 0)
0000243c.000008ac::2021/10/23-08:12:04.643 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.000008ac::2021/10/23-08:12:04.723 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner mydb4.domain.local (registered sets: 1, ipv4Count 2, ipv6Count 0, ptrCount 2)
0000243c.000008ac::2021/10/23-08:12:04.723 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.000008ac::2021/10/23-08:12:04.723 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Completed DNS Registration for Name: mydb4(Type: Singleton)
0000243c.00002994::2021/10/23-08:12:04.723 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Updating status after a DNS registration
0000243c.000008ac::2021/10/23-08:12:04.724 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Last Dns Update time changed
000010a8.000025f0::2021/10/23-08:12:04.724 INFO  [GUM] Node 1: executing request locally, gumId:25664, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:12:04.724 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:365 from node 1. Action: gum/do-update, Target: GUMA
0000243c.000008ac::2021/10/23-08:12:04.767 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.00002994::2021/10/23-08:12:04.767 INFO  [RES] Network Name <mydb4_mydb4>: Client: Synching with slow operation
0000243c.000008ac::2021/10/23-08:12:04.853 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000008ac::2021/10/23-08:12:04.853 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000008ac::2021/10/23-08:12:04.853 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:12:04.853 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000008ac::2021/10/23-08:12:04.854 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000008ac::2021/10/23-08:12:04.854 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000008ac::2021/10/23-08:12:04.854 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000008ac::2021/10/23-08:12:04.854 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.166 Prefix: 10.16.1.166/24 (Actual address: 10.16.1.166), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000008ac::2021/10/23-08:12:04.854 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.166 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.166 Prefix: 10.30.0.166/24)
0000243c.000008ac::2021/10/23-08:12:04.854 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000008ac::2021/10/23-08:12:04.854 INFO  [RES] Network Name <mydb4_mydb4>: Client: Final alias is 10.16.1.166
0000243c.000008ac::2021/10/23-08:12:04.854 INFO  [RES] Network Name <mydb4_mydb4>: Client: RegisterFqdnWithLsa - Found FQDN mydb4.domain.local that is already registered with LSA
0000243c.000008ac::2021/10/23-08:12:04.854 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: InternalReplyHandler: 0
0000243c.000008ac::2021/10/23-08:12:05.548 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Re-registering DNS records because time '86407' between previous registration and now is greater than '86400'
0000243c.000008ac::2021/10/23-08:12:05.548 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Stopping health check because DNS recheck configuration is needed
0000243c.000008ac::2021/10/23-08:12:05.548 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Dns - Rechecking config internally
0000243c.000008ac::2021/10/23-08:12:05.828 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000008ac::2021/10/23-08:12:05.828 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000008ac::2021/10/23-08:12:05.828 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:12:05.828 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000008ac::2021/10/23-08:12:05.829 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000008ac::2021/10/23-08:12:05.829 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000008ac::2021/10/23-08:12:05.829 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.164 Prefix: 10.16.1.164/24 (Actual address: 10.16.1.164), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.164 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.164 Prefix: 10.30.0.164/24)
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.164
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.164
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.164
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.165
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.166
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.000008ac::2021/10/23-08:12:05.830 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Registering into DNS Name: mydb2 (Type: Singleton)...
0000243c.000008ac::2021/10/23-08:12:05.836 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Impersonating VCO User 'mydb2$' to Update DNS registration.  IsCore? false
0000243c.00000a98::2021/10/23-08:12:05.837 INFO  [RES] Network Name <mydb2_mydb2>: Identity: Get Token Request, currently has a token
0000243c.000008ac::2021/10/23-08:12:05.837 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.000008ac::2021/10/23-08:12:05.837 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.000008ac::2021/10/23-08:12:05.837 INFO  [RES] Network Name: [NNLIB] Registering name mydb2 on DNS Network: Cluster Network 1, with 2 DNS Servers, 2 Virtual Addresses, 1 Domain Names
0000243c.000008ac::2021/10/23-08:12:05.837 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.000008ac::2021/10/23-08:12:05.837 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.000008ac::2021/10/23-08:12:05.837 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.164
0000243c.000008ac::2021/10/23-08:12:05.837 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.164
0000243c.000008ac::2021/10/23-08:12:05.837 INFO  [RES] Network Name: [NNLIB] Registering: mydb2.domain.local
0000243c.000008ac::2021/10/23-08:12:06.260 INFO  [RES] Network Name: [NNLIB] DNS Record there for mydb2.domain.local, proceeding
0000243c.000008ac::2021/10/23-08:12:06.421 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn mydb2.domain.local (ipv4Count 2, ipv6Count 0)
0000243c.000008ac::2021/10/23-08:12:06.421 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.000008ac::2021/10/23-08:12:06.501 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner mydb2.domain.local (registered sets: 1, ipv4Count 2, ipv6Count 0, ptrCount 2)
0000243c.000008ac::2021/10/23-08:12:06.501 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.000008ac::2021/10/23-08:12:06.501 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Completed DNS Registration for Name: mydb2 (Type: Singleton)
0000243c.00002994::2021/10/23-08:12:06.501 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Updating status after a DNS registration
0000243c.000008ac::2021/10/23-08:12:06.501 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Last Dns Update time changed
000010a8.00000560::2021/10/23-08:12:06.501 INFO  [GUM] Node 1: executing request locally, gumId:25665, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:12:06.502 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:366 from node 1. Action: gum/do-update, Target: GUMA
0000243c.000008ac::2021/10/23-08:12:06.543 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.00000a98::2021/10/23-08:12:06.543 INFO  [RES] Network Name <mydb2_mydb2>: Client: Synching with slow operation
0000243c.000008ac::2021/10/23-08:12:07.036 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000008ac::2021/10/23-08:12:07.036 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000008ac::2021/10/23-08:12:07.036 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:12:07.036 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000008ac::2021/10/23-08:12:07.037 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000008ac::2021/10/23-08:12:07.037 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000008ac::2021/10/23-08:12:07.037 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000008ac::2021/10/23-08:12:07.037 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.164 Prefix: 10.16.1.164/24 (Actual address: 10.16.1.164), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000008ac::2021/10/23-08:12:07.037 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.164 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.164 Prefix: 10.30.0.164/24)
0000243c.000008ac::2021/10/23-08:12:07.037 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000008ac::2021/10/23-08:12:07.037 INFO  [RES] Network Name <mydb2_mydb2>: Client: Final alias is 10.16.1.164
0000243c.000008ac::2021/10/23-08:12:07.037 INFO  [RES] Network Name <mydb2_mydb2>: Client: RegisterFqdnWithLsa - Found FQDN mydb2.domain.local that is already registered with LSA
0000243c.000008ac::2021/10/23-08:12:07.037 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: InternalReplyHandler: 0
0000243c.00000a98::2021/10/23-08:12:11.346 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Re-registering DNS records because time '86407' between previous registration and now is greater than '86400'
0000243c.00000a98::2021/10/23-08:12:11.346 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Stopping health check because DNS recheck configuration is needed
0000243c.00000a98::2021/10/23-08:12:11.346 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Dns - Rechecking config internally
0000243c.00000a98::2021/10/23-08:12:11.351 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet]                  DNS Suffix:
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00000a98::2021/10/23-08:12:11.351 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00000a98::2021/10/23-08:12:11.351 DBG   [ClNet]                  DNS Suffix:
0000243c.00000a98::2021/10/23-08:12:11.351 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.163 Prefix: 10.16.1.163/24 (Actual address: 10.16.1.163), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.163 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.163 Prefix: 10.30.0.163/24)
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.163
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.163
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.164
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.165
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.166
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.00000a98::2021/10/23-08:12:11.352 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Registering into DNS Name: mydb1 (Type: Singleton)...
0000243c.00000a98::2021/10/23-08:12:11.358 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Impersonating VCO User 'mydb1$' to Update DNS registration.  IsCore? false
0000243c.000008ac::2021/10/23-08:12:11.359 INFO  [RES] Network Name <mydb1_mydb1>: Identity: Get Token Request, currently has a token
0000243c.00000a98::2021/10/23-08:12:11.359 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.00000a98::2021/10/23-08:12:11.359 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.00000a98::2021/10/23-08:12:11.359 INFO  [RES] Network Name: [NNLIB] Registering name mydb1 on DNS Network: Cluster Network 1, with 2 DNS Servers, 2 Virtual Addresses, 1 Domain Names
0000243c.00000a98::2021/10/23-08:12:11.359 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000a98::2021/10/23-08:12:11.359 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000a98::2021/10/23-08:12:11.359 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.163
0000243c.00000a98::2021/10/23-08:12:11.359 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.163
0000243c.00000a98::2021/10/23-08:12:11.359 INFO  [RES] Network Name: [NNLIB] Registering: mydb1.domain.local
0000243c.00000a98::2021/10/23-08:12:11.438 INFO  [RES] Network Name: [NNLIB] DNS Record there for mydb1.domain.local, proceeding
0000243c.00000a98::2021/10/23-08:12:11.598 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn mydb1.domain.local (ipv4Count 2, ipv6Count 0)
0000243c.00000a98::2021/10/23-08:12:11.598 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.00000a98::2021/10/23-08:12:11.678 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner mydb1.domain.local (registered sets: 1, ipv4Count 2, ipv6Count 0, ptrCount 2)
0000243c.00000a98::2021/10/23-08:12:11.678 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.00000a98::2021/10/23-08:12:11.678 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Completed DNS Registration for Name: mydb1 (Type: Singleton)
0000243c.00002994::2021/10/23-08:12:11.678 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Updating status after a DNS registration
0000243c.00002994::2021/10/23-08:12:11.678 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Last Dns Update time changed
000010a8.0000115c::2021/10/23-08:12:11.678 INFO  [GUM] Node 1: executing request locally, gumId:25666, my action: /dm/update, # of updates: 1
000010a8.0000115c::2021/10/23-08:12:11.679 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:367 from node 1. Action: gum/do-update, Target: GUMA
0000243c.00002994::2021/10/23-08:12:11.721 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.00000a98::2021/10/23-08:12:11.721 INFO  [RES] Network Name <mydb1_mydb1>: Client: Synching with slow operation
0000243c.00002994::2021/10/23-08:12:12.165 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet]                  DNS Suffix:
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00002994::2021/10/23-08:12:12.165 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00002994::2021/10/23-08:12:12.165 DBG   [ClNet]                  DNS Suffix:
0000243c.00002994::2021/10/23-08:12:12.165 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00002994::2021/10/23-08:12:12.166 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00002994::2021/10/23-08:12:12.166 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00002994::2021/10/23-08:12:12.166 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00002994::2021/10/23-08:12:12.166 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.163 Prefix: 10.16.1.163/24 (Actual address: 10.16.1.163), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00002994::2021/10/23-08:12:12.166 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.163 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.163 Prefix: 10.30.0.163/24)
0000243c.00002994::2021/10/23-08:12:12.166 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00002994::2021/10/23-08:12:12.166 INFO  [RES] Network Name <mydb1_mydb1>: Client: Final alias is 10.16.1.163
0000243c.00002994::2021/10/23-08:12:12.166 INFO  [RES] Network Name <mydb1_mydb1>: Client: RegisterFqdnWithLsa - Found FQDN mydb1.domain.local that is already registered with LSA
0000243c.00002994::2021/10/23-08:12:12.166 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: InternalReplyHandler: 0
0000243c.00002994::2021/10/23-08:12:12.753 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Re-registering DNS records because time '86407' between previous registration and now is greater than '86400'
0000243c.00002994::2021/10/23-08:12:12.753 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Stopping health check because DNS recheck configuration is needed
0000243c.00002994::2021/10/23-08:12:12.753 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Dns - Rechecking config internally
0000243c.00002994::2021/10/23-08:12:13.176 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet]                  DNS Suffix:
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00002994::2021/10/23-08:12:13.176 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00002994::2021/10/23-08:12:13.176 DBG   [ClNet]                  DNS Suffix:
0000243c.00002994::2021/10/23-08:12:13.176 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.165 Prefix: 10.16.1.165/24 (Actual address: 10.16.1.165), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.165 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.165 Prefix: 10.30.0.165/24)
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.165
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.165
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.164
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.165
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.166
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.00002994::2021/10/23-08:12:13.177 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Registering into DNS Name: mydb3 (Type: Singleton)...
0000243c.00002994::2021/10/23-08:12:13.184 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Impersonating VCO User 'mydb3$' to Update DNS registration.  IsCore? false
0000243c.00000a98::2021/10/23-08:12:13.184 INFO  [RES] Network Name <mydb3_mydb3>: Identity: Get Token Request, currently has a token
0000243c.00002994::2021/10/23-08:12:13.184 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.00002994::2021/10/23-08:12:13.184 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.00002994::2021/10/23-08:12:13.184 INFO  [RES] Network Name: [NNLIB] Registering name mydb3 on DNS Network: Cluster Network 1, with 2 DNS Servers, 2 Virtual Addresses, 1 Domain Names
0000243c.00002994::2021/10/23-08:12:13.184 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00002994::2021/10/23-08:12:13.184 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00002994::2021/10/23-08:12:13.184 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.165
0000243c.00002994::2021/10/23-08:12:13.184 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.165
0000243c.00002994::2021/10/23-08:12:13.184 INFO  [RES] Network Name: [NNLIB] Registering: mydb3.domain.local
0000243c.00002994::2021/10/23-08:12:13.263 INFO  [RES] Network Name: [NNLIB] DNS Record there for mydb3.domain.local, proceeding
0000243c.00002994::2021/10/23-08:12:13.424 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn mydb3.domain.local (ipv4Count 2, ipv6Count 0)
0000243c.00002994::2021/10/23-08:12:13.424 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.00002994::2021/10/23-08:12:13.504 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner mydb3.domain.local (registered sets: 1, ipv4Count 2, ipv6Count 0, ptrCount 2)
0000243c.00002994::2021/10/23-08:12:13.504 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.00002994::2021/10/23-08:12:13.504 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Completed DNS Registration for Name: mydb3 (Type: Singleton)
0000243c.00000a98::2021/10/23-08:12:13.504 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Updating status after a DNS registration
0000243c.00002994::2021/10/23-08:12:13.504 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Last Dns Update time changed
000010a8.0000115c::2021/10/23-08:12:13.504 INFO  [GUM] Node 1: executing request locally, gumId:25667, my action: /dm/update, # of updates: 1
000010a8.0000115c::2021/10/23-08:12:13.505 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:368 from node 1. Action: gum/do-update, Target: GUMA
0000243c.00002994::2021/10/23-08:12:13.554 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.000008ac::2021/10/23-08:12:13.554 INFO  [RES] Network Name <mydb3_mydb3>: Client: Synching with slow operation
0000243c.00002994::2021/10/23-08:12:13.956 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet]                  DNS Suffix:
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00002994::2021/10/23-08:12:13.956 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00002994::2021/10/23-08:12:13.956 DBG   [ClNet]                  DNS Suffix:
0000243c.00002994::2021/10/23-08:12:13.956 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00002994::2021/10/23-08:12:13.957 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00002994::2021/10/23-08:12:13.957 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00002994::2021/10/23-08:12:13.957 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00002994::2021/10/23-08:12:13.957 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.165 Prefix: 10.16.1.165/24 (Actual address: 10.16.1.165), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00002994::2021/10/23-08:12:13.957 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.165 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.165 Prefix: 10.30.0.165/24)
0000243c.00002994::2021/10/23-08:12:13.957 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00002994::2021/10/23-08:12:13.957 INFO  [RES] Network Name <mydb3_mydb3>: Client: Final alias is 10.16.1.165
0000243c.00002994::2021/10/23-08:12:13.957 INFO  [RES] Network Name <mydb3_mydb3>: Client: RegisterFqdnWithLsa - Found FQDN mydb3.domain.local that is already registered with LSA
0000243c.00002994::2021/10/23-08:12:13.957 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: InternalReplyHandler: 0
00000054.00001ae8::2021/10/23-08:12:21.086 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID '010c15c7-6b6a-4c70-a40a-1c918e69010c' did not receive healthinformation before HealthCheckTimeout
00000054.00001ae8::2021/10/23-08:12:21.086 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00001ae8::2021/10/23-08:12:21.086 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Resource Alive result 0.
00000054.00001ae8::2021/10/23-08:12:21.086 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID '010c15c7-6b6a-4c70-a40a-1c918e69010c' did not receive healthinformation before HealthCheckTimeout
00000054.00001ae8::2021/10/23-08:12:21.086 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00001ae8::2021/10/23-08:12:21.086 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Resource Alive result 0.
00000054.00001ae8::2021/10/23-08:12:21.086 WARN  [RHS] Resource mydb4IsAlive has indicated failure.
00000054.00001ae8::2021/10/23-08:12:21.086 INFO  [RHS-WER] Scheduling WER ERROR report in 10.000. ReportId dbace6c4-5fc8-47cb-9113-31de837355ee;
000010a8.0000115c::2021/10/23-08:12:21.086 INFO  [RCM] HandleMonitorReply: FAILURENOTIFICATION for 'mydb4', gen(1) result 1/0.
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] Res mydb4: Online -> ProcessingFailure( StateUnknown )
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] TransitionToState(mydb4) Online-->ProcessingFailure.
000010a8.000028f4::2021/10/23-08:12:21.087 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:369 from node 1. Action: causal, Target: CAUS
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb4, Online --> Pending)
000010a8.0000115c::2021/10/23-08:12:21.087 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb4)
000010a8.000028f4::2021/10/23-08:12:21.087 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.000028f4::2021/10/23-08:12:21.087 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.000028f4::2021/10/23-08:12:21.087 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 010c15c7-6b6a-4c70-a40a-1c918e69010c.
000010a8.000028f4::2021/10/23-08:12:21.087 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 010c15c7-6b6a-4c70-a40a-1c918e69010c.
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] resource mydb4: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] numDependents is zero, auto-returning true
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] Greater than restartPeriod time has elapsed since first failure of mydb4, resetting failureTime and failureCount.
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] Will queue immediate restart (500 milliseconds) of mydb4after terminate is complete.
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] Res mydb4: ProcessingFailure -> WaitingToTerminate( DelayRestartingResource )
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] TransitionToState(mydb4) ProcessingFailure-->[WaitingToTerminate to DelayRestartingResource].
000010a8.000025f0::2021/10/23-08:12:21.087 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:370 from node 1. Action: causal, Target: CAUS
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] Res mydb4: [WaitingToTerminate to DelayRestartingResource] -> Terminating( DelayRestartingResource )
000010a8.0000115c::2021/10/23-08:12:21.087 INFO  [RCM] TransitionToState(mydb4) [WaitingToTerminate to DelayRestartingResource]-->[Terminating to DelayRestartingResource].
00000054.00001548::2021/10/23-08:12:21.087 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Lease Thread terminated
00000054.00002bdc::2021/10/23-08:12:21.087 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] Connect to SQL Server ...
00000054.00001ae8::2021/10/23-08:12:21.305 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID 'cde1f575-9870-4967-8751-a7a1f8915591' did not receive healthinformation before HealthCheckTimeout
00000054.00001ae8::2021/10/23-08:12:21.305 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00001ae8::2021/10/23-08:12:21.305 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Resource Alive result 0.
00000054.00001ae8::2021/10/23-08:12:21.305 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID 'cde1f575-9870-4967-8751-a7a1f8915591' did not receive healthinformation before HealthCheckTimeout
00000054.00001ae8::2021/10/23-08:12:21.305 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00001ae8::2021/10/23-08:12:21.305 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Resource Alive result 0.
00000054.00001ae8::2021/10/23-08:12:21.305 WARN  [RHS] Resource mydb2 IsAlive has indicated failure.
00000054.00001ae8::2021/10/23-08:12:21.305 INFO  [RHS-WER] Scheduling WER ERROR report in 10.000. ReportId f62377c0-3997-4e25-816a-b303e9c155ec;
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] HandleMonitorReply: FAILURENOTIFICATION for 'mydb2', gen(1) result 1/0.
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] Res mydb2: Online -> ProcessingFailure( StateUnknown )
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] TransitionToState(mydb2) Online-->ProcessingFailure.
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb2, Online --> Pending)
000010a8.0000115c::2021/10/23-08:12:21.305 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:371 from node 1. Action: causal, Target: CAUS
000010a8.000028f4::2021/10/23-08:12:21.305 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb2)
000010a8.000025f0::2021/10/23-08:12:21.305 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.000025f0::2021/10/23-08:12:21.305 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.000025f0::2021/10/23-08:12:21.305 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource cde1f575-9870-4967-8751-a7a1f8915591.
000010a8.000025f0::2021/10/23-08:12:21.305 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource cde1f575-9870-4967-8751-a7a1f8915591.
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] resource mydb2: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] numDependents is zero, auto-returning true
000010a8.0000115c::2021/10/23-08:12:21.305 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:372 from node 1. Action: causal, Target: CAUS
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] Greater than restartPeriod time has elapsed since first failure of mydb2, resetting failureTime and failureCount.
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] Will queue immediate restart (500 milliseconds) of mydb2 after terminate is complete.
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] Res mydb2: ProcessingFailure -> WaitingToTerminate( DelayRestartingResource )
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] TransitionToState(mydb2) ProcessingFailure-->[WaitingToTerminate to DelayRestartingResource].
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] Res mydb2: [WaitingToTerminate to DelayRestartingResource] -> Terminating( DelayRestartingResource )
000010a8.000028f4::2021/10/23-08:12:21.305 INFO  [RCM] TransitionToState(mydb2) [WaitingToTerminate to DelayRestartingResource]-->[Terminating to DelayRestartingResource].
00000054.00002534::2021/10/23-08:12:21.306 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Lease Thread terminated
00000054.00001ae8::2021/10/23-08:12:21.306 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] Connect to SQL Server ...
00000054.00002b80::2021/10/23-08:12:21.352 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID '03747308-1442-4ac6-8400-2a736435caa1' did not receive healthinformation before HealthCheckTimeout
00000054.00002b80::2021/10/23-08:12:21.352 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00002b80::2021/10/23-08:12:21.352 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Resource Alive result 0.
00000054.00002b80::2021/10/23-08:12:21.352 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID '03747308-1442-4ac6-8400-2a736435caa1' did not receive healthinformation before HealthCheckTimeout
00000054.00002b80::2021/10/23-08:12:21.352 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00002b80::2021/10/23-08:12:21.352 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Resource Alive result 0.
00000054.00002b80::2021/10/23-08:12:21.352 WARN  [RHS] Resource mydb3 IsAlive has indicated failure.
00000054.000005bc::2021/10/23-08:12:21.352 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID 'ec9ef420-492a-4291-8edb-8b5330386b8d' did not receive healthinformation before HealthCheckTimeout
00000054.000005bc::2021/10/23-08:12:21.352 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.000005bc::2021/10/23-08:12:21.352 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Resource Alive result 0.
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] HandleMonitorReply: FAILURENOTIFICATION for 'mydb3', gen(1) result 1/0.
00000054.00002b80::2021/10/23-08:12:21.352 INFO  [RHS-WER] Scheduling WER ERROR report in 10.000. ReportId c3807736-d99b-4a7d-a52c-82d974fdd95b;
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] Res mydb3: Online -> ProcessingFailure( StateUnknown )
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] TransitionToState(mydb3) Online-->ProcessingFailure.
00000054.000005bc::2021/10/23-08:12:21.352 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID 'ec9ef420-492a-4291-8edb-8b5330386b8d' did not receive healthinformation before HealthCheckTimeout
00000054.000005bc::2021/10/23-08:12:21.352 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Online --> Pending)
000010a8.000025f0::2021/10/23-08:12:21.352 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:373 from node 1. Action: causal, Target: CAUS
00000054.000005bc::2021/10/23-08:12:21.352 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Resource Alive result 0.
00000054.000005bc::2021/10/23-08:12:21.352 WARN  [RHS] Resource mydb1 IsAlive has indicated failure.
000010a8.000028f4::2021/10/23-08:12:21.352 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb3)
000010a8.000025f0::2021/10/23-08:12:21.352 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] resource mydb3: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.000025f0::2021/10/23-08:12:21.352 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] numDependents is zero, auto-returning true
000010a8.000025f0::2021/10/23-08:12:21.352 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 03747308-1442-4ac6-8400-2a736435caa1.
000010a8.000025f0::2021/10/23-08:12:21.352 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 03747308-1442-4ac6-8400-2a736435caa1.
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] Greater than restartPeriod time has elapsed since first failure of mydb3, resetting failureTime and failureCount.
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] Will queue immediate restart (500 milliseconds) of mydb3 after terminate is complete.
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] Res mydb3: ProcessingFailure -> WaitingToTerminate( DelayRestartingResource )
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] TransitionToState(mydb3) ProcessingFailure-->[WaitingToTerminate to DelayRestartingResource].
000010a8.000025f0::2021/10/23-08:12:21.352 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:374 from node 1. Action: causal, Target: CAUS
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] Res mydb3: [WaitingToTerminate to DelayRestartingResource] -> Terminating( DelayRestartingResource )
000010a8.000028f4::2021/10/23-08:12:21.352 INFO  [RCM] TransitionToState(mydb3) [WaitingToTerminate to DelayRestartingResource]-->[Terminating to DelayRestartingResource].
00000054.000005bc::2021/10/23-08:12:21.352 INFO  [RHS-WER] Scheduling WER ERROR report in 10.000. ReportId f32e60c7-e3fa-4b11-982e-b6b294ea836b;
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] HandleMonitorReply: FAILURENOTIFICATION for 'mydb1', gen(1) result 1/0.
00000054.00000480::2021/10/23-08:12:21.353 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Lease Thread terminated
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] Res mydb1: Online -> ProcessingFailure( StateUnknown )
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] TransitionToState(mydb1) Online-->ProcessingFailure.
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb1, Online --> Pending)
000010a8.0000115c::2021/10/23-08:12:21.353 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:375 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:12:21.353 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb1)
000010a8.0000115c::2021/10/23-08:12:21.353 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:376 from node 1. Action: causal, Target: CAUS
000010a8.000028f4::2021/10/23-08:12:21.353 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.000028f4::2021/10/23-08:12:21.353 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.000028f4::2021/10/23-08:12:21.353 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource ec9ef420-492a-4291-8edb-8b5330386b8d.
000010a8.000028f4::2021/10/23-08:12:21.353 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource ec9ef420-492a-4291-8edb-8b5330386b8d.
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] resource mydb1: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] numDependents is zero, auto-returning true
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] Greater than restartPeriod time has elapsed since first failure of mydb1, resetting failureTime and failureCount.
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] Will queue immediate restart (500 milliseconds) of mydb1 after terminate is complete.
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] Res mydb1: ProcessingFailure -> WaitingToTerminate( DelayRestartingResource )
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] TransitionToState(mydb1) ProcessingFailure-->[WaitingToTerminate to DelayRestartingResource].
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] Res mydb1: [WaitingToTerminate to DelayRestartingResource] -> Terminating( DelayRestartingResource )
000010a8.00000560::2021/10/23-08:12:21.353 INFO  [RCM] TransitionToState(mydb1) [WaitingToTerminate to DelayRestartingResource]-->[Terminating to DelayRestartingResource].
00000054.00002b80::2021/10/23-08:12:21.353 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Connect to SQL Server ...
00000054.00001980::2021/10/23-08:12:21.353 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Lease Thread terminated
00000054.000005bc::2021/10/23-08:12:21.353 INFO  [RES] SQL Server Availability Group: [hadrag] Stopping Health Worker Thread
00000054.00000220::2021/10/23-08:12:21.353 INFO  [RES] SQL Server Availability Group: [hadrag] Health worker was asked to terminate
00000054.00000220::2021/10/23-08:12:21.414 INFO  [RES] SQL Server Availability Group: [hadrag] Change diagnostics interval worker is stopped
00000054.000027f8::2021/10/23-08:12:21.414 INFO  [RES] SQL Server Availability Group: [hadrag] Diagnostics is stopped
00000054.00002870::2021/10/23-08:12:31.094 INFO  [RHS-WER] About to send WER ERROR report. Dump policy 0x137701110; ReportId 118e1c10-2699-470e-b8ce-df8227ef2405; Failure time 2021/10/23-03:12:21.086
00000054.00001aac::2021/10/23-08:12:31.104 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="System">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_1.evtx.
00000054.00000670::2021/10/23-08:12:31.105 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Application">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_2.evtx.
00000054.00000dc8::2021/10/23-08:12:31.106 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-WindowsUpdateClient/Operational">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_3.evtx.
00000054.00001368::2021/10/23-08:12:31.107 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-FailoverClustering/Operational">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_4.evtx.
00000054.00002b04::2021/10/23-08:12:31.109 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-Kernel-IoTrace/Diagnostic">*[System[TimeCreated[timediff(@SystemTime) &lt;= 600000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_5.evtx.
00000054.00002b5c::2021/10/23-08:12:31.109 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-RPC/Debug">*[System[TimeCreated[timediff(@SystemTime) &lt;= 600000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_6.evtx.
00000054.00000dc8::2021/10/23-08:12:31.122 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_3.evtx completed.
00000054.00000dc8::2021/10/23-08:12:31.122 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-Kernel-LiveDump/Analytic">*[System[TimeCreated[timediff(@SystemTime) &lt;= 1800000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_7.evtx.
00000054.00001fc0::2021/10/23-08:12:31.127 INFO  [RHS-WER] Capturing log by relogging events from ClusterLogger to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_14.etl for time range 2021/10/23-03:02:21.086 - 2021/10/23-03:12:21.086.
00000054.00000358::2021/10/23-08:12:31.127 INFO  [RHS-WER] Capturing log by relogging events from ClusterRhsErrorLogger to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_15.etl for time range 2021/10/23-03:02:21.086 - 2021/10/23-03:12:21.086.
00000054.00000358::2021/10/23-08:12:31.130 WARN  [RHS-WER] Capture ClusterRhsErrorLogger failed HrError(0x80070002).
00000054.00001fc0::2021/10/23-08:12:31.130 WARN  [RHS-WER] Capture ClusterLogger failed HrError(0x80070002).
00000054.0000090c::2021/10/23-08:12:31.314 INFO  [RHS-WER] 219 milliseconds (0 seconds) passed since last WER ERROR report 118e1c10-2699-470e-b8ce-df8227ef2405 for the resource type SQL Server Availability Group call type ISALIVE. Throttling this report
00000054.0000090c::2021/10/23-08:12:31.360 INFO  [RHS-WER] 266 milliseconds (0 seconds) passed since last WER ERROR report 118e1c10-2699-470e-b8ce-df8227ef2405 for the resource type SQL Server Availability Group call type ISALIVE. Throttling this report
00000054.0000090c::2021/10/23-08:12:31.360 INFO  [RHS-WER] 266 milliseconds (0 seconds) passed since last WER ERROR report 118e1c10-2699-470e-b8ce-df8227ef2405 for the resource type SQL Server Availability Group call type ISALIVE. Throttling this report
00000054.00002b04::2021/10/23-08:12:31.769 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_5.evtx completed.
00000054.00002b04::2021/10/23-08:12:31.769 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-FailoverClustering/Diagnostic">*[System[TimeCreated[timediff(@SystemTime) &lt;= 600000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_8.evtx.
00000054.00001368::2021/10/23-08:12:32.414 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_4.evtx completed.
00000054.00001368::2021/10/23-08:12:32.414 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-FailoverClustering/DiagnosticVerbose">*[System[TimeCreated[timediff(@SystemTime) &lt;= 300000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_9.evtx.
00000054.00001368::2021/10/23-08:12:32.888 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_9.evtx completed.
00000054.00001368::2021/10/23-08:12:32.888 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-FailoverClustering-CsvFs/Operational">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_10.evtx.
00000054.00000670::2021/10/23-08:12:33.323 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_2.evtx completed.
00000054.00001aac::2021/10/23-08:12:33.323 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_1.evtx completed.
00000054.00000670::2021/10/23-08:12:33.323 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-FailoverClustering-NetFt/Operational">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_11.evtx.
00000054.00001aac::2021/10/23-08:12:33.323 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-ClusterAwareUpdating/Admin">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_12.evtx.
00000054.00002b5c::2021/10/23-08:12:33.332 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_6.evtx completed.
00000054.00000dc8::2021/10/23-08:12:33.332 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_7.evtx completed.
00000054.00002b5c::2021/10/23-08:12:33.332 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-ClusterAwareUpdating-Management/Adminn">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_13.evtx.
00000054.00001368::2021/10/23-08:12:33.806 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_10.evtx completed.
00000054.00000670::2021/10/23-08:12:34.732 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_11.evtx completed.
00000054.00002b5c::2021/10/23-08:12:35.132 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_13.evtx completed.
00000054.00001aac::2021/10/23-08:12:35.132 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_12.evtx completed.
00000054.00002b80::2021/10/23-08:12:41.374 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] ODBC Error: [08001] [Microsoft][SQL Server Native Client 11.0]TCP Provider: Timeout error [258].  (258)
00000054.00002b80::2021/10/23-08:12:41.374 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] ODBC Error: [HYT00] [Microsoft][SQL Server Native Client 11.0]Login timeout expired (0)
00000054.00002b80::2021/10/23-08:12:41.374 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] ODBC Error: [08001] [Microsoft][SQL Server Native Client 11.0]Unable to complete login process due to delay in prelogin response (258)
00000054.00002b80::2021/10/23-08:12:41.374 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Could not connect to SQL Server (rc -1)
00000054.00002b80::2021/10/23-08:12:41.374 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] SQLDisconnect returns following information
00000054.00002b80::2021/10/23-08:12:41.397 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] ODBC Error: [08003] [Microsoft][ODBC Driver Manager] Connection not open (0)
00000054.00002b80::2021/10/23-08:12:41.397 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Failed to connect to SQL Server
00000054.00002b80::2021/10/23-08:12:41.397 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Offline call failed in Terminate function
000010a8.00000560::2021/10/23-08:12:41.397 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb3', gen(2) result 0/0.
000010a8.00000560::2021/10/23-08:12:41.397 INFO  [RCM] Res mydb3: [Terminating to DelayRestartingResource] -> DelayRestartingResource( StateUnknown )
000010a8.00000560::2021/10/23-08:12:41.397 INFO  [RCM] TransitionToState(mydb3) [Terminating to DelayRestartingResource]-->DelayRestartingResource.
000010a8.00000560::2021/10/23-08:12:41.397 WARN  [RCM] Queueing immediate delay restart of resource mydb3 in 500 ms.
000010a8.0000115c::2021/10/23-08:12:41.883 INFO  [RCM] Delay-restarting mydb3 and any waiting dependents.
000010a8.0000115c::2021/10/23-08:12:41.883 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.0000115c::2021/10/23-08:12:41.883 INFO  [RCM] rcm::RcmResource::Online: bringing mydb3's provider resource 'mydb3_10.30.0.165' online.
000010a8.0000115c::2021/10/23-08:12:41.883 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.0000115c::2021/10/23-08:12:41.883 INFO  [RCM] Res mydb3_10.30.0.165: CannotComeOnlineOnThisNode -> OnlineCallIssued( StateUnknown )
000010a8.0000115c::2021/10/23-08:12:41.883 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) CannotComeOnlineOnThisNode-->OnlineCallIssued.
000010a8.0000115c::2021/10/23-08:12:41.883 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00000560::2021/10/23-08:12:41.883 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:377 from node 1. Action: causal, Target: CAUS
000010a8.0000115c::2021/10/23-08:12:41.883 INFO  [RCM] Res mydb3: DelayRestartingResource -> OnlineCallIssued( StateUnknown )
000010a8.0000115c::2021/10/23-08:12:41.883 INFO  [RCM] TransitionToState(mydb3) DelayRestartingResource-->OnlineCallIssued.
000010a8.00000560::2021/10/23-08:12:41.883 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:378 from node 1. Action: causal, Target: CAUS
000010a8.000025f0::2021/10/23-08:12:41.883 INFO  [RCM] Issuing Online(mydb3_10.30.0.165) to RHS.
000010a8.0000115c::2021/10/23-08:12:41.883 INFO  [RCM] Issuing Online(mydb3) to RHS.
0000023c.00001fa4::2021/10/23-08:12:41.883 INFO  [RES] IP Address <mydb3_10.30.0.165>: Bringing resource online...
000010a8.000025f0::2021/10/23-08:12:41.884 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3_10.30.0.165', gen(2) result 997/0.
000010a8.000025f0::2021/10/23-08:12:41.884 INFO  [RCM] Res mydb3_10.30.0.165: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.000025f0::2021/10/23-08:12:41.884 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) OnlineCallIssued-->OnlinePending.
000010a8.000025f0::2021/10/23-08:12:41.884 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3', gen(2) result 997/0.
000010a8.0000115c::2021/10/23-08:12:41.884 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:379 from node 1. Action: causal, Target: CAUS
000010a8.000025f0::2021/10/23-08:12:41.884 INFO  [RCM] Res mydb3: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.000025f0::2021/10/23-08:12:41.884 INFO  [RCM] TransitionToState(mydb3) OnlineCallIssued-->OnlinePending.
0000023c.00000bb4::2021/10/23-08:12:41.884 INFO  [RES] IP Address <mydb3_10.30.0.165>: Online thread running.
000010a8.0000115c::2021/10/23-08:12:41.884 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:380 from node 1. Action: causal, Target: CAUS
00000054.00000508::2021/10/23-08:12:41.884 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] The DeadLockTimeout property has a value of 300000
00000054.00000508::2021/10/23-08:12:41.885 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] The PendingTimeout property has a value of 180000
0000023c.00000bb4::2021/10/23-08:12:41.886 INFO  [RES] IP Address <mydb3_10.30.0.165>: Checking for network match: IP address mask 255.255.255.0, network mask 255.255.255.0 and IP address 10.30.0.165, network address 10.30.0.0, role 3.
00000054.00000508::2021/10/23-08:12:41.887 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Connect to SQL Server ...
0000023c.00000bb4::2021/10/23-08:12:41.887 ERR   [RES] IP Address <mydb3_10.30.0.165>: Open: Unable to find netinterface for node 1 on network 21dd22f5-ec20-4f7b-95e9-bce2630ae612, status 5035.
0000023c.00000bb4::2021/10/23-08:12:41.887 WARN  [RHS] Resource mydb3_10.30.0.165 has indicated that it cannot come online on this node.
000010a8.000025f0::2021/10/23-08:12:41.887 WARN  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3_10.30.0.165', gen(2) result 5015/0.
000010a8.000025f0::2021/10/23-08:12:41.887 INFO  [RCM] Res mydb3_10.30.0.165: OnlinePending -> ProcessingFailure( CannotComeOnlineOnThisNode )
000010a8.000025f0::2021/10/23-08:12:41.887 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) OnlinePending-->[ProcessingFailure to CannotComeOnlineOnThisNode].
000010a8.000025f0::2021/10/23-08:12:41.887 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb3_10.30.0.165)
000010a8.000028f4::2021/10/23-08:12:41.887 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:381 from node 1. Action: causal, Target: CAUS
000010a8.000028f4::2021/10/23-08:12:41.887 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:382 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:12:41.887 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00000560::2021/10/23-08:12:41.887 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00000560::2021/10/23-08:12:41.887 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource b6741d13-b17c-40b3-9f00-284de4b58a02.
000010a8.00000560::2021/10/23-08:12:41.887 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource b6741d13-b17c-40b3-9f00-284de4b58a02.
000010a8.000025f0::2021/10/23-08:12:41.887 INFO  [RCM] IP address resource 'mydb3_10.30.0.165' cannot come online on this node right now, but not raising any failure events
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] resource mydb3_10.30.0.165: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] Since no top level resource will be offlined by this resource's failure, resetting restartAction to 1
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] Greater than restartPeriod time has elapsed since first failure of mydb3_10.30.0.165, resetting failureTime and failureCount.
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] Res mydb3_10.30.0.165: [ProcessingFailure to CannotComeOnlineOnThisNode] -> WaitingToTerminate( CannotComeOnlineOnThisNode )
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) [ProcessingFailure to CannotComeOnlineOnThisNode]-->[WaitingToTerminate to CannotComeOnlineOnThisNode].
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] Res mydb3_10.30.0.165: [WaitingToTerminate to CannotComeOnlineOnThisNode] -> Terminating( CannotComeOnlineOnThisNode )
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) [WaitingToTerminate to CannotComeOnlineOnThisNode]-->[Terminating to CannotComeOnlineOnThisNode].
000010a8.000025f0::2021/10/23-08:12:41.888 WARN  [RCM] resource 'mydb3_10.30.0.165' has exceeded its restart limit.
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] Will retry online from long delay restart of mydb3_10.30.0.165 in 600000 milliseconds.
0000023c.00001fa4::2021/10/23-08:12:41.888 INFO  [RES] IP Address <mydb3_10.30.0.165>: Terminating resource...
0000023c.00001fa4::2021/10/23-08:12:41.888 INFO  [RES] IP Address <mydb3_10.30.0.165>: Address 10.30.0.165 on adapter [Unknown] offline.
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb3_10.30.0.165', gen(3) result 0/0.
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] Res mydb3_10.30.0.165: [Terminating to CannotComeOnlineOnThisNode] -> CannotComeOnlineOnThisNode( StateUnknown )
000010a8.000025f0::2021/10/23-08:12:41.888 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) [Terminating to CannotComeOnlineOnThisNode]-->CannotComeOnlineOnThisNode.
000010a8.00001554::2021/10/23-08:12:41.888 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:383 from node 1. Action: causal, Target: CAUS
0000243c.00002994::2021/10/23-08:12:41.889 INFO  [RES] Network Name <mydb3_mydb3>: Using provider b6741d13-b17c-40b3-9f00-284de4b58a02, ip address 10.30.0.165, mask 255.255.255.0, prefix length 24
0000243c.00002994::2021/10/23-08:12:41.889 INFO  [RES] Network Name <mydb3_mydb3>: Obtaining IP info for resource mydb3_10.16.1.165
0000243c.00002994::2021/10/23-08:12:41.890 INFO  [RES] Network Name <mydb3_mydb3>: Using provider mydb3_10.16.1.165, ip address 10.16.1.165, mask 255.255.255.0, prefix length 24
0000243c.00002994::2021/10/23-08:12:41.890 INFO  [RES] Network Name <mydb3_mydb3>: Obtaining IP info for resource mydb3_10.30.0.165
0000243c.00002994::2021/10/23-08:12:41.891 INFO  [RES] Network Name <mydb3_mydb3>: Using provider mydb3_10.30.0.165, ip address 10.30.0.165, mask 255.255.255.0, prefix length 24
0000243c.00002994::2021/10/23-08:12:41.891 INFO  [RES] Network Name <mydb3_mydb3>: Resource has 2 IPs
0000243c.00002994::2021/10/23-08:12:41.891 INFO  [RES] Network Name <mydb3_mydb3>: IP: Type Ipv4, Address 10.16.1.165:~0~, Prefix 10.16.1.165/24, Online true, Transport
0000243c.00002994::2021/10/23-08:12:41.891 INFO  [RES] Network Name <mydb3_mydb3>: IP: Type Ipv4, Address 10.30.0.165:~0~, Prefix 10.30.0.165/24, Online false, Transport
0000243c.00002994::2021/10/23-08:12:41.891 INFO  [RES] Network Name <mydb3_mydb3>: Handling provider state change finished with result: 0
0000243c.000008ac::2021/10/23-08:12:41.891 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: In ProviderStateChangeImp, bIsOnline is true, bProviderStateChangeInProgress_ is false
0000243c.000008ac::2021/10/23-08:12:41.891 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Netname is online, scheduling the timer to run after 30 seconds
0000243c.000008ac::2021/10/23-08:12:41.891 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Number of IPs that match current node id is 1. Registering mydb3 for multichannel support
0000243c.000008ac::2021/10/23-08:12:41.895 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Registering netname for multichannel support returned 0
0000023c.00001fa4::2021/10/23-08:12:47.578 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000027f8::2021/10/23-08:12:57.029 INFO  [RES] SQL Server Availability Group: [hadrag] Disconnect from SQL Server
00000054.000027f8::2021/10/23-08:12:57.030 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event logging is stopped
00000054.000027f8::2021/10/23-08:12:57.033 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event target state:
00000054.000027f8::2021/10/23-08:12:57.033 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event session summary: dropped buffers = 0, dropped events = 0
00000054.000005bc::2021/10/23-08:12:57.036 INFO  [RES] SQL Server Availability Group: [hadrag] Stopping Change Diagnostics interval Worker Thread
00000054.000005bc::2021/10/23-08:12:57.036 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Connect to SQL Server ...
000010a8.00001554::2021/10/23-08:12:57.372 INFO  [GUM] Node 1: executing request locally, gumId:25668, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:12:57.373 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:384 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:12:58.108 INFO  [GUM] Node 1: executing request locally, gumId:25669, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:12:58.108 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:385 from node 1. Action: gum/do-update, Target: GUMA
00000054.00001ae8::2021/10/23-08:12:58.713 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] The connection was established successfully
00000054.00002bdc::2021/10/23-08:12:59.037 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] The connection was established successfully
000010a8.00001554::2021/10/23-08:12:59.129 INFO  [GUM] Node 1: executing request locally, gumId:25670, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:12:59.130 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:386 from node 1. Action: gum/do-update, Target: GUMA
00000054.00000508::2021/10/23-08:12:59.162 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] The connection was established successfully
00000054.000005bc::2021/10/23-08:12:59.178 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] The connection was established successfully
00000054.00000508::2021/10/23-08:12:59.255 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Current SQL Instance is not part of Failover clustering
00000054.00000508::2021/10/23-08:12:59.255 INFO  [RES] SQL Server Availability Group: [hadrag] Starting Health Worker Thread
00000054.00000e04::2021/10/23-08:12:59.336 INFO  [RES] SQL Server Availability Group: [hadrag] XEvent session MSSQLSERVER is created with RolloverCount 10, MaxFileSizeInMBytes 100, and LogPath 'D:\MSSQL15.MSSQLSERVER\MSSQL\LOG\'
00000054.00000e04::2021/10/23-08:12:59.336 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event logging is started
00000054.00000e04::2021/10/23-08:12:59.336 INFO  [RES] SQL Server Availability Group: [hadrag] Health worker started for instance db-node-primary
00000054.00000e04::2021/10/23-08:12:59.336 INFO  [RES] SQL Server Availability Group: [hadrag] Connect to SQL Server ...
000010a8.00001554::2021/10/23-08:12:59.526 INFO  [GUM] Node 1: executing request locally, gumId:25671, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:12:59.535 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:387 from node 1. Action: gum/do-update, Target: GUMA
00000054.00000e04::2021/10/23-08:12:59.981 INFO  [RES] SQL Server Availability Group: [hadrag] The connection was established successfully
00000054.00000e04::2021/10/23-08:13:00.351 INFO  [RES] SQL Server Availability Group: [hadrag] Diagnostics is started
00000054.0000285c::2021/10/23-08:13:00.351 INFO  [RES] SQL Server Availability Group: [hadrag] Change diagnostics interval worker is started
00000054.00000e04::2021/10/23-08:13:00.352 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'system' health state has been changed from '' to 'clean' at 2021-10-23 03:13:00.293
00000054.00000e04::2021/10/23-08:13:00.368 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'resource' health state has been changed from '' to 'clean' at 2021-10-23 03:13:00.293
00000054.00000e04::2021/10/23-08:13:00.397 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from '' to 'warning' at 2021-10-23 03:13:00.293
00000054.00000e04::2021/10/23-08:13:00.397 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'io_subsystem' health state has been changed from '' to 'clean' at 2021-10-23 03:13:00.293
00000054.00002bdc::2021/10/23-08:13:01.417 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] Disconnect from SQL Server
00000054.00002bdc::2021/10/23-08:13:01.418 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] Offline call successful in Terminate function
000010a8.00001554::2021/10/23-08:13:01.418 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb4', gen(2) result 0/0.
000010a8.00001554::2021/10/23-08:13:01.418 INFO  [RCM] Res mydb4: [Terminating to DelayRestartingResource] -> DelayRestartingResource( StateUnknown )
000010a8.00001554::2021/10/23-08:13:01.418 INFO  [RCM] TransitionToState(mydb4) [Terminating to DelayRestartingResource]-->DelayRestartingResource.
000010a8.00001554::2021/10/23-08:13:01.418 WARN  [RCM] Queueing immediate delay restart of resource mydb4in 500 ms.
00000054.00001ae8::2021/10/23-08:13:01.418 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] Disconnect from SQL Server
00000054.00001ae8::2021/10/23-08:13:01.418 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] Offline call successful in Terminate function
000010a8.00001554::2021/10/23-08:13:01.419 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb2', gen(2) result 0/0.
000010a8.00001554::2021/10/23-08:13:01.419 INFO  [RCM] Res mydb2: [Terminating to DelayRestartingResource] -> DelayRestartingResource( StateUnknown )
000010a8.00001554::2021/10/23-08:13:01.419 INFO  [RCM] TransitionToState(mydb2) [Terminating to DelayRestartingResource]-->DelayRestartingResource.
000010a8.00001554::2021/10/23-08:13:01.419 WARN  [RCM] Queueing immediate delay restart of resource mydb2 in 500 ms.
000010a8.00000560::2021/10/23-08:13:01.446 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb2, 1)
000010a8.00000560::2021/10/23-08:13:01.446 INFO  [GUM] Node 1: executing request locally, gumId:25672, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00000560::2021/10/23-08:13:01.446 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb2,1)
000010a8.00000560::2021/10/23-08:13:01.447 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5010)' because of 'The specified node is already a possible owner.'
000010a8.00000560::2021/10/23-08:13:01.447 WARN  [DM] Aborting group transaction 85:85:32474+1
000010a8.00000560::2021/10/23-08:13:01.447 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'Gum handler completed as failed'
000010a8.00000560::2021/10/23-08:13:01.471 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb4, 1)
000010a8.00000560::2021/10/23-08:13:01.472 INFO  [GUM] Node 1: executing request locally, gumId:25672, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00000560::2021/10/23-08:13:01.472 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb4,1)
000010a8.00000560::2021/10/23-08:13:01.472 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5010)' because of 'The specified node is already a possible owner.'
000010a8.00000560::2021/10/23-08:13:01.472 WARN  [DM] Aborting group transaction 85:85:32474+1
000010a8.00000560::2021/10/23-08:13:01.472 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'Gum handler completed as failed'
000010a8.00000560::2021/10/23-08:13:01.535 INFO  [RCM] rcm::RcmApi::MoveGroup: (Group:mydb4Dest:1 Flags:0 MoveType:MoveType::Manual Cur.State:Pending, ContextSize:0)
000010a8.00000560::2021/10/23-08:13:01.542 INFO  [RCM] rcm::RcmApi::MoveGroup: (Group:mydb2 Dest:1 Flags:0 MoveType:MoveType::Manual Cur.State:Pending, ContextSize:0)
000010a8.00000560::2021/10/23-08:13:01.661 INFO  [RCM] rcm::RcmApi::OnlineResource: (mydb4, 0)
000010a8.00000560::2021/10/23-08:13:01.661 INFO  [RCM-rbtr] giving default token to group mydb4
000010a8.00000560::2021/10/23-08:13:01.661 INFO  [RCM] rcm::RcmResource::Online: bringing mydb4's provider resource 'mydb4_10.30.0.166' online.
000010a8.00000560::2021/10/23-08:13:01.661 INFO  [RCM-rbtr] giving default token to group mydb4
000010a8.00000560::2021/10/23-08:13:01.661 INFO  [RCM] Res mydb4_10.30.0.166: CannotComeOnlineOnThisNode -> OnlineCallIssued( StateUnknown )
000010a8.00000560::2021/10/23-08:13:01.661 INFO  [RCM] TransitionToState(mydb4_10.30.0.166) CannotComeOnlineOnThisNode-->OnlineCallIssued.
000010a8.00000560::2021/10/23-08:13:01.661 INFO  [RCM-rbtr] giving default token to group mydb4
000010a8.00001554::2021/10/23-08:13:01.661 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:388 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:13:01.661 INFO  [RCM] Res mydb4: DelayRestartingResource -> OnlineCallIssued( StateUnknown )
000010a8.00000560::2021/10/23-08:13:01.661 INFO  [RCM] TransitionToState(mydb4) DelayRestartingResource-->OnlineCallIssued.
000010a8.00000560::2021/10/23-08:13:01.661 INFO  [RCM-rbtr] giving default token to group mydb4
000010a8.000028f4::2021/10/23-08:13:01.661 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:389 from node 1. Action: causal, Target: CAUS
000010a8.0000115c::2021/10/23-08:13:01.661 INFO  [RCM] Issuing Online(mydb4_10.30.0.166) to RHS.
000010a8.00001554::2021/10/23-08:13:01.661 INFO  [RCM] Issuing Online(mydb4) to RHS.
0000023c.00002acc::2021/10/23-08:13:01.662 INFO  [RES] IP Address <mydb4_10.30.0.166>: Bringing resource online...
000010a8.000025f0::2021/10/23-08:13:01.662 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb4', gen(2) result 997/0.
0000023c.0000094c::2021/10/23-08:13:01.662 INFO  [RES] IP Address <mydb4_10.30.0.166>: Online thread running.
000010a8.000025f0::2021/10/23-08:13:01.662 INFO  [RCM] Res mydb4: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.000025f0::2021/10/23-08:13:01.662 INFO  [RCM] TransitionToState(mydb4) OnlineCallIssued-->OnlinePending.
000010a8.00001554::2021/10/23-08:13:01.662 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb4_10.30.0.166', gen(2) result 997/0.
000010a8.0000115c::2021/10/23-08:13:01.662 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:390 from node 1. Action: causal, Target: CAUS
000010a8.00001554::2021/10/23-08:13:01.662 INFO  [RCM] Res mydb4_10.30.0.166: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00001554::2021/10/23-08:13:01.662 INFO  [RCM] TransitionToState(mydb4_10.30.0.166) OnlineCallIssued-->OnlinePending.
000010a8.000028f4::2021/10/23-08:13:01.662 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:391 from node 1. Action: causal, Target: CAUS
00000054.00001d54::2021/10/23-08:13:01.663 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] The DeadLockTimeout property has a value of 300000
00000054.00001d54::2021/10/23-08:13:01.663 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] The PendingTimeout property has a value of 180000
0000023c.0000094c::2021/10/23-08:13:01.664 INFO  [RES] IP Address <mydb4_10.30.0.166>: Checking for network match: IP address mask 255.255.255.0, network mask 255.255.255.0 and IP address 10.30.0.166, network address 10.30.0.0, role 3.
00000054.00001d54::2021/10/23-08:13:01.665 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] Connect to SQL Server ...
0000023c.0000094c::2021/10/23-08:13:01.665 ERR   [RES] IP Address <mydb4_10.30.0.166>: Open: Unable to find netinterface for node 1 on network 21dd22f5-ec20-4f7b-95e9-bce2630ae612, status 5035.
0000023c.0000094c::2021/10/23-08:13:01.665 WARN  [RHS] Resource mydb4_10.30.0.166 has indicated that it cannot come online on this node.
000010a8.000025f0::2021/10/23-08:13:01.665 WARN  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb4_10.30.0.166', gen(2) result 5015/0.
000010a8.000025f0::2021/10/23-08:13:01.665 INFO  [RCM] Res mydb4_10.30.0.166: OnlinePending -> ProcessingFailure( CannotComeOnlineOnThisNode )
000010a8.000025f0::2021/10/23-08:13:01.665 INFO  [RCM] TransitionToState(mydb4_10.30.0.166) OnlinePending-->[ProcessingFailure to CannotComeOnlineOnThisNode].
000010a8.000025f0::2021/10/23-08:13:01.665 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb4_10.30.0.166)
000010a8.000028f4::2021/10/23-08:13:01.665 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:392 from node 1. Action: causal, Target: CAUS
000010a8.000025f0::2021/10/23-08:13:01.665 INFO  [RCM] IP address resource 'mydb4_10.30.0.166' cannot come online on this node right now, but not raising any failure events
000010a8.000025f0::2021/10/23-08:13:01.666 INFO  [RCM] resource mydb4_10.30.0.166: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.000025f0::2021/10/23-08:13:01.666 INFO  [RCM] Since no top level resource will be offlined by this resource's failure, resetting restartAction to 1
000010a8.000025f0::2021/10/23-08:13:01.666 INFO  [RCM] Greater than restartPeriod time has elapsed since first failure of mydb4_10.30.0.166, resetting failureTime and failureCount.
000010a8.000025f0::2021/10/23-08:13:01.666 INFO  [RCM] Res mydb4_10.30.0.166: [ProcessingFailure to CannotComeOnlineOnThisNode] -> WaitingToTerminate( CannotComeOnlineOnThisNode )
000010a8.000025f0::2021/10/23-08:13:01.666 INFO  [RCM] TransitionToState(mydb4_10.30.0.166) [ProcessingFailure to CannotComeOnlineOnThisNode]-->[WaitingToTerminate to CannotComeOnlineOnThisNode].
000010a8.000025f0::2021/10/23-08:13:01.666 INFO  [RCM] Res mydb4_10.30.0.166: [WaitingToTerminate to CannotComeOnlineOnThisNode] -> Terminating( CannotComeOnlineOnThisNode )
000010a8.000025f0::2021/10/23-08:13:01.666 INFO  [RCM] TransitionToState(mydb4_10.30.0.166) [WaitingToTerminate to CannotComeOnlineOnThisNode]-->[Terminating to CannotComeOnlineOnThisNode].
000010a8.000028f4::2021/10/23-08:13:01.666 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.000028f4::2021/10/23-08:13:01.666 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.000028f4::2021/10/23-08:13:01.666 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 33351098-97e5-4438-85e9-94d016e029aa.
000010a8.000028f4::2021/10/23-08:13:01.666 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 33351098-97e5-4438-85e9-94d016e029aa.
000010a8.000025f0::2021/10/23-08:13:01.666 WARN  [RCM] resource 'mydb4_10.30.0.166' has exceeded its restart limit.
000010a8.000025f0::2021/10/23-08:13:01.666 INFO  [RCM] Will retry online from long delay restart of mydb4_10.30.0.166 in 600000 milliseconds.
000010a8.000028f4::2021/10/23-08:13:01.666 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:393 from node 1. Action: causal, Target: CAUS
0000023c.00002acc::2021/10/23-08:13:01.666 INFO  [RES] IP Address <mydb4_10.30.0.166>: Terminating resource...
0000023c.00002acc::2021/10/23-08:13:01.666 INFO  [RES] IP Address <mydb4_10.30.0.166>: Address 10.30.0.166 on adapter [Unknown] offline.
000010a8.000028f4::2021/10/23-08:13:01.666 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb4_10.30.0.166', gen(3) result 0/0.
000010a8.000028f4::2021/10/23-08:13:01.666 INFO  [RCM] Res mydb4_10.30.0.166: [Terminating to CannotComeOnlineOnThisNode] -> CannotComeOnlineOnThisNode( StateUnknown )
000010a8.000028f4::2021/10/23-08:13:01.666 INFO  [RCM] TransitionToState(mydb4_10.30.0.166) [Terminating to CannotComeOnlineOnThisNode]-->CannotComeOnlineOnThisNode.
000010a8.00001554::2021/10/23-08:13:01.666 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:394 from node 1. Action: causal, Target: CAUS
0000243c.00000a98::2021/10/23-08:13:01.667 INFO  [RES] Network Name <mydb4_mydb4>: Using provider 33351098-97e5-4438-85e9-94d016e029aa, ip address 10.30.0.166, mask 255.255.255.0, prefix length 24
0000243c.00000a98::2021/10/23-08:13:01.667 INFO  [RES] Network Name <mydb4_mydb4>: Obtaining IP info for resource mydb4_10.16.1.166
0000243c.00000a98::2021/10/23-08:13:01.668 INFO  [RES] Network Name <mydb4_mydb4>: Using provider mydb4_10.16.1.166, ip address 10.16.1.166, mask 255.255.255.0, prefix length 24
0000243c.00000a98::2021/10/23-08:13:01.668 INFO  [RES] Network Name <mydb4_mydb4>: Obtaining IP info for resource mydb4_10.30.0.166
0000243c.00000a98::2021/10/23-08:13:01.669 INFO  [RES] Network Name <mydb4_mydb4>: Using provider mydb4_10.30.0.166, ip address 10.30.0.166, mask 255.255.255.0, prefix length 24
0000243c.00000a98::2021/10/23-08:13:01.669 INFO  [RES] Network Name <mydb4_mydb4>: Resource has 2 IPs
0000243c.00000a98::2021/10/23-08:13:01.669 INFO  [RES] Network Name <mydb4_mydb4>: IP: Type Ipv4, Address 10.16.1.166:~0~, Prefix 10.16.1.166/24, Online true, Transport
0000243c.00000a98::2021/10/23-08:13:01.669 INFO  [RES] Network Name <mydb4_mydb4>: IP: Type Ipv4, Address 10.30.0.166:~0~, Prefix 10.30.0.166/24, Online false, Transport
0000243c.00000a98::2021/10/23-08:13:01.670 INFO  [RES] Network Name <mydb4_mydb4>: Handling provider state change finished with result: 0
0000243c.000008ac::2021/10/23-08:13:01.670 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: In ProviderStateChangeImp, bIsOnline is true, bProviderStateChangeInProgress_ is false
0000243c.000008ac::2021/10/23-08:13:01.670 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Netname is online, scheduling the timer to run after 30 seconds
0000243c.000008ac::2021/10/23-08:13:01.670 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Number of IPs that match current node id is 1. Registering mydb4for multichannel support
0000243c.000008ac::2021/10/23-08:13:01.674 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Registering netname for multichannel support returned 0
000010a8.000025f0::2021/10/23-08:13:01.689 INFO  [RCM] rcm::RcmApi::OnlineResource: (mydb2, 0)
000010a8.000025f0::2021/10/23-08:13:01.689 INFO  [RCM-rbtr] giving default token to group mydb2
000010a8.000025f0::2021/10/23-08:13:01.689 INFO  [RCM] rcm::RcmResource::Online: bringing mydb2's provider resource 'mydb2_10.30.0.164' online.
000010a8.000025f0::2021/10/23-08:13:01.689 INFO  [RCM-rbtr] giving default token to group mydb2
000010a8.000025f0::2021/10/23-08:13:01.689 INFO  [RCM] Res mydb2_10.30.0.164: CannotComeOnlineOnThisNode -> OnlineCallIssued( StateUnknown )
000010a8.000025f0::2021/10/23-08:13:01.689 INFO  [RCM] TransitionToState(mydb2_10.30.0.164) CannotComeOnlineOnThisNode-->OnlineCallIssued.
000010a8.000025f0::2021/10/23-08:13:01.689 INFO  [RCM-rbtr] giving default token to group mydb2
000010a8.000025f0::2021/10/23-08:13:01.689 INFO  [RCM] Res mydb2: DelayRestartingResource -> OnlineCallIssued( StateUnknown )
000010a8.000025f0::2021/10/23-08:13:01.689 INFO  [RCM] TransitionToState(mydb2) DelayRestartingResource-->OnlineCallIssued.
000010a8.00001554::2021/10/23-08:13:01.689 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:395 from node 1. Action: causal, Target: CAUS
000010a8.000025f0::2021/10/23-08:13:01.690 INFO  [RCM-rbtr] giving default token to group mydb2
000010a8.00001554::2021/10/23-08:13:01.690 INFO  [RCM] Issuing Online(mydb2_10.30.0.164) to RHS.
0000023c.00002acc::2021/10/23-08:13:01.690 INFO  [RES] IP Address <mydb2_10.30.0.164>: Bringing resource online...
000010a8.00001554::2021/10/23-08:13:01.690 INFO  [RCM] Issuing Online(mydb2) to RHS.
000010a8.000028f4::2021/10/23-08:13:01.690 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:396 from node 1. Action: causal, Target: CAUS
000010a8.00001554::2021/10/23-08:13:01.690 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb2_10.30.0.164', gen(2) result 997/0.
000010a8.00001554::2021/10/23-08:13:01.690 INFO  [RCM] Res mydb2_10.30.0.164: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00001554::2021/10/23-08:13:01.690 INFO  [RCM] TransitionToState(mydb2_10.30.0.164) OnlineCallIssued-->OnlinePending.
000010a8.00002110::2021/10/23-08:13:01.690 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:397 from node 1. Action: causal, Target: CAUS
000010a8.00001554::2021/10/23-08:13:01.690 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb2', gen(2) result 997/0.
000010a8.00001554::2021/10/23-08:13:01.690 INFO  [RCM] Res mydb2: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00001554::2021/10/23-08:13:01.690 INFO  [RCM] TransitionToState(mydb2) OnlineCallIssued-->OnlinePending.
000010a8.00002110::2021/10/23-08:13:01.690 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:398 from node 1. Action: causal, Target: CAUS
0000023c.00002328::2021/10/23-08:13:01.690 INFO  [RES] IP Address <mydb2_10.30.0.164>: Online thread running.
00000054.000009bc::2021/10/23-08:13:01.691 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] The DeadLockTimeout property has a value of 300000
00000054.000009bc::2021/10/23-08:13:01.692 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] The PendingTimeout property has a value of 180000
0000023c.00002328::2021/10/23-08:13:01.693 INFO  [RES] IP Address <mydb2_10.30.0.164>: Checking for network match: IP address mask 255.255.255.0, network mask 255.255.255.0 and IP address 10.30.0.164, network address 10.30.0.0, role 3.
00000054.000009bc::2021/10/23-08:13:01.694 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] Connect to SQL Server ...
0000023c.00002328::2021/10/23-08:13:01.694 ERR   [RES] IP Address <mydb2_10.30.0.164>: Open: Unable to find netinterface for node 1 on network 21dd22f5-ec20-4f7b-95e9-bce2630ae612, status 5035.
0000023c.00002328::2021/10/23-08:13:01.694 WARN  [RHS] Resource mydb2_10.30.0.164 has indicated that it cannot come online on this node.
000010a8.00002110::2021/10/23-08:13:01.694 WARN  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb2_10.30.0.164', gen(2) result 5015/0.
000010a8.00002110::2021/10/23-08:13:01.694 INFO  [RCM] Res mydb2_10.30.0.164: OnlinePending -> ProcessingFailure( CannotComeOnlineOnThisNode )
000010a8.00002110::2021/10/23-08:13:01.694 INFO  [RCM] TransitionToState(mydb2_10.30.0.164) OnlinePending-->[ProcessingFailure to CannotComeOnlineOnThisNode].
000010a8.00002110::2021/10/23-08:13:01.694 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb2_10.30.0.164)
000010a8.0000115c::2021/10/23-08:13:01.694 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:399 from node 1. Action: causal, Target: CAUS
000010a8.00002110::2021/10/23-08:13:01.694 INFO  [RCM] IP address resource 'mydb2_10.30.0.164' cannot come online on this node right now, but not raising any failure events
000010a8.00001554::2021/10/23-08:13:01.694 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00001554::2021/10/23-08:13:01.694 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00001554::2021/10/23-08:13:01.694 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 1c0bbea4-dfed-469b-a5e2-89f1eeee197b.
000010a8.00001554::2021/10/23-08:13:01.694 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 1c0bbea4-dfed-469b-a5e2-89f1eeee197b.
000010a8.00001554::2021/10/23-08:13:01.695 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:400 from node 1. Action: causal, Target: CAUS
000010a8.00002110::2021/10/23-08:13:01.695 INFO  [RCM] resource mydb2_10.30.0.164: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.00002110::2021/10/23-08:13:01.695 INFO  [RCM] Since no top level resource will be offlined by this resource's failure, resetting restartAction to 1
000010a8.00002110::2021/10/23-08:13:01.695 INFO  [RCM] Greater than restartPeriod time has elapsed since first failure of mydb2_10.30.0.164, resetting failureTime and failureCount.
000010a8.00002110::2021/10/23-08:13:01.695 INFO  [RCM] Res mydb2_10.30.0.164: [ProcessingFailure to CannotComeOnlineOnThisNode] -> WaitingToTerminate( CannotComeOnlineOnThisNode )
000010a8.00002110::2021/10/23-08:13:01.695 INFO  [RCM] TransitionToState(mydb2_10.30.0.164) [ProcessingFailure to CannotComeOnlineOnThisNode]-->[WaitingToTerminate to CannotComeOnlineOnThisNode].
000010a8.00002110::2021/10/23-08:13:01.695 INFO  [RCM] Res mydb2_10.30.0.164: [WaitingToTerminate to CannotComeOnlineOnThisNode] -> Terminating( CannotComeOnlineOnThisNode )
000010a8.00002110::2021/10/23-08:13:01.695 INFO  [RCM] TransitionToState(mydb2_10.30.0.164) [WaitingToTerminate to CannotComeOnlineOnThisNode]-->[Terminating to CannotComeOnlineOnThisNode].
000010a8.00002110::2021/10/23-08:13:01.695 WARN  [RCM] resource 'mydb2_10.30.0.164' has exceeded its restart limit.
000010a8.00002110::2021/10/23-08:13:01.695 INFO  [RCM] Will retry online from long delay restart of mydb2_10.30.0.164 in 600000 milliseconds.
0000023c.00000678::2021/10/23-08:13:01.695 INFO  [RES] IP Address <mydb2_10.30.0.164>: Terminating resource...
0000023c.00000678::2021/10/23-08:13:01.695 INFO  [RES] IP Address <mydb2_10.30.0.164>: Address 10.30.0.164 on adapter [Unknown] offline.
000010a8.0000115c::2021/10/23-08:13:01.695 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb2_10.30.0.164', gen(3) result 0/0.
000010a8.0000115c::2021/10/23-08:13:01.695 INFO  [RCM] Res mydb2_10.30.0.164: [Terminating to CannotComeOnlineOnThisNode] -> CannotComeOnlineOnThisNode( StateUnknown )
000010a8.0000115c::2021/10/23-08:13:01.695 INFO  [RCM] TransitionToState(mydb2_10.30.0.164) [Terminating to CannotComeOnlineOnThisNode]-->CannotComeOnlineOnThisNode.
000010a8.00002110::2021/10/23-08:13:01.695 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:401 from node 1. Action: causal, Target: CAUS
0000243c.000008ac::2021/10/23-08:13:01.696 INFO  [RES] Network Name <mydb2_mydb2>: Using provider 1c0bbea4-dfed-469b-a5e2-89f1eeee197b, ip address 10.30.0.164, mask 255.255.255.0, prefix length 24
0000243c.000008ac::2021/10/23-08:13:01.696 INFO  [RES] Network Name <mydb2_mydb2>: Obtaining IP info for resource mydb2_10.16.1.164
0000243c.000008ac::2021/10/23-08:13:01.697 INFO  [RES] Network Name <mydb2_mydb2>: Using provider mydb2_10.16.1.164, ip address 10.16.1.164, mask 255.255.255.0, prefix length 24
0000243c.000008ac::2021/10/23-08:13:01.698 INFO  [RES] Network Name <mydb2_mydb2>: Obtaining IP info for resource mydb2_10.30.0.164
0000243c.000008ac::2021/10/23-08:13:01.699 INFO  [RES] Network Name <mydb2_mydb2>: Using provider mydb2_10.30.0.164, ip address 10.30.0.164, mask 255.255.255.0, prefix length 24
0000243c.000008ac::2021/10/23-08:13:01.699 INFO  [RES] Network Name <mydb2_mydb2>: Resource has 2 IPs
0000243c.000008ac::2021/10/23-08:13:01.699 INFO  [RES] Network Name <mydb2_mydb2>: IP: Type Ipv4, Address 10.16.1.164:~0~, Prefix 10.16.1.164/24, Online true, Transport
0000243c.000008ac::2021/10/23-08:13:01.699 INFO  [RES] Network Name <mydb2_mydb2>: IP: Type Ipv4, Address 10.30.0.164:~0~, Prefix 10.30.0.164/24, Online false, Transport
0000243c.000008ac::2021/10/23-08:13:01.699 INFO  [RES] Network Name <mydb2_mydb2>: Handling provider state change finished with result: 0
0000243c.00000a98::2021/10/23-08:13:01.699 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: In ProviderStateChangeImp, bIsOnline is true, bProviderStateChangeInProgress_ is false
0000243c.00000a98::2021/10/23-08:13:01.699 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Netname is online, scheduling the timer to run after 30 seconds
0000243c.00000a98::2021/10/23-08:13:01.699 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Number of IPs that match current node id is 1. Registering mydb2 for multichannel support
0000243c.00000a98::2021/10/23-08:13:01.703 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Registering netname for multichannel support returned 0
00000054.00000e04::2021/10/23-08:13:01.730 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'events' health state has been changed from '' to 'unknown' at 2021-10-23 03:13:00.293
000010a8.00000f40::2021/10/23-08:13:01.919 INFO  [RCM] Delay-restarting mydb4and any waiting dependents.
000010a8.000025f0::2021/10/23-08:13:01.919 INFO  [RCM] Delay-restarting mydb2 and any waiting dependents.
000010a8.00000f40::2021/10/23-08:13:01.919 INFO  [RCM] Resource mydb4is not in the right state to be restarted
000010a8.000025f0::2021/10/23-08:13:01.919 INFO  [RCM] Resource mydb2 is not in the right state to be restarted
00000054.00001d54::2021/10/23-08:13:02.007 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] The connection was established successfully
00000054.00001d54::2021/10/23-08:13:02.043 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] Current SQL Instance is not part of Failover clustering
00000054.00001d54::2021/10/23-08:13:02.043 INFO  [RES] SQL Server Availability Group: [hadrag] Maximum VerboseLogging among all availability group on the server is (0)
00000054.00001d54::2021/10/23-08:13:02.043 INFO  [RES] SQL Server Availability Group: [hadrag] Minimum HealthCheckTimeout among all availability group on the server is (30000)
00000054.000009bc::2021/10/23-08:13:02.356 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] The connection was established successfully
00000054.000009bc::2021/10/23-08:13:02.384 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] Current SQL Instance is not part of Failover clustering
00000054.000009bc::2021/10/23-08:13:02.384 INFO  [RES] SQL Server Availability Group: [hadrag] Maximum VerboseLogging among all availability group on the server is (0)
00000054.000009bc::2021/10/23-08:13:02.384 INFO  [RES] SQL Server Availability Group: [hadrag] Minimum HealthCheckTimeout among all availability group on the server is (30000)
00000054.000005bc::2021/10/23-08:13:03.792 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Disconnect from SQL Server
00000054.000005bc::2021/10/23-08:13:03.792 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Offline call successful in Terminate function
000010a8.00000f40::2021/10/23-08:13:03.792 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb1', gen(2) result 0/0.
000010a8.00000f40::2021/10/23-08:13:03.792 INFO  [RCM] Res mydb1: [Terminating to DelayRestartingResource] -> DelayRestartingResource( StateUnknown )
000010a8.00000f40::2021/10/23-08:13:03.792 INFO  [RCM] TransitionToState(mydb1) [Terminating to DelayRestartingResource]-->DelayRestartingResource.
000010a8.00000f40::2021/10/23-08:13:03.792 WARN  [RCM] Queueing immediate delay restart of resource mydb1 in 500 ms.
000010a8.00000560::2021/10/23-08:13:03.914 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb1, 1)
000010a8.00000560::2021/10/23-08:13:03.914 INFO  [GUM] Node 1: executing request locally, gumId:25672, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00000560::2021/10/23-08:13:03.914 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb1,1)
000010a8.00000560::2021/10/23-08:13:03.914 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5010)' because of 'The specified node is already a possible owner.'
000010a8.00000560::2021/10/23-08:13:03.914 WARN  [DM] Aborting group transaction 85:85:32474+1
000010a8.00000560::2021/10/23-08:13:03.914 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'Gum handler completed as failed'
000010a8.00000560::2021/10/23-08:13:04.023 INFO  [RCM] rcm::RcmApi::MoveGroup: (Group:mydb1 Dest:1 Flags:0 MoveType:MoveType::Manual Cur.State:Pending, ContextSize:0)
000010a8.00000560::2021/10/23-08:13:04.293 INFO  [RCM] Delay-restarting mydb1 and any waiting dependents.
000010a8.00000560::2021/10/23-08:13:04.293 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00000560::2021/10/23-08:13:04.293 INFO  [RCM] rcm::RcmResource::Online: bringing mydb1's provider resource 'mydb1_10.30.0.163' online.
000010a8.00000560::2021/10/23-08:13:04.293 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00000560::2021/10/23-08:13:04.293 INFO  [RCM] Res mydb1_10.30.0.163: CannotComeOnlineOnThisNode -> OnlineCallIssued( StateUnknown )
000010a8.00000560::2021/10/23-08:13:04.293 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) CannotComeOnlineOnThisNode-->OnlineCallIssued.
000010a8.00000560::2021/10/23-08:13:04.293 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00000560::2021/10/23-08:13:04.293 INFO  [RCM] Res mydb1: DelayRestartingResource -> OnlineCallIssued( StateUnknown )
000010a8.000025f0::2021/10/23-08:13:04.293 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:402 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:13:04.293 INFO  [RCM] TransitionToState(mydb1) DelayRestartingResource-->OnlineCallIssued.
000010a8.00000f40::2021/10/23-08:13:04.294 INFO  [RCM] Issuing Online(mydb1_10.30.0.163) to RHS.
000010a8.000025f0::2021/10/23-08:13:04.294 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:403 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:13:04.294 INFO  [RCM] Issuing Online(mydb1) to RHS.
0000023c.00002acc::2021/10/23-08:13:04.294 INFO  [RES] IP Address <mydb1_10.30.0.163>: Bringing resource online...
000010a8.00000560::2021/10/23-08:13:04.294 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1', gen(2) result 997/0.
000010a8.00000560::2021/10/23-08:13:04.294 INFO  [RCM] Res mydb1: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00000560::2021/10/23-08:13:04.294 INFO  [RCM] TransitionToState(mydb1) OnlineCallIssued-->OnlinePending.
000010a8.00000560::2021/10/23-08:13:04.294 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1_10.30.0.163', gen(2) result 997/0.
000010a8.0000115c::2021/10/23-08:13:04.294 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:404 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:13:04.294 INFO  [RCM] Res mydb1_10.30.0.163: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00000560::2021/10/23-08:13:04.294 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) OnlineCallIssued-->OnlinePending.
000010a8.0000115c::2021/10/23-08:13:04.294 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:405 from node 1. Action: causal, Target: CAUS
0000023c.000011d0::2021/10/23-08:13:04.294 INFO  [RES] IP Address <mydb1_10.30.0.163>: Online thread running.
00000054.00000858::2021/10/23-08:13:04.295 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] The DeadLockTimeout property has a value of 300000
00000054.00000858::2021/10/23-08:13:04.295 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] The PendingTimeout property has a value of 180000
0000023c.000011d0::2021/10/23-08:13:04.296 INFO  [RES] IP Address <mydb1_10.30.0.163>: Checking for network match: IP address mask 255.255.255.0, network mask 255.255.255.0 and IP address 10.30.0.163, network address 10.30.0.0, role 3.
00000054.00000858::2021/10/23-08:13:04.297 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Connect to SQL Server ...
0000023c.000011d0::2021/10/23-08:13:04.297 ERR   [RES] IP Address <mydb1_10.30.0.163>: Open: Unable to find netinterface for node 1 on network 21dd22f5-ec20-4f7b-95e9-bce2630ae612, status 5035.
0000023c.000011d0::2021/10/23-08:13:04.297 WARN  [RHS] Resource mydb1_10.30.0.163 has indicated that it cannot come online on this node.
000010a8.0000115c::2021/10/23-08:13:04.297 WARN  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1_10.30.0.163', gen(2) result 5015/0.
000010a8.0000115c::2021/10/23-08:13:04.297 INFO  [RCM] Res mydb1_10.30.0.163: OnlinePending -> ProcessingFailure( CannotComeOnlineOnThisNode )
000010a8.0000115c::2021/10/23-08:13:04.297 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) OnlinePending-->[ProcessingFailure to CannotComeOnlineOnThisNode].
000010a8.00000f40::2021/10/23-08:13:04.297 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:406 from node 1. Action: causal, Target: CAUS
000010a8.0000115c::2021/10/23-08:13:04.298 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb1_10.30.0.163)
000010a8.00000f40::2021/10/23-08:13:04.298 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:407 from node 1. Action: causal, Target: CAUS
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] IP address resource 'mydb1_10.30.0.163' cannot come online on this node right now, but not raising any failure events
000010a8.00000f40::2021/10/23-08:13:04.298 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00000f40::2021/10/23-08:13:04.298 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00000f40::2021/10/23-08:13:04.298 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource f08053c9-1452-4458-9420-de289cd04dce.
000010a8.00000f40::2021/10/23-08:13:04.298 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource f08053c9-1452-4458-9420-de289cd04dce.
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] resource mydb1_10.30.0.163: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] Since no top level resource will be offlined by this resource's failure, resetting restartAction to 1
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] Greater than restartPeriod time has elapsed since first failure of mydb1_10.30.0.163, resetting failureTime and failureCount.
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] Res mydb1_10.30.0.163: [ProcessingFailure to CannotComeOnlineOnThisNode] -> WaitingToTerminate( CannotComeOnlineOnThisNode )
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) [ProcessingFailure to CannotComeOnlineOnThisNode]-->[WaitingToTerminate to CannotComeOnlineOnThisNode].
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] Res mydb1_10.30.0.163: [WaitingToTerminate to CannotComeOnlineOnThisNode] -> Terminating( CannotComeOnlineOnThisNode )
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) [WaitingToTerminate to CannotComeOnlineOnThisNode]-->[Terminating to CannotComeOnlineOnThisNode].
000010a8.0000115c::2021/10/23-08:13:04.298 WARN  [RCM] resource 'mydb1_10.30.0.163' has exceeded its restart limit.
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] Will retry online from long delay restart of mydb1_10.30.0.163 in 600000 milliseconds.
0000023c.00002acc::2021/10/23-08:13:04.298 INFO  [RES] IP Address <mydb1_10.30.0.163>: Terminating resource...
0000023c.00002acc::2021/10/23-08:13:04.298 INFO  [RES] IP Address <mydb1_10.30.0.163>: Address 10.30.0.163 on adapter [Unknown] offline.
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb1_10.30.0.163', gen(3) result 0/0.
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] Res mydb1_10.30.0.163: [Terminating to CannotComeOnlineOnThisNode] -> CannotComeOnlineOnThisNode( StateUnknown )
000010a8.0000115c::2021/10/23-08:13:04.298 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) [Terminating to CannotComeOnlineOnThisNode]-->CannotComeOnlineOnThisNode.
000010a8.00000560::2021/10/23-08:13:04.298 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:408 from node 1. Action: causal, Target: CAUS
0000243c.000008ac::2021/10/23-08:13:04.299 INFO  [RES] Network Name <mydb1_mydb1>: Using provider f08053c9-1452-4458-9420-de289cd04dce, ip address 10.30.0.163, mask 255.255.255.0, prefix length 24
0000243c.000008ac::2021/10/23-08:13:04.299 INFO  [RES] Network Name <mydb1_mydb1>: Obtaining IP info for resource mydb1_10.16.1.163
0000243c.000008ac::2021/10/23-08:13:04.300 INFO  [RES] Network Name <mydb1_mydb1>: Using provider mydb1_10.16.1.163, ip address 10.16.1.163, mask 255.255.255.0, prefix length 24
0000243c.000008ac::2021/10/23-08:13:04.300 INFO  [RES] Network Name <mydb1_mydb1>: Obtaining IP info for resource mydb1_10.30.0.163
0000243c.000008ac::2021/10/23-08:13:04.301 INFO  [RES] Network Name <mydb1_mydb1>: Using provider mydb1_10.30.0.163, ip address 10.30.0.163, mask 255.255.255.0, prefix length 24
0000243c.000008ac::2021/10/23-08:13:04.301 INFO  [RES] Network Name <mydb1_mydb1>: Resource has 2 IPs
0000243c.000008ac::2021/10/23-08:13:04.301 INFO  [RES] Network Name <mydb1_mydb1>: IP: Type Ipv4, Address 10.16.1.163:~0~, Prefix 10.16.1.163/24, Online true, Transport
0000243c.000008ac::2021/10/23-08:13:04.301 INFO  [RES] Network Name <mydb1_mydb1>: IP: Type Ipv4, Address 10.30.0.163:~0~, Prefix 10.30.0.163/24, Online false, Transport
0000243c.000008ac::2021/10/23-08:13:04.301 INFO  [RES] Network Name <mydb1_mydb1>: Handling provider state change finished with result: 0
0000243c.00000a98::2021/10/23-08:13:04.301 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: In ProviderStateChangeImp, bIsOnline is true, bProviderStateChangeInProgress_ is false
0000243c.00000a98::2021/10/23-08:13:04.301 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Netname is online, scheduling the timer to run after 30 seconds
0000243c.00000a98::2021/10/23-08:13:04.301 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Number of IPs that match current node id is 1. Registering mydb1 for multichannel support
0000243c.00000a98::2021/10/23-08:13:04.306 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Registering netname for multichannel support returned 0
000010a8.0000115c::2021/10/23-08:13:04.398 INFO  [RCM] rcm::RcmApi::OnlineResource: (mydb1, 0)
00000054.00000858::2021/10/23-08:13:04.521 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] The connection was established successfully
00000054.00000858::2021/10/23-08:13:04.538 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Current SQL Instance is not part of Failover clustering
00000054.00000858::2021/10/23-08:13:04.538 INFO  [RES] SQL Server Availability Group: [hadrag] Maximum VerboseLogging among all availability group on the server is (0)
00000054.00000858::2021/10/23-08:13:04.538 INFO  [RES] SQL Server Availability Group: [hadrag] Minimum HealthCheckTimeout among all availability group on the server is (30000)
000010a8.0000115c::2021/10/23-08:13:04.877 INFO  [GUM] Node 1: executing request locally, gumId:25672, my action: /dm/update, # of updates: 1
000010a8.0000115c::2021/10/23-08:13:04.878 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:409 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000f40::2021/10/23-08:13:05.010 INFO  [GUM] Node 1: executing request locally, gumId:25673, my action: /dm/update, # of updates: 1
000010a8.00000f40::2021/10/23-08:13:05.010 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:410 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000115c::2021/10/23-08:13:05.052 INFO  [GUM] Node 1: executing request locally, gumId:25674, my action: /dm/update, # of updates: 1
000010a8.0000115c::2021/10/23-08:13:05.052 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:411 from node 1. Action: gum/do-update, Target: GUMA
00000054.00000508::2021/10/23-08:13:05.115 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Disconnect from SQL Server
00000054.00000508::2021/10/23-08:13:05.116 INFO  [RHS] Resource mydb3 has come online. RHS is about to report status change to RCM
000010a8.000025f0::2021/10/23-08:13:05.116 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3', gen(2) result 0/0.
000010a8.000025f0::2021/10/23-08:13:05.116 INFO  [RCM] Res mydb3: OnlinePending -> Online( StateUnknown )
000010a8.000025f0::2021/10/23-08:13:05.116 INFO  [RCM] TransitionToState(mydb3) OnlinePending-->Online.
000010a8.000025f0::2021/10/23-08:13:05.116 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Pending --> Online)
000010a8.00000f40::2021/10/23-08:13:05.116 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:412 from node 1. Action: causal, Target: CAUS
000010a8.00000f40::2021/10/23-08:13:05.116 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:413 from node 1. Action: causal, Target: CAUS
000010a8.00002110::2021/10/23-08:13:05.180 INFO  [GUM] Node 1: executing request locally, gumId:25675, my action: /dm/update, # of updates: 1
000010a8.00002110::2021/10/23-08:13:05.181 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:414 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000115c::2021/10/23-08:13:05.192 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb3, 1)
000010a8.0000115c::2021/10/23-08:13:05.223 INFO  [GUM] Node 1: executing request locally, gumId:25676, my action: /rcm/gum/AddPossibleOwner, # of updates: 2
000010a8.0000115c::2021/10/23-08:13:05.223 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb3,1)
000010a8.0000115c::2021/10/23-08:13:05.223 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5010)' because of 'The specified node is already a possible owner.'
000010a8.0000115c::2021/10/23-08:13:05.223 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:415 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000115c::2021/10/23-08:13:05.265 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'Gum handler completed as failed'
00000054.000009bc::2021/10/23-08:13:05.297 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] Disconnect from SQL Server
00000054.000009bc::2021/10/23-08:13:05.298 INFO  [RHS] Resource mydb2 has come online. RHS is about to report status change to RCM
000010a8.00000f40::2021/10/23-08:13:05.298 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb2', gen(2) result 0/0.
000010a8.00000f40::2021/10/23-08:13:05.298 INFO  [RCM] Res mydb2: OnlinePending -> Online( StateUnknown )
000010a8.00000f40::2021/10/23-08:13:05.298 INFO  [RCM] TransitionToState(mydb2) OnlinePending-->Online.
000010a8.00000f40::2021/10/23-08:13:05.298 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb2, Pending --> Online)
000010a8.00001554::2021/10/23-08:13:05.298 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:416 from node 1. Action: causal, Target: CAUS
000010a8.000025f0::2021/10/23-08:13:05.298 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:417 from node 1. Action: causal, Target: CAUS
000010a8.00002110::2021/10/23-08:13:05.314 INFO  [RCM] rcm::RcmApi::RemovePossibleOwner: (mydb3, 2)
000010a8.00002110::2021/10/23-08:13:05.314 INFO  [GUM] Node 1: executing request locally, gumId:25677, my action: /rcm/gum/RemovePossibleOwner, # of updates: 1
000010a8.00002110::2021/10/23-08:13:05.314 INFO  [RCM] rcm::RcmGum::RemovePossibleOwner(mydb3,2)
000010a8.00002110::2021/10/23-08:13:05.314 INFO  [RCM] Removing node 2 from resource 'mydb3'.
000010a8.00002110::2021/10/23-08:13:05.315 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:418 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000115c::2021/10/23-08:13:05.347 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb2, 1)
000010a8.000025f0::2021/10/23-08:13:05.359 INFO  [GUM] Node 1: executing request locally, gumId:25678, my action: /dm/update, # of updates: 2
000010a8.000025f0::2021/10/23-08:13:05.359 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb2,1)
000010a8.000025f0::2021/10/23-08:13:05.359 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5010)' because of 'The specified node is already a possible owner.'
000010a8.000025f0::2021/10/23-08:13:05.359 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:419 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000115c::2021/10/23-08:13:05.401 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'Gum handler completed as failed'
000010a8.00002110::2021/10/23-08:13:05.401 INFO  [GUM] Node 1: executing request locally, gumId:25679, my action: /rcm/gum/SetGroupPreferredOwners, # of updates: 1
000010a8.00002110::2021/10/23-08:13:05.401 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb3,<vector len='1'>
000010a8.00002110::2021/10/23-08:13:05.401 INFO      <item>1</item>
000010a8.00002110::2021/10/23-08:13:05.401 INFO  </vector>
000010a8.00002110::2021/10/23-08:13:05.401 INFO  )
000010a8.00002110::2021/10/23-08:13:05.401 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:420 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002110::2021/10/23-08:13:05.485 INFO  [RCM] rcm::RcmApi::RemovePossibleOwner: (mydb2, 2)
000010a8.00002110::2021/10/23-08:13:05.485 INFO  [GUM] Node 1: executing request locally, gumId:25680, my action: /rcm/gum/RemovePossibleOwner, # of updates: 1
000010a8.00002110::2021/10/23-08:13:05.485 INFO  [RCM] rcm::RcmGum::RemovePossibleOwner(mydb2,2)
000010a8.00002110::2021/10/23-08:13:05.485 INFO  [RCM] Removing node 2 from resource 'mydb2'.
000010a8.00002110::2021/10/23-08:13:05.487 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:421 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:05.601 INFO  [GUM] Node 1: executing request locally, gumId:25681, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:05.602 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:422 from node 1. Action: gum/do-update, Target: GUMA
00000054.00001d54::2021/10/23-08:13:05.613 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] Disconnect from SQL Server
00000054.00001d54::2021/10/23-08:13:05.613 INFO  [RHS] Resource mydb4has come online. RHS is about to report status change to RCM
000010a8.00001554::2021/10/23-08:13:05.613 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb4', gen(2) result 0/0.
000010a8.00001554::2021/10/23-08:13:05.613 INFO  [RCM] Res mydb4: OnlinePending -> Online( StateUnknown )
000010a8.00001554::2021/10/23-08:13:05.613 INFO  [RCM] TransitionToState(mydb4) OnlinePending-->Online.
000010a8.00001554::2021/10/23-08:13:05.613 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb4, Pending --> Online)
000010a8.00000f40::2021/10/23-08:13:05.613 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:423 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:13:05.613 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:424 from node 1. Action: causal, Target: CAUS
000010a8.0000115c::2021/10/23-08:13:05.643 INFO  [GUM] Node 1: executing request locally, gumId:25682, my action: /rcm/gum/SetGroupPreferredOwners, # of updates: 1
000010a8.0000115c::2021/10/23-08:13:05.643 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb2,<vector len='1'>
000010a8.0000115c::2021/10/23-08:13:05.643 INFO      <item>1</item>
000010a8.0000115c::2021/10/23-08:13:05.643 INFO  </vector>
000010a8.0000115c::2021/10/23-08:13:05.643 INFO  )
000010a8.0000115c::2021/10/23-08:13:05.644 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:425 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002110::2021/10/23-08:13:05.659 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb3, 2)
000010a8.00002110::2021/10/23-08:13:05.685 INFO  [GUM] Node 1: executing request locally, gumId:25683, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00002110::2021/10/23-08:13:05.685 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb3,2)
000010a8.00002110::2021/10/23-08:13:05.685 INFO  [RCM] Adding node 2 to resource 'mydb3'.
000010a8.00002110::2021/10/23-08:13:05.686 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:426 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000115c::2021/10/23-08:13:05.697 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb4, 1)
000010a8.0000115c::2021/10/23-08:13:05.728 INFO  [GUM] Node 1: executing request locally, gumId:25684, my action: /rcm/gum/AddPossibleOwner, # of updates: 2
000010a8.0000115c::2021/10/23-08:13:05.728 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb4,1)
000010a8.0000115c::2021/10/23-08:13:05.728 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5010)' because of 'The specified node is already a possible owner.'
000010a8.0000115c::2021/10/23-08:13:05.729 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:427 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000115c::2021/10/23-08:13:05.772 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'Gum handler completed as failed'
000010a8.00002110::2021/10/23-08:13:05.772 INFO  [GUM] Node 1: executing request locally, gumId:25685, my action: /rcm/gum/SetGroupPreferredOwners, # of updates: 1
000010a8.00002110::2021/10/23-08:13:05.772 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb3,<vector len='2'>
000010a8.00002110::2021/10/23-08:13:05.772 INFO      <item>1</item>
000010a8.00002110::2021/10/23-08:13:05.772 INFO      <item>2</item>
000010a8.00002110::2021/10/23-08:13:05.772 INFO  </vector>
000010a8.00002110::2021/10/23-08:13:05.772 INFO  )
000010a8.00002110::2021/10/23-08:13:05.773 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:428 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:05.793 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb2, 2)
000010a8.000025f0::2021/10/23-08:13:05.815 INFO  [GUM] Node 1: executing request locally, gumId:25686, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:05.815 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb2,2)
000010a8.000025f0::2021/10/23-08:13:05.815 INFO  [RCM] Adding node 2 to resource 'mydb2'.
000010a8.000025f0::2021/10/23-08:13:05.816 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:429 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:13:05.839 INFO  [RCM] rcm::RcmApi::RemovePossibleOwner: (mydb4, 2)
000010a8.00001554::2021/10/23-08:13:05.858 INFO  [GUM] Node 1: executing request locally, gumId:25687, my action: /rcm/gum/RemovePossibleOwner, # of updates: 1
000010a8.00001554::2021/10/23-08:13:05.858 INFO  [RCM] rcm::RcmGum::RemovePossibleOwner(mydb4,2)
000010a8.00001554::2021/10/23-08:13:05.858 INFO  [RCM] Removing node 2 from resource 'mydb4'.
000010a8.00001554::2021/10/23-08:13:05.859 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:430 from node 1. Action: gum/do-update, Target: GUMA
00000054.00000858::2021/10/23-08:13:05.879 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Disconnect from SQL Server
00000054.00000858::2021/10/23-08:13:05.879 INFO  [RHS] Resource mydb1 has come online. RHS is about to report status change to RCM
000010a8.00000f40::2021/10/23-08:13:05.879 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1', gen(2) result 0/0.
000010a8.00000f40::2021/10/23-08:13:05.879 INFO  [RCM] Res mydb1: OnlinePending -> Online( StateUnknown )
000010a8.00000f40::2021/10/23-08:13:05.879 INFO  [RCM] TransitionToState(mydb1) OnlinePending-->Online.
000010a8.00000f40::2021/10/23-08:13:05.879 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb1, Pending --> Online)
000010a8.00000560::2021/10/23-08:13:05.879 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:431 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:13:05.879 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:432 from node 1. Action: causal, Target: CAUS
000010a8.000025f0::2021/10/23-08:13:05.901 INFO  [GUM] Node 1: executing request locally, gumId:25688, my action: /rcm/gum/SetGroupPreferredOwners, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:05.901 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb2,<vector len='2'>
000010a8.000025f0::2021/10/23-08:13:05.901 INFO      <item>1</item>
000010a8.000025f0::2021/10/23-08:13:05.901 INFO      <item>2</item>
000010a8.000025f0::2021/10/23-08:13:05.901 INFO  </vector>
000010a8.000025f0::2021/10/23-08:13:05.901 INFO  )
000010a8.000025f0::2021/10/23-08:13:05.901 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:433 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:13:05.914 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb1, 1)
000010a8.00001554::2021/10/23-08:13:05.942 INFO  [GUM] Node 1: executing request locally, gumId:25689, my action: /rcm/gum/AddPossibleOwner, # of updates: 2
000010a8.00001554::2021/10/23-08:13:05.942 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb1,1)
000010a8.00001554::2021/10/23-08:13:05.942 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5010)' because of 'The specified node is already a possible owner.'
000010a8.00001554::2021/10/23-08:13:05.942 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb4,<vector len='1'>
000010a8.00001554::2021/10/23-08:13:05.942 INFO      <item>1</item>
000010a8.00001554::2021/10/23-08:13:05.942 INFO  </vector>
000010a8.00001554::2021/10/23-08:13:05.942 INFO  )
000010a8.00001554::2021/10/23-08:13:05.943 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:434 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:13:05.984 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'Gum handler completed as failed'
000010a8.00000f40::2021/10/23-08:13:06.048 INFO  [RCM] rcm::RcmApi::RemovePossibleOwner: (mydb1, 2)
000010a8.00000f40::2021/10/23-08:13:06.048 INFO  [GUM] Node 1: executing request locally, gumId:25690, my action: /rcm/gum/RemovePossibleOwner, # of updates: 1
000010a8.00000f40::2021/10/23-08:13:06.048 INFO  [RCM] rcm::RcmGum::RemovePossibleOwner(mydb1,2)
000010a8.00000f40::2021/10/23-08:13:06.048 INFO  [RCM] Removing node 2 from resource 'mydb1'.
000010a8.00000f40::2021/10/23-08:13:06.050 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:435 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002110::2021/10/23-08:13:06.128 INFO  [GUM] Node 1: executing request locally, gumId:25691, my action: /rcm/gum/SetGroupPreferredOwners, # of updates: 1
000010a8.00002110::2021/10/23-08:13:06.128 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb1,<vector len='1'>
000010a8.00002110::2021/10/23-08:13:06.128 INFO      <item>1</item>
000010a8.00002110::2021/10/23-08:13:06.128 INFO  </vector>
000010a8.00002110::2021/10/23-08:13:06.128 INFO  )
000010a8.00002110::2021/10/23-08:13:06.128 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:436 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002110::2021/10/23-08:13:06.178 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb4, 2)
000010a8.00002110::2021/10/23-08:13:06.178 INFO  [GUM] Node 1: executing request locally, gumId:25692, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00002110::2021/10/23-08:13:06.178 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb4,2)
000010a8.00002110::2021/10/23-08:13:06.178 INFO  [RCM] Adding node 2 to resource 'mydb4'.
000010a8.00002110::2021/10/23-08:13:06.179 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:437 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002110::2021/10/23-08:13:06.222 INFO  [GUM] Node 1: executing request locally, gumId:25693, my action: /rcm/gum/SetGroupPreferredOwners, # of updates: 1
000010a8.00002110::2021/10/23-08:13:06.222 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb4,<vector len='2'>
000010a8.00002110::2021/10/23-08:13:06.222 INFO      <item>1</item>
000010a8.00002110::2021/10/23-08:13:06.222 INFO      <item>2</item>
000010a8.00002110::2021/10/23-08:13:06.222 INFO  </vector>
000010a8.00002110::2021/10/23-08:13:06.222 INFO  )
000010a8.00002110::2021/10/23-08:13:06.222 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:438 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:13:06.392 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb1, 2)
000010a8.00001554::2021/10/23-08:13:06.393 INFO  [GUM] Node 1: executing request locally, gumId:25694, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00001554::2021/10/23-08:13:06.393 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb1,2)
000010a8.00001554::2021/10/23-08:13:06.393 INFO  [RCM] Adding node 2 to resource 'mydb1'.
000010a8.00001554::2021/10/23-08:13:06.394 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:439 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:06.435 INFO  [GUM] Node 1: executing request locally, gumId:25695, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:06.436 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:440 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:13:06.477 INFO  [GUM] Node 1: executing request locally, gumId:25696, my action: /rcm/gum/SetGroupPreferredOwners, # of updates: 2
000010a8.00001554::2021/10/23-08:13:06.477 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb1,<vector len='2'>
000010a8.00001554::2021/10/23-08:13:06.477 INFO      <item>1</item>
000010a8.00001554::2021/10/23-08:13:06.477 INFO      <item>2</item>
000010a8.00001554::2021/10/23-08:13:06.477 INFO  </vector>
000010a8.00001554::2021/10/23-08:13:06.477 INFO  )
000010a8.00001554::2021/10/23-08:13:06.478 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:441 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:06.659 INFO  [GUM] Node 1: executing request locally, gumId:25697, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:06.659 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:442 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:06.774 INFO  [GUM] Node 1: executing request locally, gumId:25698, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:06.774 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:443 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:06.867 INFO  [GUM] Node 1: executing request locally, gumId:25699, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:06.867 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:444 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:06.908 INFO  [GUM] Node 1: executing request locally, gumId:25700, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:06.909 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:445 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002110::2021/10/23-08:13:06.977 INFO  [GUM] Node 1: executing request locally, gumId:25701, my action: /dm/update, # of updates: 1
000010a8.00002110::2021/10/23-08:13:06.977 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:446 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:07.213 INFO  [GUM] Node 1: executing request locally, gumId:25702, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:07.214 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:447 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:07.635 INFO  [GUM] Node 1: executing request locally, gumId:25703, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:07.635 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:448 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:07.822 INFO  [GUM] Node 1: executing request locally, gumId:25704, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:07.823 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:449 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:08.271 INFO  [GUM] Node 1: executing request locally, gumId:25705, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:08.272 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:450 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:08.313 INFO  [GUM] Node 1: executing request locally, gumId:25706, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:08.313 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:451 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:08.419 INFO  [GUM] Node 1: executing request locally, gumId:25707, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:08.419 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:452 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:08.593 INFO  [GUM] Node 1: executing request locally, gumId:25708, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:08.594 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:453 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:09.170 INFO  [GUM] Node 1: executing request locally, gumId:25709, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:09.170 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:454 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002110::2021/10/23-08:13:09.213 INFO  [GUM] Node 1: executing request locally, gumId:25710, my action: /dm/update, # of updates: 1
000010a8.00002110::2021/10/23-08:13:09.213 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:455 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:09.445 INFO  [GUM] Node 1: executing request locally, gumId:25711, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:09.446 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:456 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:09.488 INFO  [GUM] Node 1: executing request locally, gumId:25712, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:09.489 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:457 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:09.613 INFO  [GUM] Node 1: executing request locally, gumId:25713, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:09.613 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:458 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:09.820 INFO  [GUM] Node 1: executing request locally, gumId:25714, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:09.820 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:459 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:10.035 INFO  [GUM] Node 1: executing request locally, gumId:25715, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:10.035 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:460 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:10.163 INFO  [GUM] Node 1: executing request locally, gumId:25716, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:10.164 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:461 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000025f0::2021/10/23-08:13:10.323 INFO  [GUM] Node 1: executing request locally, gumId:25717, my action: /dm/update, # of updates: 1
000010a8.000025f0::2021/10/23-08:13:10.323 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:462 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002110::2021/10/23-08:13:10.364 INFO  [GUM] Node 1: executing request locally, gumId:25718, my action: /dm/update, # of updates: 1
000010a8.00002110::2021/10/23-08:13:10.365 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:463 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:13:10.406 INFO  [GUM] Node 1: executing request locally, gumId:25719, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:10.407 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:464 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002110::2021/10/23-08:13:10.765 INFO  [GUM] Node 1: executing request locally, gumId:25720, my action: /dm/update, # of updates: 1
000010a8.00002110::2021/10/23-08:13:10.765 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:465 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:13:10.967 INFO  [GUM] Node 1: executing request locally, gumId:25721, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:13:10.968 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:466 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:13:11.032 INFO  [GUM] Node 1: executing request locally, gumId:25722, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:13:11.033 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:467 from node 1. Action: gum/do-update, Target: GUMA
0000243c.00000a98::2021/10/23-08:13:11.887 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Configuration timer entry
0000243c.00000a98::2021/10/23-08:13:11.888 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Processing provider state changes - Rechecking 'Dns' and 'Netbios' modules
0000243c.00000a98::2021/10/23-08:13:11.888 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: StartTimerIfNeeded - bProviderStateChangeInProgress_ set to false
0000243c.000008ac::2021/10/23-08:13:11.888 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Dns - Rechecking config internally
0000243c.00000a98::2021/10/23-08:13:11.888 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: Cleaning up transports
0000243c.00002b38::2021/10/23-08:13:11.912 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet]                  DNS Suffix:
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00002b38::2021/10/23-08:13:11.912 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00002b38::2021/10/23-08:13:11.912 DBG   [ClNet]                  DNS Suffix:
0000243c.00002b38::2021/10/23-08:13:11.912 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00002b38::2021/10/23-08:13:11.913 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00002b38::2021/10/23-08:13:11.913 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.165 Prefix: 10.16.1.165/24 (Actual address: 10.16.1.165), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.165 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.165 Prefix: 10.30.0.165/24)
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.165
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.165
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.164
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.165
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.166
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.00002b38::2021/10/23-08:13:11.914 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Registering into DNS Name: mydb3 (Type: Singleton)...
0000243c.00002b38::2021/10/23-08:13:11.921 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Impersonating VCO User 'mydb3$' to Update DNS registration.  IsCore? false
0000243c.000008ac::2021/10/23-08:13:11.921 INFO  [RES] Network Name <mydb3_mydb3>: Identity: Get Token Request, currently has a token
0000243c.00002b38::2021/10/23-08:13:11.921 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.00002b38::2021/10/23-08:13:11.921 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.00002b38::2021/10/23-08:13:11.921 INFO  [RES] Network Name: [NNLIB] Registering name mydb3 on DNS Network: Cluster Network 1, with 2 DNS Servers, 2 Virtual Addresses, 1 Domain Names
0000243c.00002b38::2021/10/23-08:13:11.921 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00002b38::2021/10/23-08:13:11.921 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00002b38::2021/10/23-08:13:11.921 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.165
0000243c.00002b38::2021/10/23-08:13:11.921 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.165
0000243c.00002b38::2021/10/23-08:13:11.921 INFO  [RES] Network Name: [NNLIB] Registering: mydb3.domain.local
0000243c.00000a98::2021/10/23-08:13:11.942 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: NetbiosRecheckReplyHandler: 0
0000243c.00002b38::2021/10/23-08:13:12.001 INFO  [RES] Network Name: [NNLIB] DNS Record there for mydb3.domain.local, proceeding
0000243c.00002b38::2021/10/23-08:13:12.162 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn mydb3.domain.local (ipv4Count 2, ipv6Count 0)
0000243c.00002b38::2021/10/23-08:13:12.162 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.00002b38::2021/10/23-08:13:12.242 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner mydb3.domain.local (registered sets: 1, ipv4Count 2, ipv6Count 0, ptrCount 2)
0000243c.00002b38::2021/10/23-08:13:12.242 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.00002b38::2021/10/23-08:13:12.242 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Completed DNS Registration for Name: mydb3 (Type: Singleton)
0000243c.00002b38::2021/10/23-08:13:12.242 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: InternalReplyHandler: 0
0000243c.000008ac::2021/10/23-08:13:12.242 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Updating status after a DNS registration
0000243c.000008ac::2021/10/23-08:13:12.242 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Last Dns Update time changed
000010a8.00000560::2021/10/23-08:13:12.242 INFO  [GUM] Node 1: executing request locally, gumId:25723, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:13:12.243 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:468 from node 1. Action: gum/do-update, Target: GUMA
0000243c.000008ac::2021/10/23-08:13:12.284 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.00002b38::2021/10/23-08:13:12.284 INFO  [RES] Network Name <mydb3_mydb3>: Client: Synching with slow operation
0000243c.000008ac::2021/10/23-08:13:12.304 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:13:12.304 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000008ac::2021/10/23-08:13:12.304 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000008ac::2021/10/23-08:13:12.304 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000008ac::2021/10/23-08:13:12.304 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000008ac::2021/10/23-08:13:12.304 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:13:12.304 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000008ac::2021/10/23-08:13:12.304 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000008ac::2021/10/23-08:13:12.304 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:13:12.305 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000008ac::2021/10/23-08:13:12.305 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000008ac::2021/10/23-08:13:12.305 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000008ac::2021/10/23-08:13:12.305 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000008ac::2021/10/23-08:13:12.305 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:13:12.305 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000008ac::2021/10/23-08:13:12.306 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000008ac::2021/10/23-08:13:12.306 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000008ac::2021/10/23-08:13:12.306 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000008ac::2021/10/23-08:13:12.306 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.165 Prefix: 10.16.1.165/24 (Actual address: 10.16.1.165), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000008ac::2021/10/23-08:13:12.306 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.165 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.165 Prefix: 10.30.0.165/24)
0000243c.000008ac::2021/10/23-08:13:12.306 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000008ac::2021/10/23-08:13:12.306 INFO  [RES] Network Name <mydb3_mydb3>: Client: Final alias is 10.16.1.165
0000243c.000008ac::2021/10/23-08:13:12.306 INFO  [RES] Network Name <mydb3_mydb3>: Client: RegisterFqdnWithLsa - Found FQDN mydb3.domain.local that is already registered with LSA
0000243c.000008ac::2021/10/23-08:13:12.306 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: InternalReplyHandler: 0
0000243c.00002b38::2021/10/23-08:13:31.679 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Configuration timer entry
0000243c.00002b38::2021/10/23-08:13:31.679 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Processing provider state changes - Rechecking 'Dns' and 'Netbios' modules
0000243c.00002b38::2021/10/23-08:13:31.679 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: StartTimerIfNeeded - bProviderStateChangeInProgress_ set to false
0000243c.00002738::2021/10/23-08:13:31.679 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Dns - Rechecking config internally
0000243c.00002b38::2021/10/23-08:13:31.679 INFO  [RES] Network Name <mydb4_mydb4>: Netbios: Cleaning up transports
0000243c.00000a98::2021/10/23-08:13:31.704 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet]                  DNS Suffix:
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00000a98::2021/10/23-08:13:31.704 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00000a98::2021/10/23-08:13:31.704 DBG   [ClNet]                  DNS Suffix:
0000243c.00000a98::2021/10/23-08:13:31.704 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00000a98::2021/10/23-08:13:31.705 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00000a98::2021/10/23-08:13:31.705 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.166 Prefix: 10.16.1.166/24 (Actual address: 10.16.1.166), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.166 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.166 Prefix: 10.30.0.166/24)
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.166
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.166
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.164
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.165
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.166
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.00000a98::2021/10/23-08:13:31.706 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Registering into DNS Name: mydb4(Type: Singleton)...
0000243c.00002738::2021/10/23-08:13:31.710 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Configuration timer entry
0000243c.00002738::2021/10/23-08:13:31.710 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Processing provider state changes - Rechecking 'Dns' and 'Netbios' modules
0000243c.00002738::2021/10/23-08:13:31.710 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: StartTimerIfNeeded - bProviderStateChangeInProgress_ set to false
0000243c.000008ac::2021/10/23-08:13:31.710 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Dns - Rechecking config internally
0000243c.00002994::2021/10/23-08:13:31.710 INFO  [RES] Network Name <mydb2_mydb2>: Netbios: Cleaning up transports
0000243c.00000a98::2021/10/23-08:13:31.713 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Impersonating VCO User 'mydb4$' to Update DNS registration.  IsCore? false
0000243c.000008ac::2021/10/23-08:13:31.713 INFO  [RES] Network Name <mydb4_mydb4>: Identity: Get Token Request, currently has a token
0000243c.00000a98::2021/10/23-08:13:31.713 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.00000a98::2021/10/23-08:13:31.713 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.00000a98::2021/10/23-08:13:31.713 INFO  [RES] Network Name: [NNLIB] Registering name mydb4on DNS Network: Cluster Network 1, with 2 DNS Servers, 2 Virtual Addresses, 1 Domain Names
0000243c.00000a98::2021/10/23-08:13:31.713 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000a98::2021/10/23-08:13:31.713 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000a98::2021/10/23-08:13:31.713 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.166
0000243c.00000a98::2021/10/23-08:13:31.713 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.166
0000243c.00000a98::2021/10/23-08:13:31.713 INFO  [RES] Network Name: [NNLIB] Registering: mydb4.domain.local
0000243c.00002b38::2021/10/23-08:13:31.761 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: NetbiosRecheckReplyHandler: 0
0000243c.00000a98::2021/10/23-08:13:31.793 INFO  [RES] Network Name: [NNLIB] DNS Record there for mydb4.domain.local, proceeding
0000243c.000029bc::2021/10/23-08:13:31.807 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet]                  DNS Suffix:
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000029bc::2021/10/23-08:13:31.807 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000029bc::2021/10/23-08:13:31.807 DBG   [ClNet]                  DNS Suffix:
0000243c.000029bc::2021/10/23-08:13:31.807 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.164 Prefix: 10.16.1.164/24 (Actual address: 10.16.1.164), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.164 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.164 Prefix: 10.30.0.164/24)
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.164
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.164
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.164
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.165
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.166
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.000029bc::2021/10/23-08:13:31.808 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Registering into DNS Name: mydb2 (Type: Singleton)...
0000243c.000029bc::2021/10/23-08:13:31.815 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Impersonating VCO User 'mydb2$' to Update DNS registration.  IsCore? false
0000243c.000008ac::2021/10/23-08:13:31.815 INFO  [RES] Network Name <mydb2_mydb2>: Identity: Get Token Request, currently has a token
0000243c.000029bc::2021/10/23-08:13:31.815 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.000029bc::2021/10/23-08:13:31.815 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.000029bc::2021/10/23-08:13:31.815 INFO  [RES] Network Name: [NNLIB] Registering name mydb2 on DNS Network: Cluster Network 1, with 2 DNS Servers, 2 Virtual Addresses, 1 Domain Names
0000243c.000029bc::2021/10/23-08:13:31.815 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.000029bc::2021/10/23-08:13:31.815 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.000029bc::2021/10/23-08:13:31.815 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.164
0000243c.000029bc::2021/10/23-08:13:31.815 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.164
0000243c.000029bc::2021/10/23-08:13:31.815 INFO  [RES] Network Name: [NNLIB] Registering: mydb2.domain.local
0000243c.00002994::2021/10/23-08:13:31.852 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: NetbiosRecheckReplyHandler: 0
0000243c.000029bc::2021/10/23-08:13:31.895 INFO  [RES] Network Name: [NNLIB] DNS Record there for mydb2.domain.local, proceeding
0000243c.00000a98::2021/10/23-08:13:31.953 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn mydb4.domain.local (ipv4Count 2, ipv6Count 0)
0000243c.00000a98::2021/10/23-08:13:31.953 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.00000a98::2021/10/23-08:13:32.034 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner mydb4.domain.local (registered sets: 1, ipv4Count 2, ipv6Count 0, ptrCount 2)
0000243c.00000a98::2021/10/23-08:13:32.034 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.00000a98::2021/10/23-08:13:32.034 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Completed DNS Registration for Name: mydb4(Type: Singleton)
0000243c.00000a98::2021/10/23-08:13:32.034 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: InternalReplyHandler: 0
0000243c.000008ac::2021/10/23-08:13:32.034 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Updating status after a DNS registration
0000243c.000008ac::2021/10/23-08:13:32.034 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Last Dns Update time changed
000010a8.00001554::2021/10/23-08:13:32.034 INFO  [GUM] Node 1: executing request locally, gumId:25724, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:13:32.035 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:469 from node 1. Action: gum/do-update, Target: GUMA
0000243c.000029bc::2021/10/23-08:13:32.055 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn mydb2.domain.local (ipv4Count 2, ipv6Count 0)
0000243c.000029bc::2021/10/23-08:13:32.055 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.000008ac::2021/10/23-08:13:32.077 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.00000a98::2021/10/23-08:13:32.077 INFO  [RES] Network Name <mydb4_mydb4>: Client: Synching with slow operation
0000243c.000008ac::2021/10/23-08:13:32.126 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000008ac::2021/10/23-08:13:32.126 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000008ac::2021/10/23-08:13:32.126 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:13:32.126 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000008ac::2021/10/23-08:13:32.127 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000008ac::2021/10/23-08:13:32.127 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000008ac::2021/10/23-08:13:32.127 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000008ac::2021/10/23-08:13:32.128 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.166 Prefix: 10.16.1.166/24 (Actual address: 10.16.1.166), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000008ac::2021/10/23-08:13:32.128 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.166 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.166 Prefix: 10.30.0.166/24)
0000243c.000008ac::2021/10/23-08:13:32.128 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000008ac::2021/10/23-08:13:32.128 INFO  [RES] Network Name <mydb4_mydb4>: Client: Final alias is 10.16.1.166
0000243c.000008ac::2021/10/23-08:13:32.128 INFO  [RES] Network Name <mydb4_mydb4>: Client: RegisterFqdnWithLsa - Found FQDN mydb4.domain.local that is already registered with LSA
0000243c.000008ac::2021/10/23-08:13:32.128 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: InternalReplyHandler: 0
0000243c.000029bc::2021/10/23-08:13:32.136 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner mydb2.domain.local (registered sets: 1, ipv4Count 2, ipv6Count 0, ptrCount 2)
0000243c.000029bc::2021/10/23-08:13:32.136 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.000029bc::2021/10/23-08:13:32.136 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Completed DNS Registration for Name: mydb2 (Type: Singleton)
0000243c.000029bc::2021/10/23-08:13:32.136 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: InternalReplyHandler: 0
0000243c.000008ac::2021/10/23-08:13:32.136 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Updating status after a DNS registration
0000243c.000008ac::2021/10/23-08:13:32.136 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Last Dns Update time changed
000010a8.00001554::2021/10/23-08:13:32.136 INFO  [GUM] Node 1: executing request locally, gumId:25725, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:13:32.137 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:470 from node 1. Action: gum/do-update, Target: GUMA
0000243c.000008ac::2021/10/23-08:13:32.179 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.000029bc::2021/10/23-08:13:32.179 INFO  [RES] Network Name <mydb2_mydb2>: Client: Synching with slow operation
0000243c.000008ac::2021/10/23-08:13:32.206 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000008ac::2021/10/23-08:13:32.206 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000008ac::2021/10/23-08:13:32.206 DBG   [ClNet]                  DNS Suffix:
0000243c.000008ac::2021/10/23-08:13:32.206 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000008ac::2021/10/23-08:13:32.207 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000008ac::2021/10/23-08:13:32.207 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000008ac::2021/10/23-08:13:32.207 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000008ac::2021/10/23-08:13:32.207 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.164 Prefix: 10.16.1.164/24 (Actual address: 10.16.1.164), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000008ac::2021/10/23-08:13:32.207 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.164 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.164 Prefix: 10.30.0.164/24)
0000243c.000008ac::2021/10/23-08:13:32.207 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000008ac::2021/10/23-08:13:32.208 INFO  [RES] Network Name <mydb2_mydb2>: Client: Final alias is 10.16.1.164
0000243c.000008ac::2021/10/23-08:13:32.208 INFO  [RES] Network Name <mydb2_mydb2>: Client: RegisterFqdnWithLsa - Found FQDN mydb2.domain.local that is already registered with LSA
0000243c.000008ac::2021/10/23-08:13:32.208 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: InternalReplyHandler: 0
0000243c.000008ac::2021/10/23-08:13:34.303 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Configuration timer entry
0000243c.000008ac::2021/10/23-08:13:34.303 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Processing provider state changes - Rechecking 'Dns' and 'Netbios' modules
0000243c.000008ac::2021/10/23-08:13:34.303 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: StartTimerIfNeeded - bProviderStateChangeInProgress_ set to false
0000243c.000029bc::2021/10/23-08:13:34.303 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Dns - Rechecking config internally
0000243c.000008ac::2021/10/23-08:13:34.303 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: Cleaning up transports
0000243c.000008ac::2021/10/23-08:13:34.345 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: NetbiosRecheckReplyHandler: 0
0000243c.00000a98::2021/10/23-08:13:34.349 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet]                  DNS Suffix:
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00000a98::2021/10/23-08:13:34.349 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00000a98::2021/10/23-08:13:34.349 DBG   [ClNet]                  DNS Suffix:
0000243c.00000a98::2021/10/23-08:13:34.349 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.163 Prefix: 10.16.1.163/24 (Actual address: 10.16.1.163), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.163 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.163 Prefix: 10.30.0.163/24)
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.163
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.163
0000243c.00000a98::2021/10/23-08:13:34.350 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.164
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.165
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.166
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.00000a98::2021/10/23-08:13:34.351 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Registering into DNS Name: mydb1 (Type: Singleton)...
0000243c.00000a98::2021/10/23-08:13:34.357 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Impersonating VCO User 'mydb1$' to Update DNS registration.  IsCore? false
0000243c.000008ac::2021/10/23-08:13:34.358 INFO  [RES] Network Name <mydb1_mydb1>: Identity: Get Token Request, currently has a token
0000243c.00000a98::2021/10/23-08:13:34.358 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.00000a98::2021/10/23-08:13:34.358 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.00000a98::2021/10/23-08:13:34.358 INFO  [RES] Network Name: [NNLIB] Registering name mydb1 on DNS Network: Cluster Network 1, with 2 DNS Servers, 2 Virtual Addresses, 1 Domain Names
0000243c.00000a98::2021/10/23-08:13:34.358 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000a98::2021/10/23-08:13:34.358 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000a98::2021/10/23-08:13:34.358 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.163
0000243c.00000a98::2021/10/23-08:13:34.358 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.163
0000243c.00000a98::2021/10/23-08:13:34.358 INFO  [RES] Network Name: [NNLIB] Registering: mydb1.domain.local
0000243c.00000a98::2021/10/23-08:13:34.437 INFO  [RES] Network Name: [NNLIB] DNS Record there for mydb1.domain.local, proceeding
0000243c.00000a98::2021/10/23-08:13:34.597 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn mydb1.domain.local (ipv4Count 2, ipv6Count 0)
0000243c.00000a98::2021/10/23-08:13:34.597 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.00000a98::2021/10/23-08:13:34.678 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner mydb1.domain.local (registered sets: 1, ipv4Count 2, ipv6Count 0, ptrCount 2)
0000243c.00000a98::2021/10/23-08:13:34.678 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.00000a98::2021/10/23-08:13:34.678 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Completed DNS Registration for Name: mydb1 (Type: Singleton)
0000243c.00000a98::2021/10/23-08:13:34.678 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: InternalReplyHandler: 0
0000243c.000008ac::2021/10/23-08:13:34.678 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Updating status after a DNS registration
0000243c.000008ac::2021/10/23-08:13:34.678 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Last Dns Update time changed
000010a8.00001554::2021/10/23-08:13:34.678 INFO  [GUM] Node 1: executing request locally, gumId:25726, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:13:34.678 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:471 from node 1. Action: gum/do-update, Target: GUMA
0000243c.000008ac::2021/10/23-08:13:34.729 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.00000a98::2021/10/23-08:13:34.729 INFO  [RES] Network Name <mydb1_mydb1>: Client: Synching with slow operation
0000243c.00000a98::2021/10/23-08:13:34.739 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet]                  DNS Suffix:
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00000a98::2021/10/23-08:13:34.739 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00000a98::2021/10/23-08:13:34.739 DBG   [ClNet]                  DNS Suffix:
0000243c.00000a98::2021/10/23-08:13:34.739 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00000a98::2021/10/23-08:13:34.740 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00000a98::2021/10/23-08:13:34.740 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00000a98::2021/10/23-08:13:34.740 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00000a98::2021/10/23-08:13:34.740 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.163 Prefix: 10.16.1.163/24 (Actual address: 10.16.1.163), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00000a98::2021/10/23-08:13:34.740 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.163 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.163 Prefix: 10.30.0.163/24)
0000243c.00000a98::2021/10/23-08:13:34.740 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00000a98::2021/10/23-08:13:34.740 INFO  [RES] Network Name <mydb1_mydb1>: Client: Final alias is 10.16.1.163
0000243c.00000a98::2021/10/23-08:13:34.740 INFO  [RES] Network Name <mydb1_mydb1>: Client: RegisterFqdnWithLsa - Found FQDN mydb1.domain.local that is already registered with LSA
0000243c.00000a98::2021/10/23-08:13:34.740 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: InternalReplyHandler: 0
0000023c.00000678::2021/10/23-08:13:42.504 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.00002b04::2021/10/23-08:13:54.519 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_8.evtx completed.
00000054.00002870::2021/10/23-08:13:54.520 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_1.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.520 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_2.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.521 WARN  [RHS-WER] Failed to add file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_3.evtx to WER report 0x80070002.
00000054.00002870::2021/10/23-08:13:54.521 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_4.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.522 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_5.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.522 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_6.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.523 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_7.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.523 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_8.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.524 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_9.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.524 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_10.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.525 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_11.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.525 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_12.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.526 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_13.evtx to WER report.
00000054.00002870::2021/10/23-08:13:54.526 WARN  [RHS-WER] Failed to add file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_14.etl to WER report 0x80070002.
00000054.00002870::2021/10/23-08:13:54.526 WARN  [RHS-WER] Failed to add file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_118e1c10-2699-470e-b8ce-df8227ef2405_15.etl to WER report 0x80070002.
00000054.00002870::2021/10/23-08:13:57.885 INFO  [RHS-WER] WER ERROR report is submitted with flags 0x74. Result : WerDisabled.
00000054.00002870::2021/10/23-08:14:05.123 WARN  [RHS] Resource mydb3 is alive!
00000054.00002870::2021/10/23-08:14:05.311 WARN  [RHS] Resource mydb2 is alive!
00000054.00002870::2021/10/23-08:14:05.623 WARN  [RHS] Resource mydb4is alive!
00000054.00002870::2021/10/23-08:14:05.889 WARN  [RHS] Resource mydb1 is alive!
000010a8.000025f0::2021/10/23-08:14:31.587 WARN  Unhandled exception on the thread 9712, exception The requested operation is not supported.
0000023c.000026c8::2021/10/23-08:14:45.538 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000678::2021/10/23-08:15:42.633 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000678::2021/10/23-08:16:45.149 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.00000598::2021/10/23-08:16:45.281 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID '03747308-1442-4ac6-8400-2a736435caa1' did not receive healthinformation before HealthCheckTimeout
00000054.00000598::2021/10/23-08:16:45.281 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00000598::2021/10/23-08:16:45.281 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Resource Alive result 0.
00000054.00000598::2021/10/23-08:16:45.281 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID '03747308-1442-4ac6-8400-2a736435caa1' did not receive healthinformation before HealthCheckTimeout
00000054.00000598::2021/10/23-08:16:45.281 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00000598::2021/10/23-08:16:45.281 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Resource Alive result 0.
00000054.00000598::2021/10/23-08:16:45.281 WARN  [RHS] Resource mydb3 IsAlive has indicated failure.
00000054.00000598::2021/10/23-08:16:45.281 INFO  [RHS-WER] Scheduling WER ERROR report in 10.000. ReportId 7763308d-ac4f-436b-9aac-03c3feeca636;
000010a8.000025f0::2021/10/23-08:16:45.281 INFO  [RCM] HandleMonitorReply: FAILURENOTIFICATION for 'mydb3', gen(2) result 1/0.
000010a8.000025f0::2021/10/23-08:16:45.281 INFO  [RCM] Res mydb3: Online -> ProcessingFailure( StateUnknown )
000010a8.000025f0::2021/10/23-08:16:45.281 INFO  [RCM] TransitionToState(mydb3) Online-->ProcessingFailure.
000010a8.00001554::2021/10/23-08:16:45.281 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:472 from node 1. Action: causal, Target: CAUS
000010a8.000025f0::2021/10/23-08:16:45.281 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Online --> Pending)
000010a8.000025f0::2021/10/23-08:16:45.281 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb3)
000010a8.00001554::2021/10/23-08:16:45.281 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:473 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:16:45.281 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00000560::2021/10/23-08:16:45.281 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00000560::2021/10/23-08:16:45.281 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 03747308-1442-4ac6-8400-2a736435caa1.
000010a8.00000560::2021/10/23-08:16:45.281 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 03747308-1442-4ac6-8400-2a736435caa1.
000010a8.000025f0::2021/10/23-08:16:45.281 INFO  [RCM] resource mydb3: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.000025f0::2021/10/23-08:16:45.281 INFO  [RCM] numDependents is zero, auto-returning true
000010a8.000025f0::2021/10/23-08:16:45.281 INFO  [RCM] Resource mydb3 is causing group mydb3 to failover.
000010a8.000025f0::2021/10/23-08:16:45.281 INFO  [RCM] rcm::RcmGroup::Failover: (mydb3)
000010a8.000025f0::2021/10/23-08:16:45.281 INFO  [RCM] time since last failure is greater than failover period; resetting failoverCount to 0.
000010a8.000025f0::2021/10/23-08:16:45.281 WARN  [RCM] Failing over group mydb3, failoverCount 1, last time 2021/09/04-03:13:14.105.
000010a8.000025f0::2021/10/23-08:16:45.281 INFO  [RCM-plcmt] This node is director, making placement decision myself
000010a8.000025f0::2021/10/23-08:16:45.282 INFO  [RCM-plcmt] [Filter] Removing candidate: NodeCandidate(1) BanCode: CurrentNodeFilter (5016)
000010a8.000025f0::2021/10/23-08:16:45.282 INFO  [RCM] rcm::RcmGroup::NodeIsPossibleOwner: Group mydb3: Node:2 IsPossibleOwner:true
000010a8.00002498::2021/10/23-08:16:45.282 INFO  [RCM] applying timely STM connectivity snapshot for group mydb3
000010a8.000025f0::2021/10/23-08:16:45.282 INFO  [RCM-plcmt] filters reduced candidate list for group mydb3 to size 1, no need to run rankers
000010a8.000025f0::2021/10/23-08:16:45.282 INFO  [RCM-plcmt] placement manager result:  grp=mydb3 moveType=MoveType::Failover, node=2
000010a8.000025f0::2021/10/23-08:16:45.282 INFO  MTimer(GetPlacementAsDirector): [Total: 0 ms ( 0 s )]
000010a8.000025f0::2021/10/23-08:16:45.282 INFO  [RCM] Res mydb3: ProcessingFailure -> WaitingToTerminate( Failed )
000010a8.000025f0::2021/10/23-08:16:45.282 INFO  [RCM] TransitionToState(mydb3) ProcessingFailure-->[WaitingToTerminate to Failed].
000010a8.00002498::2021/10/23-08:16:45.282 INFO  [RCM] rcm::RcmGroup::FailoverWorker: (mydb3)
000010a8.000025f0::2021/10/23-08:16:45.282 INFO  [RCM] Res mydb3: [WaitingToTerminate to Failed] -> Terminating( Failed )
000010a8.000025f0::2021/10/23-08:16:45.282 INFO  [RCM] TransitionToState(mydb3) [WaitingToTerminate to Failed]-->[Terminating to Failed].
00000054.00000508::2021/10/23-08:16:45.282 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Lease Thread terminated
00000054.00000598::2021/10/23-08:16:45.282 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Connect to SQL Server ...
00000054.00002870::2021/10/23-08:16:45.437 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID 'cde1f575-9870-4967-8751-a7a1f8915591' did not receive healthinformation before HealthCheckTimeout
00000054.00002870::2021/10/23-08:16:45.437 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00002870::2021/10/23-08:16:45.437 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Resource Alive result 0.
00000054.00002870::2021/10/23-08:16:45.437 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID 'cde1f575-9870-4967-8751-a7a1f8915591' did not receive healthinformation before HealthCheckTimeout
00000054.00002870::2021/10/23-08:16:45.437 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00002870::2021/10/23-08:16:45.437 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Resource Alive result 0.
00000054.00002870::2021/10/23-08:16:45.437 WARN  [RHS] Resource mydb2 IsAlive has indicated failure.
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM] HandleMonitorReply: FAILURENOTIFICATION for 'mydb2', gen(2) result 1/0.
00000054.00002870::2021/10/23-08:16:45.437 INFO  [RHS-WER] Scheduling WER ERROR report in 10.000. ReportId 81b8730b-f27b-4e5b-ba09-14f200359e51;
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM] Res mydb2: Online -> ProcessingFailure( StateUnknown )
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM] TransitionToState(mydb2) Online-->ProcessingFailure.
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb2, Online --> Pending)
000010a8.000025f0::2021/10/23-08:16:45.437 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:474 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:16:45.437 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb2)
000010a8.000025f0::2021/10/23-08:16:45.437 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:475 from node 1. Action: causal, Target: CAUS
000010a8.00001554::2021/10/23-08:16:45.437 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00001554::2021/10/23-08:16:45.437 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00001554::2021/10/23-08:16:45.437 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource cde1f575-9870-4967-8751-a7a1f8915591.
000010a8.00001554::2021/10/23-08:16:45.437 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource cde1f575-9870-4967-8751-a7a1f8915591.
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM] resource mydb2: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM] numDependents is zero, auto-returning true
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM] Resource mydb2 is causing group mydb2 to failover.
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM] rcm::RcmGroup::Failover: (mydb2)
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM] time since last failure is greater than failover period; resetting failoverCount to 0.
000010a8.00000560::2021/10/23-08:16:45.437 WARN  [RCM] Failing over group mydb2, failoverCount 1, last time 2021/07/24-03:12:46.933.
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM-plcmt] This node is director, making placement decision myself
000010a8.00000560::2021/10/23-08:16:45.437 INFO  [RCM-plcmt] [Filter] Removing candidate: NodeCandidate(1) BanCode: CurrentNodeFilter (5016)
000010a8.00000560::2021/10/23-08:16:45.438 INFO  [RCM] rcm::RcmGroup::NodeIsPossibleOwner: Group mydb2: Node:2 IsPossibleOwner:true
000010a8.0000199c::2021/10/23-08:16:45.438 INFO  [RCM] applying timely STM connectivity snapshot for group mydb2
000010a8.00000560::2021/10/23-08:16:45.438 INFO  [RCM-plcmt] filters reduced candidate list for group mydb2 to size 1, no need to run rankers
000010a8.00000560::2021/10/23-08:16:45.438 INFO  [RCM-plcmt] placement manager result:  grp=mydb2 moveType=MoveType::Failover, node=2
000010a8.00000560::2021/10/23-08:16:45.438 INFO  MTimer(GetPlacementAsDirector): [Total: 0 ms ( 0 s )]
000010a8.00000560::2021/10/23-08:16:45.438 INFO  [RCM] Res mydb2: ProcessingFailure -> WaitingToTerminate( Failed )
000010a8.0000199c::2021/10/23-08:16:45.438 INFO  [RCM] rcm::RcmGroup::FailoverWorker: (mydb2)
000010a8.00000560::2021/10/23-08:16:45.438 INFO  [RCM] TransitionToState(mydb2) ProcessingFailure-->[WaitingToTerminate to Failed].
000010a8.00000560::2021/10/23-08:16:45.438 INFO  [RCM] Res mydb2: [WaitingToTerminate to Failed] -> Terminating( Failed )
000010a8.00000560::2021/10/23-08:16:45.438 INFO  [RCM] TransitionToState(mydb2) [WaitingToTerminate to Failed]-->[Terminating to Failed].
00000054.000009bc::2021/10/23-08:16:45.438 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Lease Thread terminated
00000054.000029a8::2021/10/23-08:16:45.438 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] Connect to SQL Server ...
00000054.00002870::2021/10/23-08:16:45.734 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID '010c15c7-6b6a-4c70-a40a-1c918e69010c' did not receive healthinformation before HealthCheckTimeout
00000054.00002870::2021/10/23-08:16:45.734 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00002870::2021/10/23-08:16:45.734 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Resource Alive result 0.
00000054.00002870::2021/10/23-08:16:45.734 INFO  [RES] SQL Server Availability Group: [hadrag] Availability Group with resource ID '010c15c7-6b6a-4c70-a40a-1c918e69010c' did not receive healthinformation before HealthCheckTimeout
00000054.00002870::2021/10/23-08:16:45.734 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.00002870::2021/10/23-08:16:45.734 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Resource Alive result 0.
00000054.00002870::2021/10/23-08:16:45.734 WARN  [RHS] Resource mydb4IsAlive has indicated failure.
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] HandleMonitorReply: FAILURENOTIFICATION for 'mydb4', gen(2) result 1/0.
00000054.00002870::2021/10/23-08:16:45.734 INFO  [RHS-WER] Scheduling WER ERROR report in 10.000. ReportId 5e8baddb-c9f2-4fd0-a75d-a7bfd079170c;
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] Res mydb4: Online -> ProcessingFailure( StateUnknown )
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] TransitionToState(mydb4) Online-->ProcessingFailure.
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb4, Online --> Pending)
000010a8.00000560::2021/10/23-08:16:45.734 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb4)
000010a8.000025f0::2021/10/23-08:16:45.734 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:476 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] resource mydb4: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] numDependents is zero, auto-returning true
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] Resource mydb4is causing group mydb4to failover.
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] rcm::RcmGroup::Failover: (mydb4)
000010a8.00001554::2021/10/23-08:16:45.734 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00001554::2021/10/23-08:16:45.734 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00001554::2021/10/23-08:16:45.734 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 010c15c7-6b6a-4c70-a40a-1c918e69010c.
000010a8.00001554::2021/10/23-08:16:45.734 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 010c15c7-6b6a-4c70-a40a-1c918e69010c.
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] time since last failure is greater than failover period; resetting failoverCount to 0.
000010a8.00000560::2021/10/23-08:16:45.734 WARN  [RCM] Failing over group mydb4, failoverCount 1, last time 2021/09/18-03:33:32.308.
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM-plcmt] This node is director, making placement decision myself
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM-plcmt] [Filter] Removing candidate: NodeCandidate(1) BanCode: CurrentNodeFilter (5016)
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] rcm::RcmGroup::NodeIsPossibleOwner: Group mydb4: Node:2 IsPossibleOwner:true
000010a8.00001554::2021/10/23-08:16:45.734 INFO  [RCM] applying timely STM connectivity snapshot for group mydb4
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM-plcmt] filters reduced candidate list for group mydb4to size 1, no need to run rankers
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM-plcmt] placement manager result:  grp=mydb4moveType=MoveType::Failover, node=2
000010a8.00000560::2021/10/23-08:16:45.734 INFO  MTimer(GetPlacementAsDirector): [Total: 0 ms ( 0 s )]
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] Res mydb4: ProcessingFailure -> WaitingToTerminate( Failed )
000010a8.00001554::2021/10/23-08:16:45.734 INFO  [RCM] rcm::RcmGroup::FailoverWorker: (mydb4)
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] TransitionToState(mydb4) ProcessingFailure-->[WaitingToTerminate to Failed].
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] Res mydb4: [WaitingToTerminate to Failed] -> Terminating( Failed )
000010a8.00000560::2021/10/23-08:16:45.734 INFO  [RCM] TransitionToState(mydb4) [WaitingToTerminate to Failed]-->[Terminating to Failed].
00000054.00001d54::2021/10/23-08:16:45.734 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Lease Thread terminated
00000054.00002870::2021/10/23-08:16:45.735 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] Connect to SQL Server ...
00000054.00001ba4::2021/10/23-08:16:55.291 INFO  [RHS-WER] 264172 milliseconds (264 seconds) passed since last WER ERROR report 118e1c10-2699-470e-b8ce-df8227ef2405 for the resource type SQL Server Availability Group call type ISALIVE. Throttling this report
00000054.00001ba4::2021/10/23-08:16:55.447 INFO  [RHS-WER] 264328 milliseconds (264 seconds) passed since last WER ERROR report 118e1c10-2699-470e-b8ce-df8227ef2405 for the resource type SQL Server Availability Group call type ISALIVE. Throttling this report
00000054.00001ba4::2021/10/23-08:16:55.744 INFO  [RHS-WER] 264625 milliseconds (264 seconds) passed since last WER ERROR report 118e1c10-2699-470e-b8ce-df8227ef2405 for the resource type SQL Server Availability Group call type ISALIVE. Throttling this report
00000054.000029a8::2021/10/23-08:17:05.450 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] ODBC Error: [08001] [Microsoft][SQL Server Native Client 11.0]TCP Provider: Timeout error [258].  (258)
00000054.000029a8::2021/10/23-08:17:05.450 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] ODBC Error: [HYT00] [Microsoft][SQL Server Native Client 11.0]Login timeout expired (0)
00000054.000029a8::2021/10/23-08:17:05.450 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] ODBC Error: [08001] [Microsoft][SQL Server Native Client 11.0]Unable to complete login process due to delay in prelogin response (258)
00000054.000029a8::2021/10/23-08:17:05.450 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] Could not connect to SQL Server (rc -1)
00000054.000029a8::2021/10/23-08:17:05.450 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] SQLDisconnect returns following information
00000054.000029a8::2021/10/23-08:17:05.450 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] ODBC Error: [08003] [Microsoft][ODBC Driver Manager] Connection not open (0)
00000054.000029a8::2021/10/23-08:17:05.450 ERR   [RES] SQL Server Availability Group <mydb2>: [hadrag] Failed to connect to SQL Server
00000054.000029a8::2021/10/23-08:17:05.450 INFO  [RES] SQL Server Availability Group <mydb2>: [hadrag] Offline call failed in Terminate function
000010a8.00002728::2021/10/23-08:17:05.450 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb2', gen(3) result 0/0.
000010a8.00002728::2021/10/23-08:17:05.450 INFO  [RCM] Res mydb2: [Terminating to Failed] -> Failed( StateUnknown )
000010a8.00002728::2021/10/23-08:17:05.450 INFO  [RCM] TransitionToState(mydb2) [Terminating to Failed]-->Failed.
000010a8.00002728::2021/10/23-08:17:05.451 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb2, Pending --> Failed)
000010a8.00000560::2021/10/23-08:17:05.451 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:477 from node 1. Action: causal, Target: CAUS
000010a8.0000199c::2021/10/23-08:17:05.497 INFO  [RCM] ordering failover of group mydb2 to node 2
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] rcm::RcmGroup::Move: (mydb2, 2, MoveType::Failover)
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] rcm::RcmGroup::Move: Bringing group 'mydb2' offline first...
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] Res mydb2_10.16.1.164: Online -> WaitingToGoOffline( StateUnknown )
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] TransitionToState(mydb2_10.16.1.164) Online-->WaitingToGoOffline.
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb2, Failed --> Pending)
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] Bringing dependent resource 'mydb2_mydb2' offline before provider resource 'mydb2_10.16.1.164'.
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] Res mydb2_mydb2: Online -> WaitingToGoOffline( StateUnknown )
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] TransitionToState(mydb2_mydb2) Online-->WaitingToGoOffline.
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] Res mydb2_mydb2: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] TransitionToState(mydb2_mydb2) WaitingToGoOffline-->OfflineCallIssued.
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] 'mydb2_10.16.1.164' cannot go offline yet; Dependent Resource 'mydb2_mydb2' is in state OfflineCallIssued.
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] Res mydb2_10.16.1.164: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.000006e0::2021/10/23-08:17:05.498 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:478 from node 1. Action: causal, Target: CAUS
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] Res mydb2: Failed -> Offline( StateUnknown )
000010a8.0000199c::2021/10/23-08:17:05.498 INFO  [RCM] TransitionToState(mydb2) Failed-->Offline.
000010a8.000006e0::2021/10/23-08:17:05.498 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:479 from node 1. Action: causal, Target: CAUS
0000243c.00002994::2021/10/23-08:17:05.498 INFO  [RES] Network Name <mydb2_mydb2>: Offline called for resource mydb2_mydb2
000010a8.00000560::2021/10/23-08:17:05.498 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb2_mydb2', gen(0) result 997/0.
000010a8.00000560::2021/10/23-08:17:05.498 INFO  [RCM] Res mydb2_mydb2: OfflineCallIssued -> OfflinePending( StateUnknown )
000010a8.00000560::2021/10/23-08:17:05.498 INFO  [RCM] TransitionToState(mydb2_mydb2) OfflineCallIssued-->OfflinePending.
0000243c.00002698::2021/10/23-08:17:05.498 INFO  [RES] Network Name <mydb2_mydb2>: Entering Offline thread
0000243c.00002698::2021/10/23-08:17:05.498 INFO  [RES] Network Name <mydb2_mydb2>: Performing actual offline of resource.
0000243c.00002698::2021/10/23-08:17:05.498 INFO  [RES] Network Name: Agent: Closing (f70cf510-b293-448c-89c9-9313e8be742c,AdminShare)
0000243c.00002994::2021/10/23-08:17:05.499 INFO  [RES] Network Name: Agent: OnClose (f70cf510-b293-448c-89c9-9313e8be742c,AdminShare)
0000243c.000008ac::2021/10/23-08:17:05.499 INFO  [RES] Network Name <mydb2_mydb2>: AdminShare: Canceling work, state: Closing/Idle
0000243c.000008ac::2021/10/23-08:17:05.499 INFO  [RES] Network Name <mydb2_mydb2>: AdminShare: OnCloseBase, previous state: Initialized/Idle
0000243c.00002994::2021/10/23-08:17:05.512 INFO  [RES] Network Name: Agent: OnCloseReply (f70cf510-b293-448c-89c9-9313e8be742c,AdminShare) result: 0
0000243c.00002994::2021/10/23-08:17:05.512 INFO  [RES] Network Name <mydb2_mydb2>: SyncReplyHandler Configuration, result: 0
0000243c.00002698::2021/10/23-08:17:05.512 INFO  [RES] Network Name: Agent: Closing (f70cf510-b293-448c-89c9-9313e8be742c,Configuration)
0000243c.00002994::2021/10/23-08:17:05.512 INFO  [RES] Network Name: Agent: OnClose (f70cf510-b293-448c-89c9-9313e8be742c,Configuration)
0000243c.00002994::2021/10/23-08:17:05.513 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Canceling work, state: Closing/Idle
0000243c.00002994::2021/10/23-08:17:05.513 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: OnCloseBase, previous state: Initialized/Idle
0000243c.00002994::2021/10/23-08:17:05.513 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Closing... (PreviousState: Initialized, Created: true, Type: Singleton)
0000243c.00002994::2021/10/23-08:17:05.513 INFO  [RES] Network Name: Agent: Closing (f70cf510-b293-448c-89c9-9313e8be742c,AccountAD)
0000243c.00002994::2021/10/23-08:17:05.513 INFO  [RES] Network Name: Agent: Closing (f70cf510-b293-448c-89c9-9313e8be742c,Dns)
0000243c.00002738::2021/10/23-08:17:05.513 INFO  [RES] Network Name: Agent: OnClose (f70cf510-b293-448c-89c9-9313e8be742c,AccountAD)
0000243c.00002994::2021/10/23-08:17:05.513 INFO  [RES] Network Name: Agent: Closing (f70cf510-b293-448c-89c9-9313e8be742c,Client)
0000243c.00002738::2021/10/23-08:17:05.513 INFO  [RES] Network Name: Agent: OnClose (f70cf510-b293-448c-89c9-9313e8be742c,Dns)
0000243c.00002738::2021/10/23-08:17:05.513 INFO  [RES] Network Name: Agent: OnClose (f70cf510-b293-448c-89c9-9313e8be742c,Client)
0000243c.00000a98::2021/10/23-08:17:05.513 INFO  [RES] Network Name <mydb2_mydb2>: AccountAD: Canceling work, state: Closing/Idle
0000243c.000029bc::2021/10/23-08:17:05.513 INFO  [RES] Network Name <mydb2_mydb2>: Dns: Canceling work, state: Closing/Idle
0000243c.00000a98::2021/10/23-08:17:05.513 INFO  [RES] Network Name <mydb2_mydb2>: AccountAD: OnCloseBase, previous state: Initialized/Idle
0000243c.000029bc::2021/10/23-08:17:05.513 INFO  [RES] Network Name <mydb2_mydb2>: Dns: OnCloseBase, previous state: Initialized/Idle
0000243c.00002b38::2021/10/23-08:17:05.513 INFO  [RES] Network Name <mydb2_mydb2>: Client: Canceling work, state: Closing/Idle
0000243c.000029bc::2021/10/23-08:17:05.513 INFO  [RES] Network Name: Agent: OnCloseReply (f70cf510-b293-448c-89c9-9313e8be742c,Dns) result: 0
0000243c.00002b38::2021/10/23-08:17:05.513 INFO  [RES] Network Name <mydb2_mydb2>: Client: OnCloseBase, previous state: Initialized/Idle
0000243c.000029bc::2021/10/23-08:17:05.513 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Finish Closing NetName (type Singleton) Module Dns, result 0, remaining... 3 (0)
0000243c.00000a98::2021/10/23-08:17:05.513 INFO  [RES] Network Name: [NNLIB] Removing alias 10.16.1.164 for target mydb2
0000243c.00002738::2021/10/23-08:17:05.514 INFO  [RES] Network Name: Agent: OnCloseReply (f70cf510-b293-448c-89c9-9313e8be742c,AccountAD) result: 0
0000243c.00002738::2021/10/23-08:17:05.514 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Finish Closing NetName (type Singleton) Module AccountAD, result 0, remaining... 2 (0)
0000243c.00000a98::2021/10/23-08:17:05.515 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 122, result size 0 (status: 0, subStatus: 0)
0000243c.00000a98::2021/10/23-08:17:05.515 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 122, result size 0 (status: 0, subStatus: 0)
0000243c.00000a98::2021/10/23-08:17:05.515 INFO  [RES] Network Name: [NNLIB] Success on credential operation remove on Account mydb2$, status: 0 (subStatus: 0)
0000243c.00000a98::2021/10/23-08:17:05.515 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 70, result size 0 (status: 0, subStatus: 0)
0000243c.00000a98::2021/10/23-08:17:05.515 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb2.domain.local, status: 0, subStatus: 0
0000243c.00000a98::2021/10/23-08:17:05.516 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 44, result size 0 (status: 0, subStatus: 0)
0000243c.00000a98::2021/10/23-08:17:05.516 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb2, status: 0, subStatus: 0
0000243c.00000a98::2021/10/23-08:17:05.516 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 44, result size 0 (status: 0, subStatus: 0)
0000243c.00000a98::2021/10/23-08:17:05.516 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb2, status: 0, subStatus: 0
0000243c.00000a98::2021/10/23-08:17:05.516 INFO  [RES] Network Name <mydb2_mydb2>: Client: Unregistering netname for multichannel support returned 0
0000243c.00000a98::2021/10/23-08:17:05.516 INFO  [RES] Network Name: Agent: OnCloseReply (f70cf510-b293-448c-89c9-9313e8be742c,Client) result: 0
0000243c.00000a98::2021/10/23-08:17:05.516 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Finish Closing NetName (type Singleton) Module Client, result 0, remaining... 1 (0)
0000243c.00000a98::2021/10/23-08:17:05.516 INFO  [RES] Network Name: Agent: Closing (f70cf510-b293-448c-89c9-9313e8be742c,Netbios)
0000243c.00000a98::2021/10/23-08:17:05.516 INFO  [RES] Network Name: Agent: OnClose (f70cf510-b293-448c-89c9-9313e8be742c,Netbios)
0000243c.00000a98::2021/10/23-08:17:05.517 INFO  [RES] Network Name <mydb2_mydb2>: Netbios: Canceling work, state: Closing/Idle
0000243c.00000a98::2021/10/23-08:17:05.517 INFO  [RES] Network Name <mydb2_mydb2>: Netbios: OnCloseBase, previous state: Initialized/Idle
00000054.00002870::2021/10/23-08:17:05.747 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] ODBC Error: [08001] [Microsoft][SQL Server Native Client 11.0]TCP Provider: Timeout error [258].  (258)
00000054.00002870::2021/10/23-08:17:05.747 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] ODBC Error: [HYT00] [Microsoft][SQL Server Native Client 11.0]Login timeout expired (0)
00000054.00002870::2021/10/23-08:17:05.747 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] ODBC Error: [08001] [Microsoft][SQL Server Native Client 11.0]Unable to complete login process due to delay in prelogin response (258)
00000054.00002870::2021/10/23-08:17:05.747 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] Could not connect to SQL Server (rc -1)
00000054.00002870::2021/10/23-08:17:05.747 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] SQLDisconnect returns following information
00000054.00002870::2021/10/23-08:17:05.747 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] ODBC Error: [08003] [Microsoft][ODBC Driver Manager] Connection not open (0)
00000054.00002870::2021/10/23-08:17:05.747 ERR   [RES] SQL Server Availability Group <mydb4>: [hadrag] Failed to connect to SQL Server
00000054.00002870::2021/10/23-08:17:05.747 INFO  [RES] SQL Server Availability Group <mydb4>: [hadrag] Offline call failed in Terminate function
000010a8.000006e0::2021/10/23-08:17:05.747 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb4', gen(3) result 0/0.
000010a8.000006e0::2021/10/23-08:17:05.747 INFO  [RCM] Res mydb4: [Terminating to Failed] -> Failed( StateUnknown )
000010a8.000006e0::2021/10/23-08:17:05.747 INFO  [RCM] TransitionToState(mydb4) [Terminating to Failed]-->Failed.
000010a8.000006e0::2021/10/23-08:17:05.747 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb4, Pending --> Failed)
000010a8.00000560::2021/10/23-08:17:05.747 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:480 from node 1. Action: causal, Target: CAUS
000010a8.000006e0::2021/10/23-08:17:05.747 INFO  [RCM] 'mydb2_10.16.1.164' cannot go offline yet; Dependent Resource 'mydb2_mydb2' is in state OfflinePending.
000010a8.000006e0::2021/10/23-08:17:05.747 INFO  [RCM] Res mydb2_10.16.1.164: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] ordering failover of group mydb4to node 2
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] rcm::RcmGroup::Move: (mydb4, 2, MoveType::Failover)
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] rcm::RcmGroup::Move: Bringing group 'mydb4' offline first...
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] Res mydb4: Failed -> Offline( StateUnknown )
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] TransitionToState(mydb4) Failed-->Offline.
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb4, Failed --> Offline)
000010a8.00000560::2021/10/23-08:17:05.778 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:481 from node 1. Action: causal, Target: CAUS
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] Res mydb4_10.16.1.166: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] TransitionToState(mydb4_10.16.1.166) Online-->WaitingToGoOffline.
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb4, Offline --> Pending)
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] Bringing dependent resource 'mydb4_mydb4' offline before provider resource 'mydb4_10.16.1.166'.
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] Res mydb4_mydb4: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] TransitionToState(mydb4_mydb4) Online-->WaitingToGoOffline.
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] Res mydb4_mydb4: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] TransitionToState(mydb4_mydb4) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] 'mydb4_10.16.1.166' cannot go offline yet; Dependent Resource 'mydb4_mydb4' is in state OfflineCallIssued.
000010a8.00001554::2021/10/23-08:17:05.778 INFO  [RCM] Res mydb4_10.16.1.166: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.0000199c::2021/10/23-08:17:05.778 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:482 from node 1. Action: causal, Target: CAUS
0000243c.00002738::2021/10/23-08:17:05.779 INFO  [RES] Network Name <mydb4_mydb4>: Offline called for resource mydb4_mydb4
000010a8.00002728::2021/10/23-08:17:05.779 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb4_mydb4', gen(0) result 997/0.
000010a8.00002728::2021/10/23-08:17:05.779 INFO  [RCM] Res mydb4_mydb4: OfflineCallIssued -> OfflinePending( StateUnknown )
000010a8.00002728::2021/10/23-08:17:05.779 INFO  [RCM] TransitionToState(mydb4_mydb4) OfflineCallIssued-->OfflinePending.
0000243c.00000f7c::2021/10/23-08:17:05.779 INFO  [RES] Network Name <mydb4_mydb4>: Entering Offline thread
0000243c.00000f7c::2021/10/23-08:17:05.779 INFO  [RES] Network Name <mydb4_mydb4>: Performing actual offline of resource.
0000243c.00000f7c::2021/10/23-08:17:05.779 INFO  [RES] Network Name: Agent: Closing (eb44dd7f-7717-4f70-b74f-a2d373c3217a,AdminShare)
0000243c.00002738::2021/10/23-08:17:05.779 INFO  [RES] Network Name: Agent: OnClose (eb44dd7f-7717-4f70-b74f-a2d373c3217a,AdminShare)
0000243c.00002738::2021/10/23-08:17:05.779 INFO  [RES] Network Name <mydb4_mydb4>: AdminShare: Canceling work, state: Closing/Idle
0000243c.00002738::2021/10/23-08:17:05.779 INFO  [RES] Network Name <mydb4_mydb4>: AdminShare: OnCloseBase, previous state: Initialized/Idle
0000243c.00002738::2021/10/23-08:17:05.794 INFO  [RES] Network Name: Agent: OnCloseReply (eb44dd7f-7717-4f70-b74f-a2d373c3217a,AdminShare) result: 0
0000243c.00002738::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: SyncReplyHandler Configuration, result: 0
0000243c.00000f7c::2021/10/23-08:17:05.794 INFO  [RES] Network Name: Agent: Closing (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Configuration)
0000243c.00002738::2021/10/23-08:17:05.794 INFO  [RES] Network Name: Agent: OnClose (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Configuration)
0000243c.00002738::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Canceling work, state: Closing/Idle
0000243c.00002738::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: OnCloseBase, previous state: Initialized/Idle
0000243c.00002738::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Closing... (PreviousState: Initialized, Created: true, Type: Singleton)
0000243c.00002738::2021/10/23-08:17:05.794 INFO  [RES] Network Name: Agent: Closing (eb44dd7f-7717-4f70-b74f-a2d373c3217a,AccountAD)
0000243c.00002738::2021/10/23-08:17:05.794 INFO  [RES] Network Name: Agent: Closing (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Dns)
0000243c.000029bc::2021/10/23-08:17:05.794 INFO  [RES] Network Name: Agent: OnClose (eb44dd7f-7717-4f70-b74f-a2d373c3217a,AccountAD)
0000243c.00002738::2021/10/23-08:17:05.794 INFO  [RES] Network Name: Agent: Closing (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Client)
0000243c.000029bc::2021/10/23-08:17:05.794 INFO  [RES] Network Name: Agent: OnClose (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Dns)
0000243c.00002b38::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: AccountAD: Canceling work, state: Closing/Idle
0000243c.00002b38::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: AccountAD: OnCloseBase, previous state: Initialized/Idle
0000243c.00002b38::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: Dns: Canceling work, state: Closing/Idle
0000243c.00002b38::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: Dns: OnCloseBase, previous state: Initialized/Idle
0000243c.000029bc::2021/10/23-08:17:05.794 INFO  [RES] Network Name: Agent: OnClose (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Client)
0000243c.000029bc::2021/10/23-08:17:05.794 INFO  [RES] Network Name: Agent: OnCloseReply (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Dns) result: 0
0000243c.000029bc::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: Client: Canceling work, state: Closing/Idle
0000243c.000029bc::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: Client: OnCloseBase, previous state: Initialized/Idle
0000243c.000029bc::2021/10/23-08:17:05.794 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Finish Closing NetName (type Singleton) Module Dns, result 0, remaining... 3 (0)
0000243c.000029bc::2021/10/23-08:17:05.794 INFO  [RES] Network Name: [NNLIB] Removing alias 10.16.1.166 for target mydb4
0000243c.00002b38::2021/10/23-08:17:05.795 INFO  [RES] Network Name: Agent: OnCloseReply (eb44dd7f-7717-4f70-b74f-a2d373c3217a,AccountAD) result: 0
0000243c.000023a8::2021/10/23-08:17:05.795 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Finish Closing NetName (type Singleton) Module AccountAD, result 0, remaining... 2 (0)
0000243c.000029bc::2021/10/23-08:17:05.796 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 122, result size 0 (status: 0, subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:05.796 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 122, result size 0 (status: 0, subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:05.796 INFO  [RES] Network Name: [NNLIB] Success on credential operation remove on Account mydb4$, status: 0 (subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:05.796 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 70, result size 0 (status: 0, subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:05.796 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb4.domain.local, status: 0, subStatus: 0
0000243c.000029bc::2021/10/23-08:17:05.797 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 44, result size 0 (status: 0, subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:05.797 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb4, status: 0, subStatus: 0
0000243c.000029bc::2021/10/23-08:17:05.797 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 44, result size 0 (status: 0, subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:05.797 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb4, status: 0, subStatus: 0
0000243c.000029bc::2021/10/23-08:17:05.798 INFO  [RES] Network Name <mydb4_mydb4>: Client: Unregistering netname for multichannel support returned 0
0000243c.000029bc::2021/10/23-08:17:05.798 INFO  [RES] Network Name: Agent: OnCloseReply (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Client) result: 0
0000243c.000023a8::2021/10/23-08:17:05.798 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Finish Closing NetName (type Singleton) Module Client, result 0, remaining... 1 (0)
0000243c.000023a8::2021/10/23-08:17:05.798 INFO  [RES] Network Name: Agent: Closing (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Netbios)
0000243c.000029bc::2021/10/23-08:17:05.798 INFO  [RES] Network Name: Agent: OnClose (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Netbios)
0000243c.000023a8::2021/10/23-08:17:05.798 INFO  [RES] Network Name <mydb4_mydb4>: Netbios: Canceling work, state: Closing/Idle
0000243c.000023a8::2021/10/23-08:17:05.798 INFO  [RES] Network Name <mydb4_mydb4>: Netbios: OnCloseBase, previous state: Initialized/Idle
0000243c.00000a98::2021/10/23-08:17:06.785 INFO  [RES] Network Name: [NNLIB] Deregistered server name mydb2 on transport \Device\NetbiosSmb
0000243c.000029bc::2021/10/23-08:17:07.201 INFO  [RES] Network Name: [NNLIB] Deregistered server name mydb4on transport \Device\NetbiosSmb
0000243c.00000a98::2021/10/23-08:17:07.212 INFO  [RES] Network Name: [NNLIB] Deleted server name: mydb2 from all transports
0000243c.00000a98::2021/10/23-08:17:07.213 INFO  [RES] Network Name: [NNLIB] Deleting Server Name for server name: mydb2, ret: 0
0000243c.00000478::2021/10/23-08:17:07.213 INFO  [RES] Network Name <mydb2_mydb2>: Netbios: Cleaning up transports
0000243c.000029bc::2021/10/23-08:17:07.462 INFO  [RES] Network Name: [NNLIB] Deleted server name: mydb4from all transports
0000243c.000029bc::2021/10/23-08:17:07.462 INFO  [RES] Network Name: [NNLIB] Deleting Server Name for server name: mydb4, ret: 0
0000243c.000023a8::2021/10/23-08:17:07.462 INFO  [RES] Network Name <mydb4_mydb4>: Netbios: Cleaning up transports
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: OnCloseReply (f70cf510-b293-448c-89c9-9313e8be742c,Netbios) result: 0
0000243c.00000478::2021/10/23-08:17:07.465 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Finish Closing NetName (type Singleton) Module Netbios, result 0, remaining... 0 (0)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: -- listing 5 instances ---------------------------------------------
0000243c.00002994::2021/10/23-08:17:07.465 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Closed
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 1763b060-dff9-4961-8280-b1b5c0f92039:
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.00002994::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: OnCloseReply (f70cf510-b293-448c-89c9-9313e8be742c,Configuration) result: 0
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.00002994::2021/10/23-08:17:07.465 INFO  [RES] Network Name <mydb2_mydb2>: SyncReplyHandler Configuration, result: 0
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.00002698::2021/10/23-08:17:07.465 INFO  [RHS] Resource mydb2_mydb2 has come offline. RHS is about to report resource status to RCM.
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: --- 7 modules for instance: df59581d-6cb0-41d3-a597-dbce46545dcd:
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: --- 7 modules for instance: eb44dd7f-7717-4f70-b74f-a2d373c3217a:
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Closing/Ending (Alive)
000010a8.00002728::2021/10/23-08:17:07.465 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb2_mydb2', gen(0) result 0/0.
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
000010a8.00002728::2021/10/23-08:17:07.465 INFO  [RCM] Res mydb2_mydb2: OfflinePending -> OfflineSavingCheckpoints( StateUnknown )
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
000010a8.00002728::2021/10/23-08:17:07.465 INFO  [RCM] TransitionToState(mydb2_mydb2) OfflinePending-->OfflineSavingCheckpoints.
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
000010a8.00002728::2021/10/23-08:17:07.465 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00002728::2021/10/23-08:17:07.465 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00002728::2021/10/23-08:17:07.465 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: --- 7 modules for instance: ed158bf7-8c56-4e3e-9187-15f9c63678a5:
000010a8.00002728::2021/10/23-08:17:07.465 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id f70cf510-b293-448c-89c9-9313e8be742c and name mydb2_mydb2
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id f70cf510-b293-448c-89c9-9313e8be742c
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource f70cf510-b293-448c-89c9-9313e8be742c in RcmResource
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource f70cf510-b293-448c-89c9-9313e8be742c
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource f70cf510-b293-448c-89c9-9313e8be742c.
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource f70cf510-b293-448c-89c9-9313e8be742c.
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource f70cf510-b293-448c-89c9-9313e8be742c finished, about to signal Checkpoint completion
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [RCM] Res mydb2_mydb2: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [RCM] TransitionToState(mydb2_mydb2) OfflineSavingCheckpoints-->Offline.
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: --- 7 modules for instance: f70cf510-b293-448c-89c9-9313e8be742c:
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
000010a8.00002728::2021/10/23-08:17:07.465 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:483 from node 1. Action: causal, Target: CAUS
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource f70cf510-b293-448c-89c9-9313e8be742c
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id f70cf510-b293-448c-89c9-9313e8be742c and name mydb2_mydb2
0000243c.00000a98::2021/10/23-08:17:07.465 INFO  [RES] Network Name: Agent: -- 0 Orphan modules
000010a8.0000199c::2021/10/23-08:17:07.465 INFO  [RCM] Res mydb2_10.16.1.164: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.0000199c::2021/10/23-08:17:07.465 INFO  [RCM] TransitionToState(mydb2_10.16.1.164) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00000560::2021/10/23-08:17:07.465 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:484 from node 1. Action: causal, Target: CAUS
000010a8.0000199c::2021/10/23-08:17:07.466 INFO  [RCM] 'mydb4_10.16.1.166' cannot go offline yet; Dependent Resource 'mydb4_mydb4' is in state OfflinePending.
000010a8.0000199c::2021/10/23-08:17:07.466 INFO  [RCM] Res mydb4_10.16.1.166: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
0000023c.00002acc::2021/10/23-08:17:07.466 INFO  [RES] IP Address <mydb2_10.16.1.164>: Taking resource offline...
0000023c.00002acc::2021/10/23-08:17:07.466 INFO  [RES] IP Address <mydb2_10.16.1.164>: Deleting IP address 10.16.1.164.
0000023c.00002acc::2021/10/23-08:17:07.466 INFO  [RES] IP Address <mydb2_10.16.1.164>: Address 10.16.1.164 on adapter vmxnet3 Ethernet Adapter offline.
000010a8.00001554::2021/10/23-08:17:07.466 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb2_10.16.1.164', gen(0) result 0/0.
000010a8.00001554::2021/10/23-08:17:07.466 INFO  [RCM] Res mydb2_10.16.1.164: OfflineCallIssued -> OfflineSavingCheckpoints( StateUnknown )
000010a8.00001554::2021/10/23-08:17:07.466 INFO  [RCM] TransitionToState(mydb2_10.16.1.164) OfflineCallIssued-->OfflineSavingCheckpoints.
000010a8.00001554::2021/10/23-08:17:07.466 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00001554::2021/10/23-08:17:07.466 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00001554::2021/10/23-08:17:07.466 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
000010a8.00001554::2021/10/23-08:17:07.466 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id 1297e000-5ba0-4711-9edb-765ea8bc1281 and name mydb2_10.16.1.164
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id 1297e000-5ba0-4711-9edb-765ea8bc1281
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource 1297e000-5ba0-4711-9edb-765ea8bc1281 in RcmResource
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource 1297e000-5ba0-4711-9edb-765ea8bc1281
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 1297e000-5ba0-4711-9edb-765ea8bc1281.
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 1297e000-5ba0-4711-9edb-765ea8bc1281.
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource 1297e000-5ba0-4711-9edb-765ea8bc1281 finished, about to signal Checkpoint completion
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [RCM] Res mydb2_10.16.1.164: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [RCM] TransitionToState(mydb2_10.16.1.164) OfflineSavingCheckpoints-->Offline.
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb2, Pending --> Offline)
000010a8.00001554::2021/10/23-08:17:07.466 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:485 from node 1. Action: causal, Target: CAUS
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource 1297e000-5ba0-4711-9edb-765ea8bc1281
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id 1297e000-5ba0-4711-9edb-765ea8bc1281 and name mydb2_10.16.1.164
000010a8.000006e0::2021/10/23-08:17:07.466 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:486 from node 1. Action: causal, Target: CAUS
000010a8.00001554::2021/10/23-08:17:07.467 INFO  [RCM] rcm::QueuedMovesHolder::RemoveGroup: (mydb2) GroupBeingMoved: true AllowMoveCancel: false NotifyMoveFailure: false
000010a8.00001554::2021/10/23-08:17:07.467 INFO  [GUM] Node 1: executing request locally, gumId:25727, my action: /rcm/gum/GroupMoveOperation, # of updates: 1
000010a8.00001554::2021/10/23-08:17:07.467 INFO  [RCM] rcm::RcmGum::GroupMoveOperation(1)
000010a8.00000560::2021/10/23-08:17:07.467 DBG   [NETFTAPI] received NsiDeleteInstance for 10.16.1.164
000010a8.0000199c::2021/10/23-08:17:07.467 INFO  [RCM] 'mydb4_10.16.1.166' cannot go offline yet; Dependent Resource 'mydb4_mydb4' is in state OfflinePending.
000010a8.0000199c::2021/10/23-08:17:07.467 INFO  [RCM] Res mydb4_10.16.1.166: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.00001554::2021/10/23-08:17:07.467 INFO  [RCM] move of group mydb2 from db-node-primary(1) to db-node-secondary(2) of type MoveType::Failover is about to succeed, failoverCount=1, lastFailoverTime=2021/10/23-03:16:45.436 targeted=false
000010a8.00000560::2021/10/23-08:17:07.468 WARN  [NETFTAPI] Failed to query parameters for 10.16.1.164 (status 0x80070490)
000010a8.00000560::2021/10/23-08:17:07.468 DBG   [NETFTAPI] Signaled NetftLocalRemove event for 10.16.1.164
000010a8.00001554::2021/10/23-08:17:07.468 INFO  MTimer(OneGroupMovetimer): [Total: 0 ms ( 0 s )]
000010a8.00001554::2021/10/23-08:17:07.468 INFO  [RCM] processed 1 group moves, 0 failures
000010a8.00001554::2021/10/23-08:17:07.468 INFO  [DM] An empty single transaction is cancelled 85:85:32529+1::0
000010a8.00001554::2021/10/23-08:17:07.468 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:487 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:07.505 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: forwarded, no retry on error 5908
000010a8.000011f0::2021/10/23-08:17:07.506 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:13 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.506 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:14 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.506 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:15 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.506 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:16 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.507 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:17 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.507 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:18 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.507 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:19 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.519 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:20 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.519 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:21 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.519 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:22 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.519 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:23 from node 2. Action: causal, Target: CAUS
0000243c.000029bc::2021/10/23-08:17:07.527 INFO  [RES] Network Name: Agent: OnCloseReply (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Netbios) result: 0
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Finish Closing NetName (type Singleton) Module Netbios, result 0, remaining... 0 (0)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: -- listing 5 instances ---------------------------------------------
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 1763b060-dff9-4961-8280-b1b5c0f92039:
0000243c.00002738::2021/10/23-08:17:07.528 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Closed
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: OnCloseReply (eb44dd7f-7717-4f70-b74f-a2d373c3217a,Configuration) result: 0
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:07.528 INFO  [RES] Network Name <mydb4_mydb4>: SyncReplyHandler Configuration, result: 0
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: --- 7 modules for instance: df59581d-6cb0-41d3-a597-dbce46545dcd:
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.00000f7c::2021/10/23-08:17:07.528 INFO  [RHS] Resource mydb4_mydb4has come offline. RHS is about to report resource status to RCM.
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: --- 7 modules for instance: eb44dd7f-7717-4f70-b74f-a2d373c3217a:
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: --- 7 modules for instance: ed158bf7-8c56-4e3e-9187-15f9c63678a5:
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
000010a8.00000560::2021/10/23-08:17:07.528 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb4_mydb4', gen(0) result 0/0.
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
000010a8.00000560::2021/10/23-08:17:07.528 INFO  [RCM] Res mydb4_mydb4: OfflinePending -> OfflineSavingCheckpoints( StateUnknown )
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: --- 7 modules for instance: f70cf510-b293-448c-89c9-9313e8be742c:
000010a8.00000560::2021/10/23-08:17:07.528 INFO  [RCM] TransitionToState(mydb4_mydb4) OfflinePending-->OfflineSavingCheckpoints.
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
000010a8.00000560::2021/10/23-08:17:07.528 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00000560::2021/10/23-08:17:07.528 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
000010a8.00000560::2021/10/23-08:17:07.528 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
000010a8.00000560::2021/10/23-08:17:07.528 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000023a8::2021/10/23-08:17:07.528 INFO  [RES] Network Name: Agent: -- 0 Orphan modules
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id eb44dd7f-7717-4f70-b74f-a2d373c3217a and name mydb4_mydb4
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id eb44dd7f-7717-4f70-b74f-a2d373c3217a
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource eb44dd7f-7717-4f70-b74f-a2d373c3217a in RcmResource
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource eb44dd7f-7717-4f70-b74f-a2d373c3217a
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource eb44dd7f-7717-4f70-b74f-a2d373c3217a.
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource eb44dd7f-7717-4f70-b74f-a2d373c3217a.
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource eb44dd7f-7717-4f70-b74f-a2d373c3217a finished, about to signal Checkpoint completion
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [RCM] Res mydb4_mydb4: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [RCM] TransitionToState(mydb4_mydb4) OfflineSavingCheckpoints-->Offline.
000010a8.00000560::2021/10/23-08:17:07.528 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:488 from node 1. Action: causal, Target: CAUS
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource eb44dd7f-7717-4f70-b74f-a2d373c3217a
000010a8.00001554::2021/10/23-08:17:07.528 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id eb44dd7f-7717-4f70-b74f-a2d373c3217a and name mydb4_mydb4
000010a8.0000199c::2021/10/23-08:17:07.528 INFO  [RCM] Res mydb4_10.16.1.166: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.0000199c::2021/10/23-08:17:07.528 INFO  [RCM] TransitionToState(mydb4_10.16.1.166) WaitingToGoOffline-->OfflineCallIssued.
000010a8.000006e0::2021/10/23-08:17:07.528 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:489 from node 1. Action: causal, Target: CAUS
0000023c.00002acc::2021/10/23-08:17:07.528 INFO  [RES] IP Address <mydb4_10.16.1.166>: Taking resource offline...
0000023c.00002acc::2021/10/23-08:17:07.528 INFO  [RES] IP Address <mydb4_10.16.1.166>: Deleting IP address 10.16.1.166.
0000023c.00002acc::2021/10/23-08:17:07.528 INFO  [RES] IP Address <mydb4_10.16.1.166>: Address 10.16.1.166 on adapter vmxnet3 Ethernet Adapter offline.
000010a8.000006e0::2021/10/23-08:17:07.529 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb4_10.16.1.166', gen(0) result 0/0.
000010a8.000006e0::2021/10/23-08:17:07.529 INFO  [RCM] Res mydb4_10.16.1.166: OfflineCallIssued -> OfflineSavingCheckpoints( StateUnknown )
000010a8.000006e0::2021/10/23-08:17:07.529 INFO  [RCM] TransitionToState(mydb4_10.16.1.166) OfflineCallIssued-->OfflineSavingCheckpoints.
000010a8.000006e0::2021/10/23-08:17:07.529 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.000006e0::2021/10/23-08:17:07.529 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.000006e0::2021/10/23-08:17:07.529 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
000010a8.000006e0::2021/10/23-08:17:07.529 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id 5c90cb4b-b99c-4934-bae4-215396274094 and name mydb4_10.16.1.166
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id 5c90cb4b-b99c-4934-bae4-215396274094
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource 5c90cb4b-b99c-4934-bae4-215396274094 in RcmResource
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource 5c90cb4b-b99c-4934-bae4-215396274094
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 5c90cb4b-b99c-4934-bae4-215396274094.
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 5c90cb4b-b99c-4934-bae4-215396274094.
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource 5c90cb4b-b99c-4934-bae4-215396274094 finished, about to signal Checkpoint completion
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [RCM] Res mydb4_10.16.1.166: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [RCM] TransitionToState(mydb4_10.16.1.166) OfflineSavingCheckpoints-->Offline.
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb4, Pending --> Offline)
000010a8.000006e0::2021/10/23-08:17:07.529 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:490 from node 1. Action: causal, Target: CAUS
000010a8.000006e0::2021/10/23-08:17:07.529 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:491 from node 1. Action: causal, Target: CAUS
000010a8.0000199c::2021/10/23-08:17:07.529 INFO  [RCM] rcm::QueuedMovesHolder::RemoveGroup: (mydb4) GroupBeingMoved: true AllowMoveCancel: false NotifyMoveFailure: false
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource 5c90cb4b-b99c-4934-bae4-215396274094
000010a8.00001554::2021/10/23-08:17:07.529 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id 5c90cb4b-b99c-4934-bae4-215396274094 and name mydb4_10.16.1.166
000010a8.0000199c::2021/10/23-08:17:07.529 INFO  [GUM] Node 1: executing request locally, gumId:25728, my action: /rcm/gum/GroupMoveOperation, # of updates: 1
000010a8.0000199c::2021/10/23-08:17:07.529 INFO  [RCM] rcm::RcmGum::GroupMoveOperation(1)
000010a8.0000199c::2021/10/23-08:17:07.529 INFO  [RCM] move of group mydb4from db-node-primary(1) to db-node-secondary(2) of type MoveType::Failover is about to succeed, failoverCount=1, lastFailoverTime=2021/10/23-03:16:45.733 targeted=false
000010a8.0000199c::2021/10/23-08:17:07.529 INFO  MTimer(OneGroupMovetimer): [Total: 0 ms ( 0 s )]
000010a8.0000199c::2021/10/23-08:17:07.529 INFO  [RCM] processed 1 group moves, 0 failures
000010a8.0000199c::2021/10/23-08:17:07.529 INFO  [DM] An empty single transaction is cancelled 85:85:32529+1::0
000010a8.0000199c::2021/10/23-08:17:07.529 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:492 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002a74::2021/10/23-08:17:07.530 DBG   [NETFTAPI] received NsiDeleteInstance for 10.16.1.166
000010a8.00002a74::2021/10/23-08:17:07.530 WARN  [NETFTAPI] Failed to query parameters for 10.16.1.166 (status 0x80070490)
000010a8.00002a74::2021/10/23-08:17:07.530 DBG   [NETFTAPI] Signaled NetftLocalRemove event for 10.16.1.166
000010a8.000011f0::2021/10/23-08:17:07.567 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:24 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.567 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:25 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.567 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:26 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.568 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:27 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.568 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:28 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.568 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:29 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.576 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:30 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.576 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:31 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.576 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:32 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:07.577 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:33 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:10.706 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:34 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:10.706 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:35 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:10.851 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:36 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:10.851 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:37 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:10.852 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:38 from node 2. Action: /rcm/mrr/BroadcastControl, Target: RCMA
0000243c.00002738::2021/10/23-08:17:10.852 INFO  [RES] Network Name <mydb2_mydb2>: Netname received credentials update
0000243c.00002738::2021/10/23-08:17:10.852 INFO  [RES] Network Name <mydb2_mydb2>: InitializeADAware - ADAware value is 1
0000243c.000023a8::2021/10/23-08:17:10.852 INFO  [RES] Network Name: Agent: InitializeModule, Trying to initialize Module(f70cf510-b293-448c-89c9-9313e8be742c,Identity) when there is one already in Initialized/Idle state
0000243c.00002738::2021/10/23-08:17:10.852 INFO  [RES] Network Name <mydb2_mydb2>: HandleCredentialsUpdate - Identity module already exists.
0000243c.000023a8::2021/10/23-08:17:10.855 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: Credentials Update - Configuration module sending Recheck config to Identity
0000243c.000023a8::2021/10/23-08:17:10.855 INFO  [RES] Network Name <mydb2_mydb2>: Identity: OnRecheckConfig, nothing changed
0000243c.000023a8::2021/10/23-08:17:10.855 INFO  [RES] Network Name <mydb2_mydb2>: Configuration: InternalReplyHandler: 0
000010a8.000011f0::2021/10/23-08:17:10.951 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:39 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:10.951 INFO  [GUM] Node 1: Processing RequestLock 2:5
000010a8.000011f0::2021/10/23-08:17:10.951 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:493 from node 1. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:10.951 INFO  [GUM] Node 1: Processing GrantLock to 2 (sent by 1 gumid: 25728)
000010a8.000011f0::2021/10/23-08:17:10.990 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:40 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:10.990 INFO  [GUM] Node 1: Executing locally gumId: 25729, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:11.284 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:41 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:11.284 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:42 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:11.339 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:43 from node 2. Action: /rcm/mrr/BroadcastControl, Target: RCMA
000010a8.000011f0::2021/10/23-08:17:11.339 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:44 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:11.339 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:45 from node 2. Action: causal, Target: CAUS
0000243c.000023a8::2021/10/23-08:17:11.339 INFO  [RES] Network Name <mydb4_mydb4>: Netname received credentials update
0000243c.000023a8::2021/10/23-08:17:11.339 INFO  [RES] Network Name <mydb4_mydb4>: InitializeADAware - ADAware value is 1
0000243c.00002738::2021/10/23-08:17:11.339 INFO  [RES] Network Name: Agent: InitializeModule, Trying to initialize Module(eb44dd7f-7717-4f70-b74f-a2d373c3217a,Identity) when there is one already in Initialized/Idle state
0000243c.000023a8::2021/10/23-08:17:11.339 INFO  [RES] Network Name <mydb4_mydb4>: HandleCredentialsUpdate - Identity module already exists.
0000243c.00002738::2021/10/23-08:17:11.341 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: Credentials Update - Configuration module sending Recheck config to Identity
0000243c.00002738::2021/10/23-08:17:11.341 INFO  [RES] Network Name <mydb4_mydb4>: Identity: OnRecheckConfig, nothing changed
0000243c.00002738::2021/10/23-08:17:11.341 INFO  [RES] Network Name <mydb4_mydb4>: Configuration: InternalReplyHandler: 0
000010a8.000011f0::2021/10/23-08:17:11.384 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:46 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:11.384 INFO  [GUM] Node 1: Executing locally gumId: 25730, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:15.793 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:47 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:15.793 INFO  [GUM] Node 1: Executing locally gumId: 25731, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:15.834 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:48 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:15.834 INFO  [GUM] Node 1: Executing locally gumId: 25732, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:15.876 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:49 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:15.876 INFO  [GUM] Node 1: Executing locally gumId: 25733, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:15.917 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:50 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:15.917 INFO  [GUM] Node 1: Executing locally gumId: 25734, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:15.926 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:51 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:15.926 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:52 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:15.960 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:53 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:15.960 INFO  [GUM] Node 1: Executing locally gumId: 25735, updates: 1, first action: /rcm/gum/RemovePossibleOwner
000010a8.00000560::2021/10/23-08:17:15.960 INFO  [RCM] rcm::RcmGum::RemovePossibleOwner(mydb2,1)
000010a8.00000560::2021/10/23-08:17:15.960 INFO  [RCM] Removing node 1 from resource 'mydb2'.
000010a8.000011f0::2021/10/23-08:17:15.961 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:54 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:15.962 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:55 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:16.002 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:56 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.003 INFO  [GUM] Node 1: Executing locally gumId: 25736, updates: 1, first action: /rcm/gum/SetGroupPreferredOwners
000010a8.00000560::2021/10/23-08:17:16.003 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb2,<vector len='1'>
000010a8.00000560::2021/10/23-08:17:16.003 INFO      <item>2</item>
000010a8.00000560::2021/10/23-08:17:16.003 INFO  </vector>
000010a8.00000560::2021/10/23-08:17:16.003 INFO  )
000010a8.000011f0::2021/10/23-08:17:16.044 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:57 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.044 INFO  [GUM] Node 1: Executing locally gumId: 25737, updates: 1, first action: /rcm/gum/RemovePossibleOwner
000010a8.00000560::2021/10/23-08:17:16.044 INFO  [RCM] rcm::RcmGum::RemovePossibleOwner(mydb4,1)
000010a8.00000560::2021/10/23-08:17:16.044 INFO  [RCM] Removing node 1 from resource 'mydb4'.
000010a8.000011f0::2021/10/23-08:17:16.089 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:58 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.089 INFO  [GUM] Node 1: Executing locally gumId: 25738, updates: 1, first action: /rcm/gum/AddPossibleOwner
000010a8.00000560::2021/10/23-08:17:16.089 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb2,1)
000010a8.00000560::2021/10/23-08:17:16.089 INFO  [RCM] Adding node 1 to resource 'mydb2'.
000010a8.000011f0::2021/10/23-08:17:16.130 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:59 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.130 INFO  [GUM] Node 1: Executing locally gumId: 25739, updates: 1, first action: /rcm/gum/SetGroupPreferredOwners
000010a8.00000560::2021/10/23-08:17:16.130 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb4,<vector len='1'>
000010a8.00000560::2021/10/23-08:17:16.130 INFO      <item>2</item>
000010a8.00000560::2021/10/23-08:17:16.130 INFO  </vector>
000010a8.00000560::2021/10/23-08:17:16.130 INFO  )
000010a8.000011f0::2021/10/23-08:17:16.171 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:60 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.171 INFO  [GUM] Node 1: Executing locally gumId: 25740, updates: 1, first action: /rcm/gum/SetGroupPreferredOwners
000010a8.00000560::2021/10/23-08:17:16.171 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb2,<vector len='2'>
000010a8.00000560::2021/10/23-08:17:16.171 INFO      <item>2</item>
000010a8.00000560::2021/10/23-08:17:16.171 INFO      <item>1</item>
000010a8.00000560::2021/10/23-08:17:16.171 INFO  </vector>
000010a8.00000560::2021/10/23-08:17:16.171 INFO  )
000010a8.000011f0::2021/10/23-08:17:16.213 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:61 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.213 INFO  [GUM] Node 1: Executing locally gumId: 25741, updates: 1, first action: /rcm/gum/AddPossibleOwner
000010a8.00000560::2021/10/23-08:17:16.213 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb4,1)
000010a8.00000560::2021/10/23-08:17:16.213 INFO  [RCM] Adding node 1 to resource 'mydb4'.
000010a8.000011f0::2021/10/23-08:17:16.256 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:62 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.256 INFO  [GUM] Node 1: Executing locally gumId: 25742, updates: 1, first action: /rcm/gum/SetGroupPreferredOwners
000010a8.00000560::2021/10/23-08:17:16.256 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb4,<vector len='2'>
000010a8.00000560::2021/10/23-08:17:16.256 INFO      <item>2</item>
000010a8.00000560::2021/10/23-08:17:16.256 INFO      <item>1</item>
000010a8.00000560::2021/10/23-08:17:16.256 INFO  </vector>
000010a8.00000560::2021/10/23-08:17:16.256 INFO  )
000010a8.000011f0::2021/10/23-08:17:16.297 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:63 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.297 INFO  [GUM] Node 1: Executing locally gumId: 25743, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:16.350 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:64 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.350 INFO  [GUM] Node 1: Executing locally gumId: 25744, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:16.392 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:65 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.392 INFO  [GUM] Node 1: Executing locally gumId: 25745, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:16.432 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:66 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.433 INFO  [GUM] Node 1: Executing locally gumId: 25746, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:16.474 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:67 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:16.474 INFO  [GUM] Node 1: Executing locally gumId: 25747, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:18.144 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:68 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:17:18.144 INFO  [GUM] Node 1: Executing locally gumId: 25748, updates: 1, first action: /dm/update
00000054.000029a8::2021/10/23-08:17:20.029 ERR   [RES] SQL Server Availability Group: [hadrag] Failure detected, diagnostics heartbeat is lost
00000054.000029a8::2021/10/23-08:17:20.029 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.000029a8::2021/10/23-08:17:20.029 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Resource Alive result 0.
00000054.000029a8::2021/10/23-08:17:20.029 ERR   [RES] SQL Server Availability Group: [hadrag] Failure detected, diagnostics heartbeat is lost
00000054.000029a8::2021/10/23-08:17:20.029 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Availability Group is not healthy with given HealthCheckTimeout and FailureConditionLevel
00000054.000029a8::2021/10/23-08:17:20.029 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Resource Alive result 0.
00000054.000029a8::2021/10/23-08:17:20.029 WARN  [RHS] Resource mydb1 IsAlive has indicated failure.
00000054.000029a8::2021/10/23-08:17:20.029 INFO  [RHS-WER] Scheduling WER ERROR report in 10.000. ReportId 49488105-57c0-4899-be8d-46e77dce124a;
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM] HandleMonitorReply: FAILURENOTIFICATION for 'mydb1', gen(2) result 1/0.
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM] Res mydb1: Online -> ProcessingFailure( StateUnknown )
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM] TransitionToState(mydb1) Online-->ProcessingFailure.
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb1, Online --> Pending)
000010a8.00000560::2021/10/23-08:17:20.029 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:494 from node 1. Action: causal, Target: CAUS
000010a8.0000199c::2021/10/23-08:17:20.029 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb1)
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM] resource mydb1: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM] numDependents is zero, auto-returning true
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM] Resource mydb1 is causing group mydb1 to failover.
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM] rcm::RcmGroup::Failover: (mydb1)
000010a8.00000560::2021/10/23-08:17:20.029 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00001554::2021/10/23-08:17:20.029 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:495 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:17:20.029 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00000560::2021/10/23-08:17:20.029 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource ec9ef420-492a-4291-8edb-8b5330386b8d.
000010a8.00000560::2021/10/23-08:17:20.029 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource ec9ef420-492a-4291-8edb-8b5330386b8d.
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM] time since last failure is greater than failover period; resetting failoverCount to 0.
000010a8.0000199c::2021/10/23-08:17:20.029 WARN  [RCM] Failing over group mydb1, failoverCount 1, last time 2021/09/04-03:13:14.043.
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM-plcmt] This node is director, making placement decision myself
000010a8.0000199c::2021/10/23-08:17:20.029 INFO  [RCM-plcmt] [Filter] Removing candidate: NodeCandidate(1) BanCode: CurrentNodeFilter (5016)
000010a8.0000199c::2021/10/23-08:17:20.030 INFO  [RCM] rcm::RcmGroup::NodeIsPossibleOwner: Group mydb1: Node:2 IsPossibleOwner:true
000010a8.00000560::2021/10/23-08:17:20.030 INFO  [RCM] applying timely STM connectivity snapshot for group mydb1
000010a8.0000199c::2021/10/23-08:17:20.030 INFO  [RCM-plcmt] filters reduced candidate list for group mydb1 to size 1, no need to run rankers
000010a8.0000199c::2021/10/23-08:17:20.030 INFO  [RCM-plcmt] placement manager result:  grp=mydb1 moveType=MoveType::Failover, node=2
000010a8.0000199c::2021/10/23-08:17:20.030 INFO  MTimer(GetPlacementAsDirector): [Total: 0 ms ( 0 s )]
000010a8.0000199c::2021/10/23-08:17:20.030 INFO  [RCM] Res mydb1: ProcessingFailure -> WaitingToTerminate( Failed )
000010a8.0000199c::2021/10/23-08:17:20.030 INFO  [RCM] TransitionToState(mydb1) ProcessingFailure-->[WaitingToTerminate to Failed].
000010a8.00000560::2021/10/23-08:17:20.030 INFO  [RCM] rcm::RcmGroup::FailoverWorker: (mydb1)
000010a8.0000199c::2021/10/23-08:17:20.030 INFO  [RCM] Res mydb1: [WaitingToTerminate to Failed] -> Terminating( Failed )
000010a8.0000199c::2021/10/23-08:17:20.030 INFO  [RCM] TransitionToState(mydb1) [WaitingToTerminate to Failed]-->[Terminating to Failed].
00000054.00000858::2021/10/23-08:17:20.030 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Lease Thread terminated
00000054.000029a8::2021/10/23-08:17:20.030 INFO  [RES] SQL Server Availability Group: [hadrag] Stopping Health Worker Thread
00000054.0000285c::2021/10/23-08:17:20.030 INFO  [RES] SQL Server Availability Group: [hadrag] Health worker was asked to terminate
00000054.0000285c::2021/10/23-08:17:20.647 INFO  [RES] SQL Server Availability Group: [hadrag] Change diagnostics interval worker is stopped
00000054.00000e04::2021/10/23-08:17:20.647 INFO  [RES] SQL Server Availability Group: [hadrag] Diagnostics is stopped
000010a8.00001554::2021/10/23-08:17:20.996 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:496 from node 1. Action: causal, Target: CAUS
000010a8.00001554::2021/10/23-08:17:20.996 INFO  [GUM] Node 1: Processing RequestLock 1:313
000010a8.000011f0::2021/10/23-08:17:21.034 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:69 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:21.034 INFO  [GUM] Node 1: Processing GrantLock to 1 (sent by 2 gumid: 25748)
000010a8.00001554::2021/10/23-08:17:21.034 INFO  [GUM] Node 1: executing request locally, gumId:25749, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:17:21.035 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:497 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:17:22.151 INFO  [GUM] Node 1: executing request locally, gumId:25750, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:17:22.151 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:498 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:17:22.233 INFO  [GUM] Node 1: executing request locally, gumId:25751, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:17:22.233 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:499 from node 1. Action: gum/do-update, Target: GUMA
00000054.00000598::2021/10/23-08:17:22.243 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] The connection was established successfully
00000054.00000e04::2021/10/23-08:17:22.767 INFO  [RES] SQL Server Availability Group: [hadrag] Disconnect from SQL Server
00000054.00000e04::2021/10/23-08:17:22.767 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event logging is stopped
00000054.00000e04::2021/10/23-08:17:22.774 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event target state:
00000054.00000e04::2021/10/23-08:17:22.774 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event session summary: dropped buffers = 0, dropped events = 0
00000054.000029a8::2021/10/23-08:17:22.776 INFO  [RES] SQL Server Availability Group: [hadrag] Stopping Change Diagnostics interval Worker Thread
00000054.000029a8::2021/10/23-08:17:22.777 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Connect to SQL Server ...
000010a8.00001554::2021/10/23-08:17:22.857 INFO  [GUM] Node 1: executing request locally, gumId:25752, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:17:22.860 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:500 from node 1. Action: gum/do-update, Target: GUMA
00000054.000029a8::2021/10/23-08:17:23.594 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] The connection was established successfully
000010a8.00001554::2021/10/23-08:17:23.595 INFO  [GUM] Node 1: executing request locally, gumId:25753, my action: /dm/update, # of updates: 1
000010a8.00001554::2021/10/23-08:17:23.595 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:501 from node 1. Action: gum/do-update, Target: GUMA
00000054.000029a8::2021/10/23-08:17:23.859 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Disconnect from SQL Server
00000054.000029a8::2021/10/23-08:17:23.859 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Offline call successful in Terminate function
000010a8.00001554::2021/10/23-08:17:23.859 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb1', gen(3) result 0/0.
000010a8.00001554::2021/10/23-08:17:23.859 INFO  [RCM] Res mydb1: [Terminating to Failed] -> Failed( StateUnknown )
000010a8.00001554::2021/10/23-08:17:23.859 INFO  [RCM] TransitionToState(mydb1) [Terminating to Failed]-->Failed.
000010a8.00001554::2021/10/23-08:17:23.859 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb1, Pending --> Failed)
000010a8.0000199c::2021/10/23-08:17:23.859 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:502 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] ordering failover of group mydb1 to node 2
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] rcm::RcmGroup::Move: (mydb1, 2, MoveType::Failover)
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] rcm::RcmGroup::Move: Bringing group 'mydb1' offline first...
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] Res mydb1_mydb1: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] TransitionToState(mydb1_mydb1) Online-->WaitingToGoOffline.
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb1, Failed --> Pending)
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] Res mydb1_mydb1: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] TransitionToState(mydb1_mydb1) WaitingToGoOffline-->OfflineCallIssued.
000010a8.0000199c::2021/10/23-08:17:23.860 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:503 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] Res mydb1_10.16.1.163: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] TransitionToState(mydb1_10.16.1.163) Online-->WaitingToGoOffline.
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] 'mydb1_10.16.1.163' cannot go offline yet; Dependent Resource 'mydb1_mydb1' is in state OfflineCallIssued.
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] Res mydb1_10.16.1.163: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] Res mydb1: Failed -> Offline( StateUnknown )
000010a8.00000560::2021/10/23-08:17:23.860 INFO  [RCM] TransitionToState(mydb1) Failed-->Offline.
000010a8.0000199c::2021/10/23-08:17:23.860 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:504 from node 1. Action: causal, Target: CAUS
000010a8.0000199c::2021/10/23-08:17:23.860 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:505 from node 1. Action: causal, Target: CAUS
0000243c.000023a8::2021/10/23-08:17:23.860 INFO  [RES] Network Name <mydb1_mydb1>: Offline called for resource mydb1_mydb1
000010a8.00002728::2021/10/23-08:17:23.860 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb1_mydb1', gen(0) result 997/0.
000010a8.00002728::2021/10/23-08:17:23.860 INFO  [RCM] Res mydb1_mydb1: OfflineCallIssued -> OfflinePending( StateUnknown )
000010a8.00002728::2021/10/23-08:17:23.860 INFO  [RCM] TransitionToState(mydb1_mydb1) OfflineCallIssued-->OfflinePending.
0000243c.000025dc::2021/10/23-08:17:23.860 INFO  [RES] Network Name <mydb1_mydb1>: Entering Offline thread
0000243c.000025dc::2021/10/23-08:17:23.860 INFO  [RES] Network Name <mydb1_mydb1>: Performing actual offline of resource.
0000243c.000025dc::2021/10/23-08:17:23.860 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,AdminShare)
0000243c.000023a8::2021/10/23-08:17:23.860 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,AdminShare)
0000243c.000023a8::2021/10/23-08:17:23.860 INFO  [RES] Network Name <mydb1_mydb1>: AdminShare: Canceling work, state: Closing/Idle
0000243c.000023a8::2021/10/23-08:17:23.860 INFO  [RES] Network Name <mydb1_mydb1>: AdminShare: OnCloseBase, previous state: Initialized/Idle
0000243c.000023a8::2021/10/23-08:17:23.874 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,AdminShare) result: 0
0000243c.000023a8::2021/10/23-08:17:23.874 INFO  [RES] Network Name <mydb1_mydb1>: SyncReplyHandler Configuration, result: 0
0000243c.000025dc::2021/10/23-08:17:23.874 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,Configuration)
0000243c.000023a8::2021/10/23-08:17:23.874 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,Configuration)
0000243c.000029bc::2021/10/23-08:17:23.874 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Canceling work, state: Closing/Idle
0000243c.000029bc::2021/10/23-08:17:23.874 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: OnCloseBase, previous state: Initialized/Idle
0000243c.000029bc::2021/10/23-08:17:23.875 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Closing... (PreviousState: Initialized, Created: true, Type: Singleton)
0000243c.000029bc::2021/10/23-08:17:23.875 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,AccountAD)
0000243c.000029bc::2021/10/23-08:17:23.875 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,Dns)
0000243c.000029bc::2021/10/23-08:17:23.875 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,Client)
0000243c.000023a8::2021/10/23-08:17:23.875 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,AccountAD)
0000243c.000023a8::2021/10/23-08:17:23.875 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,Dns)
0000243c.00002738::2021/10/23-08:17:23.875 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: Canceling work, state: Closing/Idle
0000243c.000023a8::2021/10/23-08:17:23.875 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,Client)
0000243c.00002738::2021/10/23-08:17:23.875 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: OnCloseBase, previous state: Initialized/Idle
0000243c.00002738::2021/10/23-08:17:23.875 INFO  [RES] Network Name <mydb1_mydb1>: Client: Canceling work, state: Closing/Idle
0000243c.00000a98::2021/10/23-08:17:23.875 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Canceling work, state: Closing/Idle
0000243c.00002738::2021/10/23-08:17:23.875 INFO  [RES] Network Name <mydb1_mydb1>: Client: OnCloseBase, previous state: Initialized/Idle
0000243c.00000a98::2021/10/23-08:17:23.875 INFO  [RES] Network Name <mydb1_mydb1>: Dns: OnCloseBase, previous state: Initialized/Idle
0000243c.00002738::2021/10/23-08:17:23.875 INFO  [RES] Network Name: [NNLIB] Removing alias 10.16.1.163 for target mydb1
0000243c.00002994::2021/10/23-08:17:23.875 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,Dns) result: 0
0000243c.00002994::2021/10/23-08:17:23.875 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Closing NetName (type Singleton) Module Dns, result 0, remaining... 3 (0)
0000243c.000023a8::2021/10/23-08:17:23.876 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,AccountAD) result: 0
0000243c.000023a8::2021/10/23-08:17:23.876 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Closing NetName (type Singleton) Module AccountAD, result 0, remaining... 2 (0)
0000243c.00002738::2021/10/23-08:17:23.876 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 122, result size 0 (status: 0, subStatus: 0)
0000243c.00002738::2021/10/23-08:17:23.877 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 122, result size 0 (status: 0, subStatus: 0)
0000243c.00002738::2021/10/23-08:17:23.877 INFO  [RES] Network Name: [NNLIB] Success on credential operation remove on Account mydb1$, status: 0 (subStatus: 0)
0000243c.00002738::2021/10/23-08:17:23.877 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 70, result size 0 (status: 0, subStatus: 0)
0000243c.00002738::2021/10/23-08:17:23.877 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb1.domain.local, status: 0, subStatus: 0
0000243c.00002738::2021/10/23-08:17:23.877 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 44, result size 0 (status: 0, subStatus: 0)
0000243c.00002738::2021/10/23-08:17:23.877 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb1, status: 0, subStatus: 0
0000243c.00002738::2021/10/23-08:17:23.878 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 44, result size 0 (status: 0, subStatus: 0)
0000243c.00002738::2021/10/23-08:17:23.878 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb1, status: 0, subStatus: 0
0000243c.00002738::2021/10/23-08:17:23.878 INFO  [RES] Network Name <mydb1_mydb1>: Client: Unregistering netname for multichannel support returned 0
0000243c.00002738::2021/10/23-08:17:23.878 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,Client) result: 0
0000243c.00002738::2021/10/23-08:17:23.878 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Closing NetName (type Singleton) Module Client, result 0, remaining... 1 (0)
0000243c.00002738::2021/10/23-08:17:23.878 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,Netbios)
0000243c.00002738::2021/10/23-08:17:23.878 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,Netbios)
0000243c.00002738::2021/10/23-08:17:23.878 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: Canceling work, state: Closing/Idle
0000243c.00002738::2021/10/23-08:17:23.878 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: OnCloseBase, previous state: Initialized/Idle
0000243c.00002738::2021/10/23-08:17:23.904 INFO  [RES] Network Name: [NNLIB] Deregistered server name mydb1 on transport \Device\NetbiosSmb
0000243c.00002738::2021/10/23-08:17:23.904 INFO  [RES] Network Name: [NNLIB] Deleted server name: mydb1 from all transports
0000243c.00002738::2021/10/23-08:17:23.904 INFO  [RES] Network Name: [NNLIB] Deleting Server Name for server name: mydb1, ret: 0
0000243c.00002994::2021/10/23-08:17:23.904 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: Cleaning up transports
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,Netbios) result: 0
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Closing NetName (type Singleton) Module Netbios, result 0, remaining... 0 (0)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: -- listing 5 instances ---------------------------------------------
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 1763b060-dff9-4961-8280-b1b5c0f92039:
0000243c.000029bc::2021/10/23-08:17:23.905 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Closed
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000029bc::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,Configuration) result: 0
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:23.905 INFO  [RES] Network Name <mydb1_mydb1>: SyncReplyHandler Configuration, result: 0
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: --- 7 modules for instance: df59581d-6cb0-41d3-a597-dbce46545dcd:
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.000025dc::2021/10/23-08:17:23.905 INFO  [RHS] Resource mydb1_mydb1 has come offline. RHS is about to report resource status to RCM.
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: --- 7 modules for instance: eb44dd7f-7717-4f70-b74f-a2d373c3217a:
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.00002738::2021/10/23-08:17:23.905 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
000010a8.00002728::2021/10/23-08:17:23.905 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb1_mydb1', gen(0) result 0/0.
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: --- 7 modules for instance: ed158bf7-8c56-4e3e-9187-15f9c63678a5:
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] Res mydb1_mydb1: OfflinePending -> OfflineSavingCheckpoints( StateUnknown )
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] TransitionToState(mydb1_mydb1) OfflinePending-->OfflineSavingCheckpoints.
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: --- 7 modules for instance: f70cf510-b293-448c-89c9-9313e8be742c:
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id 1763b060-dff9-4961-8280-b1b5c0f92039 and name mydb1_mydb1
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id 1763b060-dff9-4961-8280-b1b5c0f92039
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource 1763b060-dff9-4961-8280-b1b5c0f92039 in RcmResource
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource 1763b060-dff9-4961-8280-b1b5c0f92039
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
0000243c.00002738::2021/10/23-08:17:23.906 INFO  [RES] Network Name: Agent: -- 0 Orphan modules
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 1763b060-dff9-4961-8280-b1b5c0f92039.
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 1763b060-dff9-4961-8280-b1b5c0f92039.
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource 1763b060-dff9-4961-8280-b1b5c0f92039 finished, about to signal Checkpoint completion
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [RCM] Res mydb1_mydb1: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [RCM] TransitionToState(mydb1_mydb1) OfflineSavingCheckpoints-->Offline.
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:506 from node 1. Action: causal, Target: CAUS
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource 1763b060-dff9-4961-8280-b1b5c0f92039
000010a8.00001554::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id 1763b060-dff9-4961-8280-b1b5c0f92039 and name mydb1_mydb1
000010a8.0000199c::2021/10/23-08:17:23.906 INFO  [RCM] Res mydb1_10.16.1.163: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.0000199c::2021/10/23-08:17:23.906 INFO  [RCM] TransitionToState(mydb1_10.16.1.163) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:507 from node 1. Action: causal, Target: CAUS
0000023c.00000678::2021/10/23-08:17:23.906 INFO  [RES] IP Address <mydb1_10.16.1.163>: Taking resource offline...
0000023c.00000678::2021/10/23-08:17:23.906 INFO  [RES] IP Address <mydb1_10.16.1.163>: Deleting IP address 10.16.1.163.
0000023c.00000678::2021/10/23-08:17:23.906 INFO  [RES] IP Address <mydb1_10.16.1.163>: Address 10.16.1.163 on adapter vmxnet3 Ethernet Adapter offline.
000010a8.00000560::2021/10/23-08:17:23.906 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb1_10.16.1.163', gen(0) result 0/0.
000010a8.00000560::2021/10/23-08:17:23.906 INFO  [RCM] Res mydb1_10.16.1.163: OfflineCallIssued -> OfflineSavingCheckpoints( StateUnknown )
000010a8.00000560::2021/10/23-08:17:23.906 INFO  [RCM] TransitionToState(mydb1_10.16.1.163) OfflineCallIssued-->OfflineSavingCheckpoints.
000010a8.00000560::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00000560::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00000560::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
000010a8.00000560::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id 1bf0cc76-26ef-4034-aaad-0060d6e2dff7 and name mydb1_10.16.1.163
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id 1bf0cc76-26ef-4034-aaad-0060d6e2dff7
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource 1bf0cc76-26ef-4034-aaad-0060d6e2dff7 in RcmResource
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource 1bf0cc76-26ef-4034-aaad-0060d6e2dff7
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 1bf0cc76-26ef-4034-aaad-0060d6e2dff7.
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 1bf0cc76-26ef-4034-aaad-0060d6e2dff7.
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource 1bf0cc76-26ef-4034-aaad-0060d6e2dff7 finished, about to signal Checkpoint completion
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] Res mydb1_10.16.1.163: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] TransitionToState(mydb1_10.16.1.163) OfflineSavingCheckpoints-->Offline.
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb1, Pending --> Offline)
000010a8.00000560::2021/10/23-08:17:23.906 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:508 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource 1bf0cc76-26ef-4034-aaad-0060d6e2dff7
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id 1bf0cc76-26ef-4034-aaad-0060d6e2dff7 and name mydb1_10.16.1.163
000010a8.00002a74::2021/10/23-08:17:23.906 INFO  [RCM] rcm::QueuedMovesHolder::RemoveGroup: (mydb1) GroupBeingMoved: true AllowMoveCancel: false NotifyMoveFailure: false
000010a8.00002728::2021/10/23-08:17:23.906 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:509 from node 1. Action: causal, Target: CAUS
000010a8.00002a74::2021/10/23-08:17:23.907 INFO  [GUM] Node 1: executing request locally, gumId:25754, my action: /rcm/gum/GroupMoveOperation, # of updates: 1
000010a8.00002a74::2021/10/23-08:17:23.907 INFO  [RCM] rcm::RcmGum::GroupMoveOperation(1)
000010a8.00002a74::2021/10/23-08:17:23.907 INFO  [RCM] move of group mydb1 from db-node-primary(1) to db-node-secondary(2) of type MoveType::Failover is about to succeed, failoverCount=1, lastFailoverTime=2021/10/23-03:17:20.028 targeted=false
000010a8.00002a74::2021/10/23-08:17:23.907 INFO  MTimer(OneGroupMovetimer): [Total: 0 ms ( 0 s )]
000010a8.00002a74::2021/10/23-08:17:23.907 INFO  [RCM] processed 1 group moves, 0 failures
000010a8.00002a74::2021/10/23-08:17:23.907 INFO  [DM] An empty single transaction is cancelled 85:85:32554+1::0
000010a8.00002a74::2021/10/23-08:17:23.907 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:510 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002728::2021/10/23-08:17:23.907 DBG   [NETFTAPI] received NsiDeleteInstance for 10.16.1.163
000010a8.00002728::2021/10/23-08:17:23.907 WARN  [NETFTAPI] Failed to query parameters for 10.16.1.163 (status 0x80070490)
000010a8.00002728::2021/10/23-08:17:23.907 DBG   [NETFTAPI] Signaled NetftLocalRemove event for 10.16.1.163
000010a8.00002728::2021/10/23-08:17:23.939 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: forwarded, no retry on error 5908
000010a8.000011f0::2021/10/23-08:17:23.945 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:70 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:23.945 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:71 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:23.945 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:72 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:23.945 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:73 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:23.946 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:74 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:23.946 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:75 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:23.946 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:76 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:23.953 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:77 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:23.953 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:78 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:23.954 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:79 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:23.954 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:80 from node 2. Action: causal, Target: CAUS
000010a8.00002a74::2021/10/23-08:17:24.164 INFO  [GUM] Node 1: executing request locally, gumId:25755, my action: /dm/update, # of updates: 1
000010a8.00002a74::2021/10/23-08:17:24.165 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:511 from node 1. Action: gum/do-update, Target: GUMA
00000054.00000598::2021/10/23-08:17:25.561 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Disconnect from SQL Server
00000054.00000598::2021/10/23-08:17:25.579 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Offline call successful in Terminate function
000010a8.00002728::2021/10/23-08:17:25.579 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb3', gen(3) result 0/0.
000010a8.00002728::2021/10/23-08:17:25.579 INFO  [RCM] Res mydb3: [Terminating to Failed] -> Failed( StateUnknown )
000010a8.00002728::2021/10/23-08:17:25.579 INFO  [RCM] TransitionToState(mydb3) [Terminating to Failed]-->Failed.
000010a8.00002728::2021/10/23-08:17:25.579 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Pending --> Failed)
000010a8.00001554::2021/10/23-08:17:25.579 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:512 from node 1. Action: causal, Target: CAUS
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] ordering failover of group mydb3 to node 2
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] rcm::RcmGroup::Move: (mydb3, 2, MoveType::Failover)
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] rcm::RcmGroup::Move: Bringing group 'mydb3' offline first...
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] Res mydb3: Failed -> Offline( StateUnknown )
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] TransitionToState(mydb3) Failed-->Offline.
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Failed --> Offline)
000010a8.00001554::2021/10/23-08:17:25.609 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:513 from node 1. Action: causal, Target: CAUS
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] Res mydb3_mydb3: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] TransitionToState(mydb3_mydb3) Online-->WaitingToGoOffline.
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Offline --> Pending)
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] Res mydb3_mydb3: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] TransitionToState(mydb3_mydb3) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] Res mydb3_10.16.1.165: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) Online-->WaitingToGoOffline.
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] 'mydb3_10.16.1.165' cannot go offline yet; Dependent Resource 'mydb3_mydb3' is in state OfflineCallIssued.
000010a8.00002498::2021/10/23-08:17:25.609 INFO  [RCM] Res mydb3_10.16.1.165: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.00000560::2021/10/23-08:17:25.609 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:514 from node 1. Action: causal, Target: CAUS
0000243c.00002738::2021/10/23-08:17:25.609 INFO  [RES] Network Name <mydb3_mydb3>: Offline called for resource mydb3_mydb3
000010a8.00002a74::2021/10/23-08:17:25.610 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb3_mydb3', gen(0) result 997/0.
000010a8.00002a74::2021/10/23-08:17:25.610 INFO  [RCM] Res mydb3_mydb3: OfflineCallIssued -> OfflinePending( StateUnknown )
000010a8.00002a74::2021/10/23-08:17:25.610 INFO  [RCM] TransitionToState(mydb3_mydb3) OfflineCallIssued-->OfflinePending.
0000243c.00000fa0::2021/10/23-08:17:25.610 INFO  [RES] Network Name <mydb3_mydb3>: Entering Offline thread
0000243c.00000fa0::2021/10/23-08:17:25.610 INFO  [RES] Network Name <mydb3_mydb3>: Performing actual offline of resource.
0000243c.00000fa0::2021/10/23-08:17:25.610 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,AdminShare)
0000243c.00002738::2021/10/23-08:17:25.610 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,AdminShare)
0000243c.00002738::2021/10/23-08:17:25.610 INFO  [RES] Network Name <mydb3_mydb3>: AdminShare: Canceling work, state: Closing/Idle
0000243c.00002738::2021/10/23-08:17:25.610 INFO  [RES] Network Name <mydb3_mydb3>: AdminShare: OnCloseBase, previous state: Initialized/Idle
0000243c.00002738::2021/10/23-08:17:25.624 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,AdminShare) result: 0
0000243c.00002738::2021/10/23-08:17:25.624 INFO  [RES] Network Name <mydb3_mydb3>: SyncReplyHandler Configuration, result: 0
0000243c.00000fa0::2021/10/23-08:17:25.625 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,Configuration)
0000243c.00002738::2021/10/23-08:17:25.625 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,Configuration)
0000243c.00002738::2021/10/23-08:17:25.625 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Canceling work, state: Closing/Idle
0000243c.00002738::2021/10/23-08:17:25.625 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: OnCloseBase, previous state: Initialized/Idle
0000243c.00002738::2021/10/23-08:17:25.625 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Closing... (PreviousState: Initialized, Created: true, Type: Singleton)
0000243c.00002738::2021/10/23-08:17:25.625 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,AccountAD)
0000243c.00002738::2021/10/23-08:17:25.625 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,Dns)
0000243c.00002738::2021/10/23-08:17:25.625 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,Client)
0000243c.000029bc::2021/10/23-08:17:25.625 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,AccountAD)
0000243c.000029bc::2021/10/23-08:17:25.625 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,Dns)
0000243c.000029bc::2021/10/23-08:17:25.625 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,Client)
0000243c.00002994::2021/10/23-08:17:25.625 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: Canceling work, state: Closing/Idle
0000243c.000023a8::2021/10/23-08:17:25.625 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Canceling work, state: Closing/Idle
0000243c.00002994::2021/10/23-08:17:25.625 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: OnCloseBase, previous state: Initialized/Idle
0000243c.000023a8::2021/10/23-08:17:25.625 INFO  [RES] Network Name <mydb3_mydb3>: Dns: OnCloseBase, previous state: Initialized/Idle
0000243c.000029bc::2021/10/23-08:17:25.625 INFO  [RES] Network Name <mydb3_mydb3>: Client: Canceling work, state: Closing/Idle
0000243c.000029bc::2021/10/23-08:17:25.625 INFO  [RES] Network Name <mydb3_mydb3>: Client: OnCloseBase, previous state: Initialized/Idle
0000243c.000029bc::2021/10/23-08:17:25.625 INFO  [RES] Network Name: [NNLIB] Removing alias 10.16.1.165 for target mydb3
0000243c.00000a98::2021/10/23-08:17:25.625 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Dns) result: 0
0000243c.00000a98::2021/10/23-08:17:25.625 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Closing NetName (type Singleton) Module Dns, result 0, remaining... 3 (0)
0000243c.00002994::2021/10/23-08:17:25.626 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,AccountAD) result: 0
0000243c.00002994::2021/10/23-08:17:25.626 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Closing NetName (type Singleton) Module AccountAD, result 0, remaining... 2 (0)
0000243c.000029bc::2021/10/23-08:17:25.627 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 124, result size 0 (status: 0, subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:25.627 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 124, result size 0 (status: 0, subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:25.627 INFO  [RES] Network Name: [NNLIB] Success on credential operation remove on Account mydb3$, status: 0 (subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:25.627 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 72, result size 0 (status: 0, subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:25.627 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb3.domain.local, status: 0, subStatus: 0
0000243c.000029bc::2021/10/23-08:17:25.628 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 46, result size 0 (status: 0, subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:25.628 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb3, status: 0, subStatus: 0
0000243c.000029bc::2021/10/23-08:17:25.628 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 46, result size 0 (status: 0, subStatus: 0)
0000243c.000029bc::2021/10/23-08:17:25.628 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb3, status: 0, subStatus: 0
0000243c.000029bc::2021/10/23-08:17:25.629 INFO  [RES] Network Name <mydb3_mydb3>: Client: Unregistering netname for multichannel support returned 0
0000243c.000029bc::2021/10/23-08:17:25.629 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Client) result: 0
0000243c.000029bc::2021/10/23-08:17:25.629 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Closing NetName (type Singleton) Module Client, result 0, remaining... 1 (0)
0000243c.000029bc::2021/10/23-08:17:25.629 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,Netbios)
0000243c.000029bc::2021/10/23-08:17:25.629 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,Netbios)
0000243c.000029bc::2021/10/23-08:17:25.629 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: Canceling work, state: Closing/Idle
0000243c.000029bc::2021/10/23-08:17:25.629 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: OnCloseBase, previous state: Initialized/Idle
0000243c.000029bc::2021/10/23-08:17:25.633 INFO  [RES] Network Name: [NNLIB] Deregistered server name mydb3 on transport \Device\NetbiosSmb
0000243c.000029bc::2021/10/23-08:17:25.653 INFO  [RES] Network Name: [NNLIB] Deleted server name: mydb3 from all transports
0000243c.000029bc::2021/10/23-08:17:25.653 INFO  [RES] Network Name: [NNLIB] Deleting Server Name for server name: mydb3, ret: 0
0000243c.00002994::2021/10/23-08:17:25.653 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: Cleaning up transports
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Netbios) result: 0
0000243c.00002994::2021/10/23-08:17:25.670 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Closing NetName (type Singleton) Module Netbios, result 0, remaining... 0 (0)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: -- listing 5 instances ---------------------------------------------
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 1763b060-dff9-4961-8280-b1b5c0f92039:
0000243c.00002738::2021/10/23-08:17:25.670 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Closed
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Configuration) result: 0
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.00002738::2021/10/23-08:17:25.670 INFO  [RES] Network Name <mydb3_mydb3>: SyncReplyHandler Configuration, result: 0
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: --- 7 modules for instance: df59581d-6cb0-41d3-a597-dbce46545dcd:
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.00000fa0::2021/10/23-08:17:25.670 INFO  [RHS] Resource mydb3_mydb3 has come offline. RHS is about to report resource status to RCM.
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: --- 7 modules for instance: eb44dd7f-7717-4f70-b74f-a2d373c3217a:
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: --- 7 modules for instance: ed158bf7-8c56-4e3e-9187-15f9c63678a5:
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: --- 7 modules for instance: f70cf510-b293-448c-89c9-9313e8be742c:
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
000010a8.00001554::2021/10/23-08:17:25.670 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb3_mydb3', gen(0) result 0/0.
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
000010a8.00001554::2021/10/23-08:17:25.670 INFO  [RCM] Res mydb3_mydb3: OfflinePending -> OfflineSavingCheckpoints( StateUnknown )
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
000010a8.00001554::2021/10/23-08:17:25.670 INFO  [RCM] TransitionToState(mydb3_mydb3) OfflinePending-->OfflineSavingCheckpoints.
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000029bc::2021/10/23-08:17:25.670 INFO  [RES] Network Name: Agent: -- 0 Orphan modules
000010a8.00001554::2021/10/23-08:17:25.670 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00001554::2021/10/23-08:17:25.670 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00001554::2021/10/23-08:17:25.670 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
000010a8.00001554::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id df59581d-6cb0-41d3-a597-dbce46545dcd and name mydb3_mydb3
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id df59581d-6cb0-41d3-a597-dbce46545dcd
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource df59581d-6cb0-41d3-a597-dbce46545dcd in RcmResource
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource df59581d-6cb0-41d3-a597-dbce46545dcd
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource df59581d-6cb0-41d3-a597-dbce46545dcd.
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource df59581d-6cb0-41d3-a597-dbce46545dcd.
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource df59581d-6cb0-41d3-a597-dbce46545dcd finished, about to signal Checkpoint completion
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] Res mydb3_mydb3: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] TransitionToState(mydb3_mydb3) OfflineSavingCheckpoints-->Offline.
000010a8.00001554::2021/10/23-08:17:25.671 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:515 from node 1. Action: causal, Target: CAUS
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource df59581d-6cb0-41d3-a597-dbce46545dcd
000010a8.00000560::2021/10/23-08:17:25.671 INFO  [RCM] Res mydb3_10.16.1.165: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.00000560::2021/10/23-08:17:25.671 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00001554::2021/10/23-08:17:25.671 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:516 from node 1. Action: causal, Target: CAUS
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id df59581d-6cb0-41d3-a597-dbce46545dcd and name mydb3_mydb3
0000023c.000026c8::2021/10/23-08:17:25.671 INFO  [RES] IP Address <mydb3_10.16.1.165>: Taking resource offline...
0000023c.000026c8::2021/10/23-08:17:25.671 INFO  [RES] IP Address <mydb3_10.16.1.165>: Deleting IP address 10.16.1.165.
0000023c.000026c8::2021/10/23-08:17:25.671 INFO  [RES] IP Address <mydb3_10.16.1.165>: Address 10.16.1.165 on adapter vmxnet3 Ethernet Adapter offline.
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb3_10.16.1.165', gen(0) result 0/0.
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] Res mydb3_10.16.1.165: OfflineCallIssued -> OfflineSavingCheckpoints( StateUnknown )
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) OfflineCallIssued-->OfflineSavingCheckpoints.
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id e4c0a555-70a1-4277-9e63-eb4511c6d6a2 and name mydb3_10.16.1.165
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id e4c0a555-70a1-4277-9e63-eb4511c6d6a2
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2 in RcmResource
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2.
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2.
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2 finished, about to signal Checkpoint completion
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] Res mydb3_10.16.1.165: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) OfflineSavingCheckpoints-->Offline.
000010a8.00002a74::2021/10/23-08:17:25.671 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Pending --> Offline)
000010a8.0000199c::2021/10/23-08:17:25.671 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:517 from node 1. Action: causal, Target: CAUS
000010a8.00002498::2021/10/23-08:17:25.671 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:518 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:25.671 INFO  [RCM] rcm::QueuedMovesHolder::RemoveGroup: (mydb3) GroupBeingMoved: true AllowMoveCancel: false NotifyMoveFailure: false
000010a8.00002728::2021/10/23-08:17:25.672 INFO  [GUM] Node 1: executing request locally, gumId:25756, my action: /rcm/gum/GroupMoveOperation, # of updates: 1
000010a8.00002a74::2021/10/23-08:17:25.672 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2
000010a8.00002a74::2021/10/23-08:17:25.672 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id e4c0a555-70a1-4277-9e63-eb4511c6d6a2 and name mydb3_10.16.1.165
000010a8.00002728::2021/10/23-08:17:25.672 INFO  [RCM] rcm::RcmGum::GroupMoveOperation(1)
000010a8.00002728::2021/10/23-08:17:25.672 INFO  [RCM] move of group mydb3 from db-node-primary(1) to db-node-secondary(2) of type MoveType::Failover is about to succeed, failoverCount=1, lastFailoverTime=2021/10/23-03:16:45.280 targeted=false
000010a8.00002728::2021/10/23-08:17:25.672 INFO  MTimer(OneGroupMovetimer): [Total: 0 ms ( 0 s )]
000010a8.00002728::2021/10/23-08:17:25.672 INFO  [RCM] processed 1 group moves, 0 failures
000010a8.00002728::2021/10/23-08:17:25.672 INFO  [DM] An empty single transaction is cancelled 85:85:32555+1::0
000010a8.00002728::2021/10/23-08:17:25.672 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:519 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002a74::2021/10/23-08:17:25.672 DBG   [NETFTAPI] received NsiDeleteInstance for 10.16.1.165
000010a8.00002a74::2021/10/23-08:17:25.672 WARN  [NETFTAPI] Failed to query parameters for 10.16.1.165 (status 0x80070490)
000010a8.00002a74::2021/10/23-08:17:25.672 DBG   [NETFTAPI] Signaled NetftLocalRemove event for 10.16.1.165
000010a8.00002a74::2021/10/23-08:17:25.694 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: forwarded, no retry on error 5908
000010a8.000011f0::2021/10/23-08:17:25.710 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:81 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.710 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:82 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.710 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:83 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.710 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:84 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.711 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:85 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.711 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:86 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.711 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:87 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.718 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:88 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.718 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:89 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.718 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:90 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.719 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:91 from node 2. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:25.865 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb3, 1)
000010a8.000011f0::2021/10/23-08:17:25.903 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:92 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.903 INFO  [GUM] Node 1: Processing RequestLock 2:27
000010a8.000011f0::2021/10/23-08:17:25.903 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:520 from node 1. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:25.903 INFO  [GUM] Node 1: Processing GrantLock to 2 (sent by 1 gumid: 25756)
000010a8.00002728::2021/10/23-08:17:25.941 WARN  [RCM] rcm::RcmApi::AddPossibleOwner: retrying: mydb3, 5908.
000010a8.00002728::2021/10/23-08:17:26.992 WARN  [RCM] rcm::RcmApi::AddPossibleOwner: retrying: mydb3, 5908.
000010a8.000011f0::2021/10/23-08:17:27.099 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:93 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.099 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:94 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.136 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:95 from node 2. Action: /rcm/mrr/BroadcastControl, Target: RCMA
000010a8.000011f0::2021/10/23-08:17:27.136 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:96 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.137 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:97 from node 2. Action: causal, Target: CAUS
0000243c.000029bc::2021/10/23-08:17:27.137 INFO  [RES] Network Name <mydb1_mydb1>: Netname received credentials update
0000243c.000029bc::2021/10/23-08:17:27.137 INFO  [RES] Network Name <mydb1_mydb1>: InitializeADAware - ADAware value is 1
0000243c.00002738::2021/10/23-08:17:27.137 INFO  [RES] Network Name: Agent: InitializeModule, Trying to initialize Module(1763b060-dff9-4961-8280-b1b5c0f92039,Identity) when there is one already in Initialized/Idle state
0000243c.000029bc::2021/10/23-08:17:27.137 INFO  [RES] Network Name <mydb1_mydb1>: HandleCredentialsUpdate - Identity module already exists.
0000243c.00002738::2021/10/23-08:17:27.139 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Credentials Update - Configuration module sending Recheck config to Identity
0000243c.00002738::2021/10/23-08:17:27.139 INFO  [RES] Network Name <mydb1_mydb1>: Identity: OnRecheckConfig, nothing changed
0000243c.00002738::2021/10/23-08:17:27.139 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: InternalReplyHandler: 0
000010a8.000011f0::2021/10/23-08:17:27.187 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:98 from node 2. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:17:27.187 INFO  [GUM] Node 1: Executing locally gumId: 25757, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:27.308 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:99 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.308 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:100 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.850 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:101 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.850 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:102 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.850 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:103 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.850 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:104 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.855 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:105 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.855 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:106 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.856 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:107 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.909 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:108 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.910 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:109 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.911 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:110 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:27.955 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:111 from node 2. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:28.039 WARN  [RCM] rcm::RcmApi::AddPossibleOwner: retrying: mydb3, 5908.
000010a8.00002728::2021/10/23-08:17:29.086 WARN  [RCM] rcm::RcmApi::AddPossibleOwner: retrying: mydb3, 5908.
000010a8.000011f0::2021/10/23-08:17:29.371 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:112 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:29.371 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:113 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:29.408 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:114 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:29.408 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:115 from node 2. Action: /rcm/mrr/BroadcastControl, Target: RCMA
000010a8.000011f0::2021/10/23-08:17:29.408 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:116 from node 2. Action: causal, Target: CAUS
0000243c.00002738::2021/10/23-08:17:29.408 INFO  [RES] Network Name <mydb3_mydb3>: Netname received credentials update
0000243c.00002738::2021/10/23-08:17:29.409 INFO  [RES] Network Name <mydb3_mydb3>: InitializeADAware - ADAware value is 1
0000243c.000029bc::2021/10/23-08:17:29.409 INFO  [RES] Network Name: Agent: InitializeModule, Trying to initialize Module(df59581d-6cb0-41d3-a597-dbce46545dcd,Identity) when there is one already in Initialized/Idle state
0000243c.00002738::2021/10/23-08:17:29.409 INFO  [RES] Network Name <mydb3_mydb3>: HandleCredentialsUpdate - Identity module already exists.
0000243c.000029bc::2021/10/23-08:17:29.411 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Credentials Update - Configuration module sending Recheck config to Identity
0000243c.000029bc::2021/10/23-08:17:29.411 INFO  [RES] Network Name <mydb3_mydb3>: Identity: OnRecheckConfig, nothing changed
0000243c.000029bc::2021/10/23-08:17:29.411 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: InternalReplyHandler: 0
000010a8.000011f0::2021/10/23-08:17:29.459 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:117 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:17:29.459 INFO  [GUM] Node 1: Executing locally gumId: 25758, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:29.647 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:118 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:17:29.647 INFO  [GUM] Node 1: Executing locally gumId: 25759, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:29.693 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:119 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:17:29.693 INFO  [GUM] Node 1: Executing locally gumId: 25760, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:17:29.759 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:120 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:29.759 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:121 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:29.826 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:122 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:17:29.826 INFO  [GUM] Node 1: Executing locally gumId: 25761, updates: 1, first action: /rcm/gum/RemovePossibleOwner
000010a8.00001554::2021/10/23-08:17:29.826 INFO  [RCM] rcm::RcmGum::RemovePossibleOwner(mydb3,1)
000010a8.00001554::2021/10/23-08:17:29.826 INFO  [RCM] Removing node 1 from resource 'mydb3'.
000010a8.000011f0::2021/10/23-08:17:29.870 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:123 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:17:29.871 INFO  [GUM] Node 1: Executing locally gumId: 25762, updates: 1, first action: /rcm/gum/SetGroupPreferredOwners
000010a8.00001554::2021/10/23-08:17:29.871 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb3,<vector len='1'>
000010a8.00001554::2021/10/23-08:17:29.871 INFO      <item>2</item>
000010a8.00001554::2021/10/23-08:17:29.871 INFO  </vector>
000010a8.00001554::2021/10/23-08:17:29.871 INFO  )
000010a8.000011f0::2021/10/23-08:17:29.914 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:124 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:17:29.914 INFO  [GUM] Node 1: Executing locally gumId: 25763, updates: 1, first action: /rcm/gum/AddPossibleOwner
000010a8.00001554::2021/10/23-08:17:29.914 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb3,1)
000010a8.00001554::2021/10/23-08:17:29.914 INFO  [RCM] Adding node 1 to resource 'mydb3'.
000010a8.000011f0::2021/10/23-08:17:29.956 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:125 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:17:29.956 INFO  [GUM] Node 1: Executing locally gumId: 25764, updates: 1, first action: /rcm/gum/SetGroupPreferredOwners
000010a8.00001554::2021/10/23-08:17:29.956 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb3,<vector len='2'>
000010a8.00001554::2021/10/23-08:17:29.956 INFO      <item>2</item>
000010a8.00001554::2021/10/23-08:17:29.956 INFO      <item>1</item>
000010a8.00001554::2021/10/23-08:17:29.956 INFO  </vector>
000010a8.00001554::2021/10/23-08:17:29.956 INFO  )
00000054.00000598::2021/10/23-08:17:30.030 INFO  [RHS-WER] 298922 milliseconds (298 seconds) passed since last WER ERROR report 118e1c10-2699-470e-b8ce-df8227ef2405 for the resource type SQL Server Availability Group call type ISALIVE. Throttling this report
000010a8.000011f0::2021/10/23-08:17:30.063 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:126 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00001554::2021/10/23-08:17:30.063 INFO  [GUM] Node 1: Executing locally gumId: 25765, updates: 1, first action: /dm/update
000010a8.00002728::2021/10/23-08:17:30.133 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'RcmRpcAddPossibleOwner( _rcm, pGroup->GetOwnerNode()->NodeNumber, pRes->ObjectId, nodeId )'
000010a8.00002728::2021/10/23-08:17:30.160 INFO  [RCM] rcm::RcmApi::MoveGroup: (Group:mydb3 Dest:1 Flags:0 MoveType:MoveType::Manual Cur.State:Online, ContextSize:0)
000010a8.00001554::2021/10/23-08:17:30.203 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter NodeDownFilter
000010a8.00001554::2021/10/23-08:17:30.203 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter NodeShuttingDownFilter
000010a8.00001554::2021/10/23-08:17:30.203 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter CurrentNodeFilter
000010a8.00001554::2021/10/23-08:17:30.203 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter PausedNodeFilter
000010a8.00001554::2021/10/23-08:17:30.203 INFO  [RCM] rcm::RcmGroup::NodeIsPossibleOwner: Group mydb3: Node:1 IsPossibleOwner:true
000010a8.00001554::2021/10/23-08:17:30.203 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter PossibleOwnerFilter
000010a8.00001554::2021/10/23-08:17:30.203 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter QueuingPerviouslyRejectedFilter
000010a8.00001554::2021/10/23-08:17:30.203 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter PreferredOwnerWaitFilter
000010a8.00001554::2021/10/23-08:17:30.203 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter AntiAffinityFilter
000010a8.00002498::2021/10/23-08:17:30.204 INFO  [RCM] applying timely STM connectivity snapshot for group mydb3
000010a8.00001554::2021/10/23-08:17:30.204 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter StmFilter
000010a8.00001554::2021/10/23-08:17:30.204 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter DependentCsvSiteFilter
000010a8.00001554::2021/10/23-08:17:30.204 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter GroupIntelligenceFilter
000010a8.00001554::2021/10/23-08:17:30.204 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 1 by filter AvailabilitySetFilter
000010a8.000011f0::2021/10/23-08:17:30.243 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:127 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:30.243 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:128 from node 2. Action: causal, Target: CAUS
000010a8.00001554::2021/10/23-08:17:40.151 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb1, 1)
000010a8.00001554::2021/10/23-08:17:40.189 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'RcmRpcAddPossibleOwner( _rcm, pGroup->GetOwnerNode()->NodeNumber, pRes->ObjectId, nodeId )'
000010a8.00001554::2021/10/23-08:17:40.278 INFO  [RCM] rcm::RcmApi::MoveGroup: (Group:mydb1 Dest:1 Flags:0 MoveType:MoveType::Manual Cur.State:Failed, ContextSize:0)
000010a8.00002728::2021/10/23-08:17:40.316 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter NodeDownFilter
000010a8.00002728::2021/10/23-08:17:40.316 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter NodeShuttingDownFilter
000010a8.00002728::2021/10/23-08:17:40.316 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter CurrentNodeFilter
000010a8.00002728::2021/10/23-08:17:40.316 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter PausedNodeFilter
000010a8.00002728::2021/10/23-08:17:40.317 INFO  [RCM] rcm::RcmGroup::NodeIsPossibleOwner: Group mydb1: Node:1 IsPossibleOwner:true
000010a8.00002728::2021/10/23-08:17:40.317 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter PossibleOwnerFilter
000010a8.00002728::2021/10/23-08:17:40.317 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter QueuingPerviouslyRejectedFilter
000010a8.00002728::2021/10/23-08:17:40.317 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter PreferredOwnerWaitFilter
000010a8.00002728::2021/10/23-08:17:40.317 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter AntiAffinityFilter
000010a8.0000199c::2021/10/23-08:17:40.317 INFO  [RCM] applying timely STM connectivity snapshot for group mydb1
000010a8.00002728::2021/10/23-08:17:40.317 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter StmFilter
000010a8.00002728::2021/10/23-08:17:40.317 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter DependentCsvSiteFilter
000010a8.00002728::2021/10/23-08:17:40.317 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter GroupIntelligenceFilter
000010a8.00002728::2021/10/23-08:17:40.317 INFO  [RCM-plcmt] Group mydb1 allowed to move to node 1 by filter AvailabilitySetFilter
000010a8.000011f0::2021/10/23-08:17:40.355 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:129 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:40.355 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:130 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:40.412 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:131 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:40.412 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:132 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:40.412 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:133 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:40.412 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:134 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:40.414 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:135 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00002728::2021/10/23-08:17:40.414 INFO  [GUM] Node 1: Executing locally gumId: 25766, updates: 1, first action: /rcm/gum/GroupMoveOperation
000010a8.00002728::2021/10/23-08:17:40.414 INFO  [RCM] rcm::RcmGum::GroupMoveOperation(1)
000010a8.00002728::2021/10/23-08:17:40.414 INFO  [RCM] move of group mydb1 from db-node-secondary(2) to db-node-primary(1) of type MoveType::Manual is about to succeed, failoverCount=1, lastFailoverTime=2021/10/23-03:17:20.028 targeted=true
000010a8.0000199c::2021/10/23-08:17:40.414 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:521 from node 1. Action: causal, Target: CAUS
000010a8.0000199c::2021/10/23-08:17:40.414 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:522 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] rcm::RcmGroup::NodeIsPossibleOwner: Group mydb1: Node:1 IsPossibleOwner:true
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] mydb1: Added Flags 16 to StatusInformation. New StatusInformation 16
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] Handing group mydb1 over to the priority manager for bringing
000010a8.0000199c::2021/10/23-08:17:40.415 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:523 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:40.415 INFO  MTimer(OneGroupMovetimer): [Total: 0 ms ( 0 s )]
000010a8.00002a74::2021/10/23-08:17:40.415 INFO  [RCM] moved 1 tasks from staging set to task set.  TaskSetSize=1
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] processed 1 group moves, 0 failures
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [DM] An empty single transaction is cancelled 85:85:32564+1::0
000010a8.00002a74::2021/10/23-08:17:40.415 INFO  [RCM] beginning task set inspection. Blockcontext priority=2000 gname=mydb1
000010a8.00002a74::2021/10/23-08:17:40.415 INFO  [RCM] rcm::RcmPriorityManager::StartGroups: [RCM] done, executed 1 tasks
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] mydb1: Removed Flags 16 from StatusInformation. New StatusInformation 0
000010a8.00002a74::2021/10/23-08:17:40.415 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:524 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] rcm::RcmResource::Online: bringing mydb1_mydb1's provider resource 'mydb1_10.16.1.163' online.
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] rcm::RcmResource::Online: bringing mydb1_mydb1's provider resource 'mydb1_10.30.0.163' online.
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] Res mydb1_10.30.0.163: Offline -> OnlineCallIssued( StateUnknown )
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) Offline-->OnlineCallIssued.
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb1, BringingToPersistentState --> Pending)
000010a8.00002a74::2021/10/23-08:17:40.415 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:525 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] Res mydb1_10.16.1.163: Offline -> OnlineCallIssued( StateUnknown )
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] TransitionToState(mydb1_10.16.1.163) Offline-->OnlineCallIssued.
000010a8.0000199c::2021/10/23-08:17:40.415 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:526 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] Res mydb1_mydb1: Offline -> WaitingToComeOnline( StateUnknown )
000010a8.00002728::2021/10/23-08:17:40.415 INFO  [RCM] TransitionToState(mydb1_mydb1) Offline-->WaitingToComeOnline.
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM] rcm::RcmResource::Online: mydb1's provider 'mydb1_mydb1' is already coming online (state is WaitingToComeOnline).
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM] rcm::RcmResource::Online: mydb1's provider 'mydb1_10.16.1.163' is already coming online (state is OnlineCallIssued).
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM] rcm::RcmResource::Online: mydb1's provider 'mydb1_10.30.0.163' is already coming online (state is OnlineCallIssued).
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM] Res mydb1: Offline -> WaitingToComeOnline( StateUnknown )
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM] TransitionToState(mydb1) Offline-->WaitingToComeOnline.
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002728::2021/10/23-08:17:40.416 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002a74::2021/10/23-08:17:40.416 INFO  [RCM] Issuing Online(mydb1_10.16.1.163) to RHS.
000010a8.00002498::2021/10/23-08:17:40.416 INFO  [RCM] Issuing Online(mydb1_10.30.0.163) to RHS.
0000023c.00002acc::2021/10/23-08:17:40.416 INFO  [RES] IP Address <mydb1_10.30.0.163>: Bringing resource online...
0000023c.00000678::2021/10/23-08:17:40.416 INFO  [RES] IP Address <mydb1_10.16.1.163>: Bringing resource online...
000010a8.00002498::2021/10/23-08:17:40.417 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1_10.30.0.163', gen(3) result 997/0.
000010a8.00002498::2021/10/23-08:17:40.417 INFO  [RCM] Res mydb1_10.30.0.163: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00002498::2021/10/23-08:17:40.417 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) OnlineCallIssued-->OnlinePending.
0000023c.00001ae8::2021/10/23-08:17:40.417 INFO  [RES] IP Address <mydb1_10.30.0.163>: Online thread running.
000010a8.00002a74::2021/10/23-08:17:40.417 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1_10.16.1.163', gen(0) result 997/0.
000010a8.00002a74::2021/10/23-08:17:40.417 INFO  [RCM] Res mydb1_10.16.1.163: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00002a74::2021/10/23-08:17:40.417 INFO  [RCM] TransitionToState(mydb1_10.16.1.163) OnlineCallIssued-->OnlinePending.
0000023c.000027b0::2021/10/23-08:17:40.417 INFO  [RES] IP Address <mydb1_10.16.1.163>: Online thread running.
0000023c.000027b0::2021/10/23-08:17:40.417 INFO  [RES] IP Address <mydb1_10.16.1.163>: Deleting IP address 10.16.1.163.
0000023c.000027b0::2021/10/23-08:17:40.417 WARN  [RES] IP Address <mydb1_10.16.1.163>: Failed to delete IP address 10.16.1.163, status 87.
0000023c.000027b0::2021/10/23-08:17:40.417 INFO  [RES] IP Address <mydb1_10.16.1.163>: could not delete IP address 10.16.1.163, probably it is no longer valid.
0000023c.00001ae8::2021/10/23-08:17:40.419 INFO  [RES] IP Address <mydb1_10.30.0.163>: Checking for network match: IP address mask 255.255.255.0, network mask 255.255.255.0 and IP address 10.30.0.163, network address 10.30.0.0, role 3.
0000023c.000027b0::2021/10/23-08:17:40.419 INFO  [RES] IP Address <mydb1_10.16.1.163>: Checking for network match: IP address mask 255.255.255.0, network mask 255.255.255.0 and IP address 10.16.1.163, network address 10.30.0.0, role 3.
0000023c.000027b0::2021/10/23-08:17:40.420 INFO  [RES] IP Address <mydb1_10.16.1.163>: Checking for network match: IP address mask 255.255.255.0, network mask 255.255.255.0 and IP address 10.16.1.163, network address 10.16.1.0, role 3.
0000023c.00001ae8::2021/10/23-08:17:40.420 ERR   [RES] IP Address <mydb1_10.30.0.163>: Open: Unable to find netinterface for node 1 on network 21dd22f5-ec20-4f7b-95e9-bce2630ae612, status 5035.
0000023c.00001ae8::2021/10/23-08:17:40.421 WARN  [RHS] Resource mydb1_10.30.0.163 has indicated that it cannot come online on this node.
000010a8.00002728::2021/10/23-08:17:40.421 WARN  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1_10.30.0.163', gen(3) result 5015/0.
000010a8.00002728::2021/10/23-08:17:40.421 INFO  [RCM] Res mydb1_10.30.0.163: OnlinePending -> ProcessingFailure( CannotComeOnlineOnThisNode )
000010a8.00002728::2021/10/23-08:17:40.421 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) OnlinePending-->[ProcessingFailure to CannotComeOnlineOnThisNode].
000010a8.00002728::2021/10/23-08:17:40.421 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb1_10.30.0.163)
000010a8.00002a74::2021/10/23-08:17:40.421 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:527 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:40.421 INFO  [RCM] IP address resource 'mydb1_10.30.0.163' cannot come online on this node right now, but not raising any failure events
000010a8.00002498::2021/10/23-08:17:40.421 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00002498::2021/10/23-08:17:40.421 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00002728::2021/10/23-08:17:40.421 INFO  [RCM] resource mydb1_10.30.0.163: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.00002498::2021/10/23-08:17:40.421 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource f08053c9-1452-4458-9420-de289cd04dce.
000010a8.00002498::2021/10/23-08:17:40.421 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource f08053c9-1452-4458-9420-de289cd04dce.
000010a8.00002728::2021/10/23-08:17:40.421 INFO  [RCM] Since no top level resource will be offlined by this resource's failure, resetting restartAction to 1
000010a8.00002728::2021/10/23-08:17:40.421 INFO  [RCM] Res mydb1_10.30.0.163: [ProcessingFailure to CannotComeOnlineOnThisNode] -> WaitingToTerminate( CannotComeOnlineOnThisNode )
000010a8.00002728::2021/10/23-08:17:40.421 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) [ProcessingFailure to CannotComeOnlineOnThisNode]-->[WaitingToTerminate to CannotComeOnlineOnThisNode].
000010a8.00002728::2021/10/23-08:17:40.421 INFO  [RCM] Res mydb1_10.30.0.163: [WaitingToTerminate to CannotComeOnlineOnThisNode] -> Terminating( CannotComeOnlineOnThisNode )
000010a8.00002728::2021/10/23-08:17:40.421 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) [WaitingToTerminate to CannotComeOnlineOnThisNode]-->[Terminating to CannotComeOnlineOnThisNode].
000010a8.00002728::2021/10/23-08:17:40.421 WARN  [RCM] resource 'mydb1_10.30.0.163' has exceeded its restart limit.
000010a8.00002728::2021/10/23-08:17:40.421 INFO  [RCM] Will retry online from long delay restart of mydb1_10.30.0.163 in 600000 milliseconds.
0000023c.00000678::2021/10/23-08:17:40.421 INFO  [RES] IP Address <mydb1_10.30.0.163>: Terminating resource...
0000023c.00000678::2021/10/23-08:17:40.421 INFO  [RES] IP Address <mydb1_10.30.0.163>: Address 10.30.0.163 on adapter [Unknown] offline.
000010a8.00000560::2021/10/23-08:17:40.421 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb1_10.30.0.163', gen(4) result 0/0.
000010a8.00002a74::2021/10/23-08:17:40.421 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002a74::2021/10/23-08:17:40.421 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002a74::2021/10/23-08:17:40.421 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002a74::2021/10/23-08:17:40.421 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002a74::2021/10/23-08:17:40.421 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002a74::2021/10/23-08:17:40.421 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002a74::2021/10/23-08:17:40.421 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002a74::2021/10/23-08:17:40.421 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00000560::2021/10/23-08:17:40.421 INFO  [RCM] Res mydb1_10.30.0.163: [Terminating to CannotComeOnlineOnThisNode] -> CannotComeOnlineOnThisNode( StateUnknown )
000010a8.00000560::2021/10/23-08:17:40.421 INFO  [RCM] TransitionToState(mydb1_10.30.0.163) [Terminating to CannotComeOnlineOnThisNode]-->CannotComeOnlineOnThisNode.
000010a8.00002a74::2021/10/23-08:17:40.421 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:528 from node 1. Action: causal, Target: CAUS
000010a8.000006e0::2021/10/23-08:17:40.421 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:40.421 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:40.422 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:40.422 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:40.422 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:40.422 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:40.422 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:40.422 INFO  [RCM-rbtr] giving default token to group mydb1
0000023c.000027b0::2021/10/23-08:17:40.423 INFO  [RES] IP Address <mydb1_10.16.1.163>: Online: Opened object handle for netinterface 0f1179de-8e47-40fc-931d-935472342602.
0000023c.000027b0::2021/10/23-08:17:40.423 INFO  [RES] IP Address <mydb1_10.16.1.163>: Online: Registered notification for netinterface 0f1179de-8e47-40fc-931d-935472342602.
000010a8.00001554::2021/10/23-08:17:40.452 WARN  [RCM] rcm::RcmApi::GetResourceState: retrying: mydb1, 5908.
0000023c.000027b0::2021/10/23-08:17:40.453 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000023c.000027b0::2021/10/23-08:17:40.453 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000023c.000027b0::2021/10/23-08:17:40.453 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000023c.000027b0::2021/10/23-08:17:40.453 DBG   [ClNet]                  ConnectoidName: Ethernet
0000023c.000027b0::2021/10/23-08:17:40.453 DBG   [ClNet]                  Netbios/TCP:    0
0000023c.000027b0::2021/10/23-08:17:40.453 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000023c.000027b0::2021/10/23-08:17:40.453 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000023c.000027b0::2021/10/23-08:17:40.453 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000023c.000027b0::2021/10/23-08:17:40.453 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000023c.000027b0::2021/10/23-08:17:40.453 DBG   [ClNet]                  Netbios/TCP:    1
0000023c.000027b0::2021/10/23-08:17:40.453 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000023c.000027b0::2021/10/23-08:17:40.453 INFO  [RES] IP Address <mydb1_10.16.1.163>: NetBIOS is disabled for the resource. Deleting NBT value from the cluster database.
0000023c.000027b0::2021/10/23-08:17:40.453 INFO  [RES] IP Address <mydb1_10.16.1.163>: Successfully deleted NBT interface information from database, status 0.
0000023c.000027b0::2021/10/23-08:17:40.453 INFO  [RES] IP Address <mydb1_10.16.1.163>: Did not write IP interface information to database as it is already present.
0000023c.000027b0::2021/10/23-08:17:40.453 INFO  [RES] IP Address <mydb1_10.16.1.163>: Created IP interface A30110AC.
000010a8.00000560::2021/10/23-08:17:40.453 DBG   [NETFTAPI] received NsiAddInstance for 10.16.1.163
000010a8.000006e0::2021/10/23-08:17:41.775 INFO  [RCM] rcm::RcmApi::OnlineResource: (mydb1, 0)
0000023c.00000678::2021/10/23-08:17:42.799 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001554::2021/10/23-08:17:43.894 DBG   [NETFTAPI] received NsiParameterNotification for 10.16.1.163 (IpDadStatePreferred)
000010a8.00001554::2021/10/23-08:17:43.894 DBG   [NETFTAPI] Signaled NetftLocalAdd event for 10.16.1.163
000010a8.00001554::2021/10/23-08:17:43.894 DBG   [NETFTAPI] Signaled NetftLocalConnect event for 10.16.1.163
000010a8.0000174c::2021/10/23-08:17:43.898 INFO  [IM] got event: Local endpoint 10.16.1.163:~0~ connected
0000023c.000027b0::2021/10/23-08:17:44.127 INFO  [RES] IP Address <mydb1_10.16.1.163>: IpaOnlineThread: ProbePort property is not set.
0000023c.000027b0::2021/10/23-08:17:44.127 INFO  [RHS] Resource mydb1_10.16.1.163 has come online. RHS is about to report status change to RCM
000010a8.00000560::2021/10/23-08:17:44.128 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1_10.16.1.163', gen(0) result 0/0.
0000023c.000027b0::2021/10/23-08:17:44.128 INFO  [RES] IP Address <mydb1_10.16.1.163>: IP Address 10.16.1.163 on adapter vmxnet3 Ethernet Adapter online
000010a8.00000560::2021/10/23-08:17:44.128 INFO  [RCM] Res mydb1_10.16.1.163: OnlinePending -> Online( StateUnknown )
000010a8.00000560::2021/10/23-08:17:44.128 INFO  [RCM] TransitionToState(mydb1_10.16.1.163) OnlinePending-->Online.
000010a8.00001554::2021/10/23-08:17:44.128 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:529 from node 1. Action: causal, Target: CAUS
000010a8.000006e0::2021/10/23-08:17:44.128 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:44.128 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:44.128 INFO  [RCM] Res mydb1_mydb1: WaitingToComeOnline -> OnlineCallIssued( StateUnknown )
000010a8.000006e0::2021/10/23-08:17:44.128 INFO  [RCM] TransitionToState(mydb1_mydb1) WaitingToComeOnline-->OnlineCallIssued.
000010a8.000006e0::2021/10/23-08:17:44.128 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00002a74::2021/10/23-08:17:44.128 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:530 from node 1. Action: causal, Target: CAUS
000010a8.000006e0::2021/10/23-08:17:44.128 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:44.128 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.000006e0::2021/10/23-08:17:44.128 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00001554::2021/10/23-08:17:44.128 INFO  [RCM] Issuing Online(mydb1_mydb1) to RHS.
0000243c.000029bc::2021/10/23-08:17:44.128 INFO  [RES] Network Name <mydb1_mydb1>: Online called for resource mydb1_mydb1
000010a8.00002a74::2021/10/23-08:17:44.129 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1_mydb1', gen(0) result 997/0.
000010a8.00002a74::2021/10/23-08:17:44.129 INFO  [RCM] Res mydb1_mydb1: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00002a74::2021/10/23-08:17:44.129 INFO  [RCM] TransitionToState(mydb1_mydb1) OnlineCallIssued-->OnlinePending.
0000243c.00000f98::2021/10/23-08:17:44.129 INFO  [RES] Network Name <mydb1_mydb1>: Entering Online thread
0000243c.00000f98::2021/10/23-08:17:44.129 INFO  [RES] Network Name <mydb1_mydb1>: Initializing config info
0000243c.00000f98::2021/10/23-08:17:44.132 INFO  [RES] Network Name: Agent: Initializing (1763b060-dff9-4961-8280-b1b5c0f92039,Identity)
0000243c.00000f98::2021/10/23-08:17:44.132 INFO  [RES] Network Name <mydb1_mydb1>: Performing actual online of resource.
0000243c.000029bc::2021/10/23-08:17:44.132 INFO  [RES] Network Name: Agent: OnInitialize (1763b060-dff9-4961-8280-b1b5c0f92039,Identity)
0000243c.000029bc::2021/10/23-08:17:44.132 INFO  [RES] Network Name: Agent: InitializeModule, Trying to initialize Module(1763b060-dff9-4961-8280-b1b5c0f92039,Identity) when there is one already in Initialized/Idle state
0000243c.000029bc::2021/10/23-08:17:44.132 INFO  [RES] Network Name <mydb1_mydb1>: ReplyHandler Identity, result: 183
0000243c.00000f98::2021/10/23-08:17:44.132 INFO  [RES] Network Name <mydb1_mydb1>: InitializeADAware - ADAware value is 1
0000243c.00000f98::2021/10/23-08:17:44.133 INFO  [RES] Network Name <mydb1_mydb1>: Obtaining IP info for resource mydb1_10.16.1.163
0000243c.00000f98::2021/10/23-08:17:44.134 INFO  [RES] Network Name <mydb1_mydb1>: Using provider mydb1_10.16.1.163, ip address 10.16.1.163, mask 255.255.255.0, prefix length 24
0000243c.00000f98::2021/10/23-08:17:44.134 INFO  [RES] Network Name <mydb1_mydb1>: Obtaining IP info for resource mydb1_10.30.0.163
0000243c.00000f98::2021/10/23-08:17:44.135 INFO  [RES] Network Name <mydb1_mydb1>: Using provider mydb1_10.30.0.163, ip address 10.30.0.163, mask 255.255.255.0, prefix length 24
0000243c.00000f98::2021/10/23-08:17:44.135 INFO  [RES] Network Name <mydb1_mydb1>: Resource has 2 IPs
0000243c.00000f98::2021/10/23-08:17:44.135 INFO  [RES] Network Name <mydb1_mydb1>: IP: Type Ipv4, Address 10.16.1.163:~0~, Prefix 10.16.1.163/24, Online true, Transport
0000243c.00000f98::2021/10/23-08:17:44.135 INFO  [RES] Network Name <mydb1_mydb1>: IP: Type Ipv4, Address 10.30.0.163:~0~, Prefix 10.30.0.163/24, Online false, Transport
0000243c.00000f98::2021/10/23-08:17:44.135 INFO  [RES] Network Name: Agent: Initializing (1763b060-dff9-4961-8280-b1b5c0f92039,Configuration)
0000243c.000029bc::2021/10/23-08:17:44.135 INFO  [RES] Network Name: Agent: OnInitialize (1763b060-dff9-4961-8280-b1b5c0f92039,Configuration)
0000243c.000029bc::2021/10/23-08:17:44.135 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Offline
0000243c.000029bc::2021/10/23-08:17:44.135 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:1763b060-dff9-4961-8280-b1b5c0f92039:Configuration
0000243c.00002994::2021/10/23-08:17:44.135 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Waiting for ongoing slow strand to complete (if any)
0000243c.00002994::2021/10/23-08:17:44.135 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Signaling main strand to initialize module
0000243c.00002994::2021/10/23-08:17:44.136 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Calling initialize of the configuration implementation
0000243c.00002994::2021/10/23-08:17:44.136 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Initializing an AD NetName (type Singleton)...
0000243c.00002994::2021/10/23-08:17:44.136 INFO  [RES] Network Name: Agent: Initializing (1763b060-dff9-4961-8280-b1b5c0f92039,Dns)
0000243c.00002994::2021/10/23-08:17:44.136 INFO  [RES] Network Name: Agent: Initializing (1763b060-dff9-4961-8280-b1b5c0f92039,Netbios)
0000243c.000029bc::2021/10/23-08:17:44.136 INFO  [RES] Network Name: Agent: OnInitialize (1763b060-dff9-4961-8280-b1b5c0f92039,Dns)
0000243c.000029bc::2021/10/23-08:17:44.136 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.000029bc::2021/10/23-08:17:44.136 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:1763b060-dff9-4961-8280-b1b5c0f92039:Dns
0000243c.000029bc::2021/10/23-08:17:44.136 INFO  [RES] Network Name: Agent: OnInitialize (1763b060-dff9-4961-8280-b1b5c0f92039,Netbios)
0000243c.00002994::2021/10/23-08:17:44.136 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Waiting for ongoing slow strand to complete (if any)
0000243c.000029bc::2021/10/23-08:17:44.136 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.00002994::2021/10/23-08:17:44.136 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Signaling main strand to initialize module
0000243c.000029bc::2021/10/23-08:17:44.136 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:1763b060-dff9-4961-8280-b1b5c0f92039:Netbios
0000243c.00002994::2021/10/23-08:17:44.136 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Initializing Name: mydb1, NetbiosName: mydb1, Type: Singleton
0000243c.00000478::2021/10/23-08:17:44.136 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: Waiting for ongoing slow strand to complete (if any)
0000243c.00002994::2021/10/23-08:17:44.136 INFO  [RES] Network Name: Agent: OnInitializeReply (1763b060-dff9-4961-8280-b1b5c0f92039,Dns): 0, Prev.State: Alive
0000243c.00002994::2021/10/23-08:17:44.136 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: Signaling main strand to initialize module
0000243c.00000478::2021/10/23-08:17:44.136 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Initializing NetName (type Singleton, state Initializing) Module Dns, result 0, remaining... 2 (0)
0000243c.00002994::2021/10/23-08:17:44.136 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: Initializing Name: mydb1, NetbiosName: mydb1, Type: Singleton
0000243c.00002994::2021/10/23-08:17:44.137 INFO  [RES] Network Name: [NNLIB] NetbiosServer::SetName - Transport address len 10, address suffix len 23
0000243c.00002994::2021/10/23-08:17:44.197 INFO  [RES] Network Name: [NNLIB] Registered server name mydb1 on transport \Device\NetbiosSmb, flags 14
0000243c.00002994::2021/10/23-08:17:44.197 INFO  [RES] Network Name: [NNLIB] Enabled scope for server name mydb1
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name: [NNLIB] Redirector Cache Flushed (0)
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: Registered Name: mydb1 into Netbios (Type: Singleton), result: 0 (0 transports registered)
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name: Agent: OnInitializeReply (1763b060-dff9-4961-8280-b1b5c0f92039,Netbios): 0, Prev.State: Alive
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Initializing NetName (type Singleton, state Initializing) Module Netbios, result 0, remaining... 1 (0)
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name: Agent: Initializing (1763b060-dff9-4961-8280-b1b5c0f92039,Client)
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name: Agent: OnInitialize (1763b060-dff9-4961-8280-b1b5c0f92039,Client)
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:1763b060-dff9-4961-8280-b1b5c0f92039:Client
0000243c.00000478::2021/10/23-08:17:44.198 INFO  [RES] Network Name <mydb1_mydb1>: Client: Waiting for ongoing slow strand to complete (if any)
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name <mydb1_mydb1>: Client: Signaling main strand to initialize module
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name <mydb1_mydb1>: Client: Initializing Name: mydb1, NetbiosName: mydb1, Type: Singleton
0000243c.00002994::2021/10/23-08:17:44.198 INFO  [RES] Network Name: [NNLIB] NetbiosServer::SetName - Transport address len 10, address suffix len 23
0000243c.00000478::2021/10/23-08:17:44.199 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 44, result size 0 (status: 0, subStatus: 0)
0000243c.00000478::2021/10/23-08:17:44.199 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb1, status: 0, subStatus: 0
0000243c.00000478::2021/10/23-08:17:44.200 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 44, result size 0 (status: 0, subStatus: 0)
0000243c.00000478::2021/10/23-08:17:44.200 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb1, status: 0, subStatus: 0
0000243c.00000478::2021/10/23-08:17:44.260 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet]                  DNS Suffix:
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00000478::2021/10/23-08:17:44.260 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00000478::2021/10/23-08:17:44.260 DBG   [ClNet]                  DNS Suffix:
0000243c.00000478::2021/10/23-08:17:44.260 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00000478::2021/10/23-08:17:44.261 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00000478::2021/10/23-08:17:44.261 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00000478::2021/10/23-08:17:44.261 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00000478::2021/10/23-08:17:44.261 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.163 Prefix: 10.16.1.163/24 (Actual address: 10.16.1.163), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00000478::2021/10/23-08:17:44.261 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.163 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.163 Prefix: 10.30.0.163/24)
0000243c.00000478::2021/10/23-08:17:44.261 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00000478::2021/10/23-08:17:44.261 INFO  [RES] Network Name <mydb1_mydb1>: Client: Final alias is 10.16.1.163
0000243c.00000478::2021/10/23-08:17:44.261 INFO  [RES] Network Name: [NNLIB] Adding alias 10.16.1.163 for target mydb1
0000243c.00000478::2021/10/23-08:17:44.262 INFO  [RES] Network Name <mydb1_mydb1>: Client: RegisterFqdnWithLsa - Registering FQDN 'mydb1.domain.local' with LSA
0000243c.00000478::2021/10/23-08:17:44.262 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 70, result size 0 (status: 0, subStatus: 0)
0000243c.00000478::2021/10/23-08:17:44.262 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb1.domain.local, status: 0, subStatus: 0
0000243c.00000478::2021/10/23-08:17:44.271 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 150, result size 0 (status: 0, subStatus: 0)
0000243c.00000478::2021/10/23-08:17:44.271 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 150, result size 0 (status: 0, subStatus: 0)
0000243c.00000478::2021/10/23-08:17:44.271 INFO  [RES] Network Name: [NNLIB] Success on credential operation add on Account mydb1$, status: 0 (subStatus: 0)
0000243c.00000478::2021/10/23-08:17:44.271 INFO  [RES] Network Name <mydb1_mydb1>: Client: Registered Name: mydb1 into LSA (Type: Singleton), result: 0
0000243c.00002994::2021/10/23-08:17:44.271 INFO  [RES] Network Name: Agent: OnInitializeReply (1763b060-dff9-4961-8280-b1b5c0f92039,Client): 0, Prev.State: Alive
0000243c.00002994::2021/10/23-08:17:44.271 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Initializing NetName (type Singleton, state Initializing) Module Client, result 0, remaining... 0 (0)
0000243c.00002994::2021/10/23-08:17:44.271 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Initialized
0000243c.00000478::2021/10/23-08:17:44.271 INFO  [RES] Network Name: Agent: OnInitializeReply (1763b060-dff9-4961-8280-b1b5c0f92039,Configuration): 0, Prev.State: Alive
0000243c.00000478::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: SyncReplyHandler Configuration, result: 0
0000243c.00000478::2021/10/23-08:17:44.272 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.00000f98::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: PerformOnline - Initialization of Configuration module finished with result: 0
0000243c.00002994::2021/10/23-08:17:44.272 INFO  [RES] Network Name: Agent: Initializing (1763b060-dff9-4961-8280-b1b5c0f92039,AccountAD)
0000243c.00002994::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Rechecking Dns
0000243c.00000478::2021/10/23-08:17:44.272 INFO  [RES] Network Name: Agent: OnInitialize (1763b060-dff9-4961-8280-b1b5c0f92039,AccountAD)
0000243c.00000478::2021/10/23-08:17:44.272 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.00000478::2021/10/23-08:17:44.272 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:1763b060-dff9-4961-8280-b1b5c0f92039:AccountAD
0000243c.000029bc::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Dns - Rechecking config internally
0000243c.000029bc::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: Waiting for ongoing slow strand to complete (if any)
0000243c.000029bc::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: Signaling main strand to initialize module
0000243c.000029bc::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: Initializing Name: mydb1, NetbiosName: mydb1, Type: Singleton, Created: true
0000243c.00000f98::2021/10/23-08:17:44.272 INFO  [RES] Network Name: Agent: Initializing (1763b060-dff9-4961-8280-b1b5c0f92039,AdminShare)
0000243c.00002738::2021/10/23-08:17:44.272 INFO  [RES] Network Name: Agent: OnInitialize (1763b060-dff9-4961-8280-b1b5c0f92039,AdminShare)
0000243c.00000f98::2021/10/23-08:17:44.272 INFO  [RHS] Resource mydb1_mydb1 has come online. RHS is about to report status change to RCM
0000243c.00002738::2021/10/23-08:17:44.272 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.00002738::2021/10/23-08:17:44.272 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:1763b060-dff9-4961-8280-b1b5c0f92039:AdminShare
000010a8.00001554::2021/10/23-08:17:44.272 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1_mydb1', gen(0) result 0/0.
000010a8.00001554::2021/10/23-08:17:44.272 INFO  [RCM] Res mydb1_mydb1: OnlinePending -> Online( StateUnknown )
000010a8.00001554::2021/10/23-08:17:44.272 INFO  [RCM] TransitionToState(mydb1_mydb1) OnlinePending-->Online.
0000243c.00002738::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: AdminShare: Waiting for ongoing slow strand to complete (if any)
0000243c.00002994::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Sending broadcast credentials to all Identity clones after initialization
0000243c.00002738::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: AdminShare: Signaling main strand to initialize module
0000243c.00002738::2021/10/23-08:17:44.272 INFO  [RES] Network Name <mydb1_mydb1>: AdminShare: Initializing Name: mydb1, NetbiosName: mydb1, Type: Singleton
000010a8.000006e0::2021/10/23-08:17:44.272 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:531 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:44.272 INFO  [RCM] rcm::RcmApi::BroadcastControl: Sending NETNAME_CREDS_UPDATED to mydb1_mydb1 on all nodes.
000010a8.00002728::2021/10/23-08:17:44.272 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:532 from node 1. Action: /rcm/mrr/BroadcastControl, Target: RCMA
000010a8.00001554::2021/10/23-08:17:44.272 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00001554::2021/10/23-08:17:44.272 INFO  [RCM-rbtr] giving default token to group mydb1
000010a8.00001554::2021/10/23-08:17:44.272 INFO  [RCM] Res mydb1: WaitingToComeOnline -> OnlineCallIssued( StateUnknown )
000010a8.00001554::2021/10/23-08:17:44.272 INFO  [RCM] TransitionToState(mydb1) WaitingToComeOnline-->OnlineCallIssued.
000010a8.00001554::2021/10/23-08:17:44.272 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:533 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:17:44.273 INFO  [RCM] Issuing Online(mydb1) to RHS.
0000243c.000023a8::2021/10/23-08:17:44.273 INFO  [RES] Network Name <mydb1_mydb1>: Netname received credentials update
000010a8.00000560::2021/10/23-08:17:44.273 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1', gen(3) result 997/0.
000010a8.00000560::2021/10/23-08:17:44.273 INFO  [RCM] Res mydb1: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00000560::2021/10/23-08:17:44.273 INFO  [RCM] TransitionToState(mydb1) OnlineCallIssued-->OnlinePending.
0000243c.000023a8::2021/10/23-08:17:44.273 INFO  [RES] Network Name <mydb1_mydb1>: InitializeADAware - ADAware value is 1
0000243c.000008ac::2021/10/23-08:17:44.273 INFO  [RES] Network Name: Agent: InitializeModule, Trying to initialize Module(1763b060-dff9-4961-8280-b1b5c0f92039,Identity) when there is one already in Initialized/Idle state
0000243c.000023a8::2021/10/23-08:17:44.273 INFO  [RES] Network Name <mydb1_mydb1>: HandleCredentialsUpdate - Identity module already exists.
00000054.0000074c::2021/10/23-08:17:44.274 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] The DeadLockTimeout property has a value of 300000
00000054.0000074c::2021/10/23-08:17:44.274 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] The PendingTimeout property has a value of 180000
0000243c.00000478::2021/10/23-08:17:44.280 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00000478::2021/10/23-08:17:44.280 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00000478::2021/10/23-08:17:44.280 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00000478::2021/10/23-08:17:44.280 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00000478::2021/10/23-08:17:44.280 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00000478::2021/10/23-08:17:44.280 DBG   [ClNet]                  DNS Suffix:
0000243c.00000478::2021/10/23-08:17:44.280 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00000478::2021/10/23-08:17:44.280 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00000478::2021/10/23-08:17:44.280 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00000478::2021/10/23-08:17:44.281 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00000478::2021/10/23-08:17:44.281 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00000478::2021/10/23-08:17:44.281 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00000478::2021/10/23-08:17:44.281 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00000478::2021/10/23-08:17:44.281 DBG   [ClNet]                  DNS Suffix:
0000243c.00000478::2021/10/23-08:17:44.281 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.163 Prefix: 10.16.1.163/24 (Actual address: 10.16.1.163), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.163 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.163 Prefix: 10.30.0.163/24)
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.163
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.163
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.00000478::2021/10/23-08:17:44.283 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Registering into DNS Name: mydb1 (Type: Singleton)...
0000243c.00000478::2021/10/23-08:17:44.290 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Impersonating VCO User 'mydb1$' to Update DNS registration.  IsCore? false
0000243c.000023a8::2021/10/23-08:17:44.290 INFO  [RES] Network Name <mydb1_mydb1>: Identity: Get Token Request, currently has a token
0000243c.00000478::2021/10/23-08:17:44.290 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.00000478::2021/10/23-08:17:44.290 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.00000478::2021/10/23-08:17:44.290 INFO  [RES] Network Name: [NNLIB] Registering name mydb1 on DNS Network: Cluster Network 1, with 2 DNS Servers, 2 Virtual Addresses, 1 Domain Names
0000243c.00000478::2021/10/23-08:17:44.290 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000478::2021/10/23-08:17:44.290 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000478::2021/10/23-08:17:44.290 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.163
0000243c.00000478::2021/10/23-08:17:44.290 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.163
0000243c.00000478::2021/10/23-08:17:44.290 INFO  [RES] Network Name: [NNLIB] Registering: mydb1.domain.local
0000243c.00002738::2021/10/23-08:17:44.302 INFO  [RES] Network Name <mydb1_mydb1>: AdminShare: Creation of disk admin shares succeeded
00000054.0000074c::2021/10/23-08:17:44.305 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Connect to SQL Server ...
0000243c.00002994::2021/10/23-08:17:44.313 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: BroadcastCredentialsUpdateImp sent
0000243c.00002994::2021/10/23-08:17:44.313 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Number of IPs that match current node id is 1. Registering mydb1 for multichannel support
0000243c.00002994::2021/10/23-08:17:44.317 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Registering netname for multichannel support returned 0
0000243c.00002994::2021/10/23-08:17:44.317 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Credentials Update - Configuration module sending Recheck config to Identity
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: -- listing 5 instances ---------------------------------------------
0000243c.00002994::2021/10/23-08:17:44.317 INFO  [RES] Network Name <mydb1_mydb1>: Identity: OnRecheckConfig, nothing changed
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 1763b060-dff9-4961-8280-b1b5c0f92039:
0000243c.00002994::2021/10/23-08:17:44.317 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: InternalReplyHandler: 0
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initializing/Reading (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initializing/Writing (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: --- 7 modules for instance: df59581d-6cb0-41d3-a597-dbce46545dcd:
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: --- 7 modules for instance: eb44dd7f-7717-4f70-b74f-a2d373c3217a:
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: --- 7 modules for instance: ed158bf7-8c56-4e3e-9187-15f9c63678a5:
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: --- 7 modules for instance: f70cf510-b293-448c-89c9-9313e8be742c:
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.00000a98::2021/10/23-08:17:44.317 INFO  [RES] Network Name: Agent: -- 0 Orphan modules
0000243c.00000478::2021/10/23-08:17:44.391 INFO  [RES] Network Name: [NNLIB] DNS Record there for mydb1.domain.local, proceeding
0000243c.000029bc::2021/10/23-08:17:44.508 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000243c.000029bc::2021/10/23-08:17:44.508 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: OnInitializeEnd: 0
0000243c.000029bc::2021/10/23-08:17:44.509 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: OnInitializeEnd: Starting health check timer in 3600 seconds
0000243c.00000a98::2021/10/23-08:17:44.509 INFO  [RES] Network Name: Agent: OnInitializeReply (1763b060-dff9-4961-8280-b1b5c0f92039,AccountAD): 0, Prev.State: Alive
0000243c.00000a98::2021/10/23-08:17:44.509 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: AccountADInitReplyHandler - Received result 0 from AccountAD
0000243c.00000478::2021/10/23-08:17:44.578 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn mydb1.domain.local (ipv4Count 2, ipv6Count 0)
0000243c.00000478::2021/10/23-08:17:44.578 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.00000478::2021/10/23-08:17:44.657 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner mydb1.domain.local (registered sets: 1, ipv4Count 2, ipv6Count 0, ptrCount 2)
0000243c.00000478::2021/10/23-08:17:44.657 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.00000478::2021/10/23-08:17:44.658 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Completed DNS Registration for Name: mydb1 (Type: Singleton)
0000243c.00000478::2021/10/23-08:17:44.658 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: InternalReplyHandler: 0
0000243c.000029bc::2021/10/23-08:17:44.658 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Updating status after a DNS registration
0000243c.000029bc::2021/10/23-08:17:44.658 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Last Dns Update time changed
000010a8.00002728::2021/10/23-08:17:44.658 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:534 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:17:44.658 INFO  [GUM] Node 1: Processing RequestLock 1:321
000010a8.000011f0::2021/10/23-08:17:44.696 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:136 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:17:44.696 INFO  [GUM] Node 1: Processing GrantLock to 1 (sent by 2 gumid: 25766)
000010a8.00002728::2021/10/23-08:17:44.696 INFO  [GUM] Node 1: executing request locally, gumId:25767, my action: /dm/update, # of updates: 1
000010a8.00002728::2021/10/23-08:17:44.697 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:535 from node 1. Action: gum/do-update, Target: GUMA
0000243c.000029bc::2021/10/23-08:17:44.738 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.00000478::2021/10/23-08:17:44.738 INFO  [RES] Network Name <mydb1_mydb1>: Client: Synching with slow operation
0000243c.000029bc::2021/10/23-08:17:44.775 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet]                  DNS Suffix:
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000029bc::2021/10/23-08:17:44.775 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000029bc::2021/10/23-08:17:44.775 DBG   [ClNet]                  DNS Suffix:
0000243c.000029bc::2021/10/23-08:17:44.775 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000029bc::2021/10/23-08:17:44.776 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000029bc::2021/10/23-08:17:44.776 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000029bc::2021/10/23-08:17:44.776 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000029bc::2021/10/23-08:17:44.776 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.163 Prefix: 10.16.1.163/24 (Actual address: 10.16.1.163), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000029bc::2021/10/23-08:17:44.776 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.163 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.163 Prefix: 10.30.0.163/24)
0000243c.000029bc::2021/10/23-08:17:44.776 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000029bc::2021/10/23-08:17:44.776 INFO  [RES] Network Name <mydb1_mydb1>: Client: Final alias is 10.16.1.163
0000243c.000029bc::2021/10/23-08:17:44.776 INFO  [RES] Network Name <mydb1_mydb1>: Client: RegisterFqdnWithLsa - Found FQDN mydb1.domain.local that is already registered with LSA
0000243c.000029bc::2021/10/23-08:17:44.776 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: InternalReplyHandler: 0
00000054.0000074c::2021/10/23-08:17:45.886 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] The connection was established successfully
00000054.0000074c::2021/10/23-08:17:45.914 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Current SQL Instance is not part of Failover clustering
00000054.0000074c::2021/10/23-08:17:45.914 INFO  [RES] SQL Server Availability Group: [hadrag] Starting Health Worker Thread
00000054.0000235c::2021/10/23-08:17:45.956 INFO  [RES] SQL Server Availability Group: [hadrag] XEvent session MSSQLSERVER is created with RolloverCount 10, MaxFileSizeInMBytes 100, and LogPath 'D:\MSSQL15.MSSQLSERVER\MSSQL\LOG\'
00000054.0000235c::2021/10/23-08:17:45.956 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event logging is started
00000054.0000235c::2021/10/23-08:17:45.956 INFO  [RES] SQL Server Availability Group: [hadrag] Health worker started for instance db-node-primary
00000054.0000235c::2021/10/23-08:17:45.956 INFO  [RES] SQL Server Availability Group: [hadrag] Connect to SQL Server ...
00000054.0000235c::2021/10/23-08:17:46.300 INFO  [RES] SQL Server Availability Group: [hadrag] The connection was established successfully
00000054.0000235c::2021/10/23-08:17:46.525 INFO  [RES] SQL Server Availability Group: [hadrag] Diagnostics is started
00000054.00001d04::2021/10/23-08:17:46.525 INFO  [RES] SQL Server Availability Group: [hadrag] Change diagnostics interval worker is started
00000054.0000235c::2021/10/23-08:17:46.525 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'system' health state has been changed from '' to 'clean' at 2021-10-23 03:17:46.450
00000054.0000235c::2021/10/23-08:17:46.565 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'resource' health state has been changed from '' to 'clean' at 2021-10-23 03:17:46.450
00000054.0000235c::2021/10/23-08:17:46.652 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from '' to 'clean' at 2021-10-23 03:17:46.450
00000054.0000235c::2021/10/23-08:17:46.652 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'io_subsystem' health state has been changed from '' to 'clean' at 2021-10-23 03:17:46.450
00000054.0000235c::2021/10/23-08:17:49.203 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'events' health state has been changed from '' to 'unknown' at 2021-10-23 03:17:46.450
00000054.0000235c::2021/10/23-08:17:56.568 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 03:17:56.473
000010a8.00002a74::2021/10/23-08:18:01.261 INFO  [GUM] Node 1: executing request locally, gumId:25768, my action: /dm/update, # of updates: 1
000010a8.00002a74::2021/10/23-08:18:01.261 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:536 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002a74::2021/10/23-08:18:01.501 INFO  [GUM] Node 1: executing request locally, gumId:25769, my action: /dm/update, # of updates: 1
000010a8.00002a74::2021/10/23-08:18:01.502 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:537 from node 1. Action: gum/do-update, Target: GUMA
00000054.0000074c::2021/10/23-08:18:01.904 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Disconnect from SQL Server
00000054.0000074c::2021/10/23-08:18:01.904 INFO  [RHS] Resource mydb1 has come online. RHS is about to report status change to RCM
000010a8.00002498::2021/10/23-08:18:01.904 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb1', gen(3) result 0/0.
000010a8.00002498::2021/10/23-08:18:01.904 INFO  [RCM] Res mydb1: OnlinePending -> Online( StateUnknown )
000010a8.00002498::2021/10/23-08:18:01.904 INFO  [RCM] TransitionToState(mydb1) OnlinePending-->Online.
000010a8.00002498::2021/10/23-08:18:01.904 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb1, Pending --> Online)
000010a8.00002a74::2021/10/23-08:18:01.904 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:538 from node 1. Action: causal, Target: CAUS
000010a8.00002498::2021/10/23-08:18:01.904 INFO  [RCM] rcm::RcmGroup::ProcessStateChange: [RCM] Group move for 'mydb1' has completed.
000010a8.00002498::2021/10/23-08:18:01.904 INFO  [RCM] rcm::RcmGroup::ProcessStateChange: [RCM] DrainMgr: Not Sending message to Src node for group mydb1 after successful online
000010a8.00002a74::2021/10/23-08:18:01.905 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:539 from node 1. Action: causal, Target: CAUS
000010a8.00002a74::2021/10/23-08:18:02.635 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb1, 1)
000010a8.00002a74::2021/10/23-08:18:02.635 INFO  [GUM] Node 1: executing request locally, gumId:25770, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00002a74::2021/10/23-08:18:02.635 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb1,1)
000010a8.00002a74::2021/10/23-08:18:02.635 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5010)' because of 'The specified node is already a possible owner.'
000010a8.00002a74::2021/10/23-08:18:02.635 WARN  [DM] Aborting group transaction 85:85:32567+1
000010a8.00002a74::2021/10/23-08:18:02.635 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'Gum handler completed as failed'
000010a8.0000199c::2021/10/23-08:18:02.660 INFO  [RCM] rcm::RcmApi::RemovePossibleOwner: (mydb1, 2)
000010a8.0000199c::2021/10/23-08:18:02.660 INFO  [GUM] Node 1: executing request locally, gumId:25770, my action: /rcm/gum/RemovePossibleOwner, # of updates: 1
000010a8.0000199c::2021/10/23-08:18:02.660 INFO  [RCM] rcm::RcmGum::RemovePossibleOwner(mydb1,2)
000010a8.0000199c::2021/10/23-08:18:02.660 INFO  [RCM] Removing node 2 from resource 'mydb1'.
000010a8.0000199c::2021/10/23-08:18:02.661 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:540 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:18:02.715 INFO  [GUM] Node 1: executing request locally, gumId:25771, my action: /rcm/gum/SetGroupPreferredOwners, # of updates: 1
000010a8.0000199c::2021/10/23-08:18:02.715 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb1,<vector len='1'>
000010a8.0000199c::2021/10/23-08:18:02.715 INFO      <item>1</item>
000010a8.0000199c::2021/10/23-08:18:02.715 INFO  </vector>
000010a8.0000199c::2021/10/23-08:18:02.715 INFO  )
000010a8.0000199c::2021/10/23-08:18:02.715 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:541 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:18:02.796 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb1, 2)
000010a8.00000560::2021/10/23-08:18:02.796 INFO  [GUM] Node 1: executing request locally, gumId:25772, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00000560::2021/10/23-08:18:02.796 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb1,2)
000010a8.00000560::2021/10/23-08:18:02.796 INFO  [RCM] Adding node 2 to resource 'mydb1'.
000010a8.00000560::2021/10/23-08:18:02.797 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:542 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:18:02.839 INFO  [GUM] Node 1: executing request locally, gumId:25773, my action: /rcm/gum/SetGroupPreferredOwners, # of updates: 1
000010a8.00000560::2021/10/23-08:18:02.839 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb1,<vector len='2'>
000010a8.00000560::2021/10/23-08:18:02.839 INFO      <item>1</item>
000010a8.00000560::2021/10/23-08:18:02.839 INFO      <item>2</item>
000010a8.00000560::2021/10/23-08:18:02.839 INFO  </vector>
000010a8.00000560::2021/10/23-08:18:02.839 INFO  )
000010a8.00000560::2021/10/23-08:18:02.840 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:543 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002a74::2021/10/23-08:18:06.299 INFO  [GUM] Node 1: executing request locally, gumId:25774, my action: /dm/update, # of updates: 1
000010a8.00002a74::2021/10/23-08:18:06.299 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:544 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002a74::2021/10/23-08:18:06.453 INFO  [GUM] Node 1: executing request locally, gumId:25775, my action: /dm/update, # of updates: 1
000010a8.00002a74::2021/10/23-08:18:06.454 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:545 from node 1. Action: gum/do-update, Target: GUMA
00000054.0000235c::2021/10/23-08:18:06.495 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 03:18:06.470
000010a8.00002a74::2021/10/23-08:18:10.399 INFO  [GUM] Node 1: executing request locally, gumId:25776, my action: /dm/update, # of updates: 1
000010a8.00002a74::2021/10/23-08:18:10.399 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:546 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:18:10.483 INFO  [GUM] Node 1: executing request locally, gumId:25777, my action: /dm/update, # of updates: 1
000010a8.0000199c::2021/10/23-08:18:10.484 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:547 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000011f0::2021/10/23-08:18:10.540 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:137 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:18:10.540 INFO  [GUM] Node 1: Processing RequestLock 2:44
000010a8.000011f0::2021/10/23-08:18:10.540 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:548 from node 1. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:18:10.540 INFO  [GUM] Node 1: Processing GrantLock to 2 (sent by 1 gumid: 25777)
000010a8.000011f0::2021/10/23-08:18:10.579 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:138 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00002498::2021/10/23-08:18:10.579 INFO  [GUM] Node 1: Executing locally gumId: 25778, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:18:10.629 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:139 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00002498::2021/10/23-08:18:10.629 INFO  [GUM] Node 1: Executing locally gumId: 25779, updates: 1, first action: /dm/update
000010a8.0000199c::2021/10/23-08:18:10.660 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:549 from node 1. Action: causal, Target: CAUS
000010a8.0000199c::2021/10/23-08:18:10.660 INFO  [GUM] Node 1: Processing RequestLock 1:333
000010a8.000011f0::2021/10/23-08:18:10.698 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:140 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:18:10.698 INFO  [GUM] Node 1: Processing GrantLock to 1 (sent by 2 gumid: 25779)
000010a8.0000199c::2021/10/23-08:18:10.698 INFO  [GUM] Node 1: executing request locally, gumId:25780, my action: /dm/update, # of updates: 2
000010a8.0000199c::2021/10/23-08:18:10.700 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:550 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002a74::2021/10/23-08:18:10.747 INFO  [GUM] Node 1: executing request locally, gumId:25781, my action: /dm/update, # of updates: 1
000010a8.00002a74::2021/10/23-08:18:10.748 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:551 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:18:10.790 INFO  [GUM] Node 1: executing request locally, gumId:25782, my action: /dm/update, # of updates: 1
000010a8.0000199c::2021/10/23-08:18:10.791 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:552 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:18:10.832 INFO  [GUM] Node 1: executing request locally, gumId:25783, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:18:10.833 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:553 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000011f0::2021/10/23-08:18:10.874 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:141 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:18:10.874 INFO  [GUM] Node 1: Processing RequestLock 2:46
000010a8.00000560::2021/10/23-08:18:10.874 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:554 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:18:10.874 INFO  [GUM] Node 1: Processing GrantLock to 2 (sent by 1 gumid: 25783)
000010a8.00000560::2021/10/23-08:18:10.879 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:555 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:18:10.879 INFO  [GUM] Node 1: Processing RequestLock 1:337
000010a8.000011f0::2021/10/23-08:18:10.913 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:142 from node 2. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:18:10.913 INFO  [GUM] Node 1: Executing locally gumId: 25784, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:18:10.954 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:143 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:18:10.954 INFO  [GUM] Node 1: Processing GrantLock to 1 (sent by 2 gumid: 25784)
000010a8.00000560::2021/10/23-08:18:10.954 INFO  [GUM] Node 1: executing request locally, gumId:25785, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:18:10.954 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:556 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:18:11.097 INFO  [GUM] Node 1: executing request locally, gumId:25786, my action: /dm/update, # of updates: 1
000010a8.0000199c::2021/10/23-08:18:11.099 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:557 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002498::2021/10/23-08:18:11.140 INFO  [GUM] Node 1: executing request locally, gumId:25787, my action: /dm/update, # of updates: 1
000010a8.00002498::2021/10/23-08:18:11.141 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:558 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000011f0::2021/10/23-08:18:11.161 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:144 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:18:11.161 INFO  [GUM] Node 1: Processing RequestLock 2:47
000010a8.00002498::2021/10/23-08:18:11.183 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:559 from node 1. Action: causal, Target: CAUS
000010a8.00002498::2021/10/23-08:18:11.183 INFO  [GUM] Node 1: Processing GrantLock to 2 (sent by 1 gumid: 25787)
000010a8.000011f0::2021/10/23-08:18:11.222 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:145 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00002498::2021/10/23-08:18:11.222 INFO  [GUM] Node 1: Executing locally gumId: 25788, updates: 1, first action: /dm/update
000010a8.00000560::2021/10/23-08:18:11.225 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:560 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:18:11.225 INFO  [GUM] Node 1: Processing RequestLock 1:340
000010a8.000011f0::2021/10/23-08:18:11.263 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:146 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:18:11.263 INFO  [GUM] Node 1: Processing GrantLock to 1 (sent by 2 gumid: 25788)
000010a8.00000560::2021/10/23-08:18:11.263 INFO  [GUM] Node 1: executing request locally, gumId:25789, my action: /dm/update, # of updates: 1
000010a8.00000560::2021/10/23-08:18:11.264 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:561 from node 1. Action: gum/do-update, Target: GUMA
000010a8.000011f0::2021/10/23-08:18:11.268 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:147 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:18:11.268 INFO  [GUM] Node 1: Processing RequestLock 2:48
000010a8.00000560::2021/10/23-08:18:11.305 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:562 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:18:11.305 INFO  [GUM] Node 1: Processing GrantLock to 2 (sent by 1 gumid: 25789)
000010a8.000011f0::2021/10/23-08:18:11.344 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:148 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:18:11.344 INFO  [GUM] Node 1: Executing locally gumId: 25790, updates: 1, first action: /dm/update
0000023c.00002acc::2021/10/23-08:18:42.822 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.000029a8::2021/10/23-08:19:01.914 WARN  [RHS] Resource mydb1 is alive!
000010a8.00002a74::2021/10/23-08:19:26.860 INFO  [RCM] rcm::RcmApi::OnlineResource: (mydb3, 0)
000010a8.00002a74::2021/10/23-08:19:26.907 ERR   [RCM] rcm::RcmApi::OnlineResource: (5023)' because of 'RcmRpcOnlineResource( _rcm, pGroup->GetOwnerNode()->NodeNumber, pRes->ObjectId, PublicFlags, Context )'
000010a8.00002a74::2021/10/23-08:19:31.348 WARN  Unhandled exception on the thread 10868, exception The requested operation is not supported.
0000023c.00000204::2021/10/23-08:19:42.921 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000011f0::2021/10/23-08:19:55.308 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:149 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:55.309 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:150 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:55.309 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:151 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:55.369 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:152 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:55.416 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:153 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:55.416 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:154 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:55.416 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:155 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:55.416 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:156 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:55.417 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:157 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000560::2021/10/23-08:19:55.417 INFO  [GUM] Node 1: Executing locally gumId: 25791, updates: 1, first action: /rcm/gum/GroupMoveOperation
000010a8.00000560::2021/10/23-08:19:55.417 INFO  [RCM] rcm::RcmGum::GroupMoveOperation(1)
000010a8.00000560::2021/10/23-08:19:55.417 INFO  [RCM] move of group mydb3 from db-node-secondary(2) to db-node-primary(1) of type MoveType::Manual is about to succeed, failoverCount=1, lastFailoverTime=2021/10/23-03:16:45.280 targeted=true
000010a8.00002498::2021/10/23-08:19:55.417 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:563 from node 1. Action: causal, Target: CAUS
000010a8.00002498::2021/10/23-08:19:55.417 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:564 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:19:55.417 INFO  [RCM] rcm::RcmGroup::NodeIsPossibleOwner: Group mydb3: Node:1 IsPossibleOwner:true
000010a8.00000560::2021/10/23-08:19:55.417 INFO  [RCM] mydb3: Added Flags 16 to StatusInformation. New StatusInformation 16
000010a8.00000560::2021/10/23-08:19:55.417 INFO  [RCM] Handing group mydb3 over to the priority manager for bringing
000010a8.00002498::2021/10/23-08:19:55.417 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:565 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:19:55.417 INFO  MTimer(OneGroupMovetimer): [Total: 0 ms ( 0 s )]
000010a8.00000560::2021/10/23-08:19:55.417 INFO  [RCM] processed 1 group moves, 0 failures
000010a8.00000560::2021/10/23-08:19:55.417 INFO  [DM] An empty single transaction is cancelled 85:85:32588+1::0
000010a8.00002498::2021/10/23-08:19:55.418 INFO  [RCM] moved 1 tasks from staging set to task set.  TaskSetSize=1
000010a8.00002498::2021/10/23-08:19:55.418 INFO  [RCM] beginning task set inspection. Blockcontext priority=2000 gname=mydb3
000010a8.00002498::2021/10/23-08:19:55.418 INFO  [RCM] rcm::RcmPriorityManager::StartGroups: [RCM] done, executed 1 tasks
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] mydb3: Removed Flags 16 from StatusInformation. New StatusInformation 0
000010a8.00000560::2021/10/23-08:19:55.418 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:566 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] rcm::RcmResource::Online: bringing mydb3's provider resource 'mydb3_mydb3' online.
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] rcm::RcmResource::Online: bringing mydb3's provider resource 'mydb3_10.16.1.165' online.
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] rcm::RcmResource::Online: bringing mydb3's provider resource 'mydb3_10.30.0.165' online.
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] Res mydb3_10.30.0.165: Offline -> OnlineCallIssued( StateUnknown )
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) Offline-->OnlineCallIssued.
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, BringingToPersistentState --> Pending)
000010a8.0000199c::2021/10/23-08:19:55.418 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:567 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] Res mydb3_10.16.1.165: Offline -> OnlineCallIssued( StateUnknown )
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) Offline-->OnlineCallIssued.
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] Res mydb3_mydb3: Offline -> WaitingToComeOnline( StateUnknown )
000010a8.00002728::2021/10/23-08:19:55.418 INFO  [RCM] TransitionToState(mydb3_mydb3) Offline-->WaitingToComeOnline.
000010a8.0000199c::2021/10/23-08:19:55.418 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:568 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:19:55.419 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002728::2021/10/23-08:19:55.419 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002728::2021/10/23-08:19:55.419 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002728::2021/10/23-08:19:55.419 INFO  [RCM] Res mydb3: Offline -> WaitingToComeOnline( StateUnknown )
000010a8.00002728::2021/10/23-08:19:55.419 INFO  [RCM] TransitionToState(mydb3) Offline-->WaitingToComeOnline.
000010a8.00002728::2021/10/23-08:19:55.419 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002728::2021/10/23-08:19:55.419 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00000560::2021/10/23-08:19:55.419 INFO  [RCM] Issuing Online(mydb3_10.30.0.165) to RHS.
000010a8.00002498::2021/10/23-08:19:55.419 INFO  [RCM] Issuing Online(mydb3_10.16.1.165) to RHS.
0000023c.00000204::2021/10/23-08:19:55.420 INFO  [RES] IP Address <mydb3_10.30.0.165>: Bringing resource online...
000010a8.00002498::2021/10/23-08:19:55.420 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3_10.30.0.165', gen(3) result 997/0.
0000023c.00002acc::2021/10/23-08:19:55.420 INFO  [RES] IP Address <mydb3_10.16.1.165>: Bringing resource online...
000010a8.00002498::2021/10/23-08:19:55.420 INFO  [RCM] Res mydb3_10.30.0.165: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00002498::2021/10/23-08:19:55.420 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) OnlineCallIssued-->OnlinePending.
000010a8.00002498::2021/10/23-08:19:55.420 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3_10.16.1.165', gen(0) result 997/0.
000010a8.00002498::2021/10/23-08:19:55.420 INFO  [RCM] Res mydb3_10.16.1.165: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00002498::2021/10/23-08:19:55.420 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) OnlineCallIssued-->OnlinePending.
0000023c.00002860::2021/10/23-08:19:55.420 INFO  [RES] IP Address <mydb3_10.30.0.165>: Online thread running.
0000023c.00001ed0::2021/10/23-08:19:55.420 INFO  [RES] IP Address <mydb3_10.16.1.165>: Online thread running.
0000023c.00001ed0::2021/10/23-08:19:55.421 INFO  [RES] IP Address <mydb3_10.16.1.165>: Deleting IP address 10.16.1.165.
0000023c.00001ed0::2021/10/23-08:19:55.421 WARN  [RES] IP Address <mydb3_10.16.1.165>: Failed to delete IP address 10.16.1.165, status 87.
0000023c.00001ed0::2021/10/23-08:19:55.421 INFO  [RES] IP Address <mydb3_10.16.1.165>: could not delete IP address 10.16.1.165, probably it is no longer valid.
0000023c.00002860::2021/10/23-08:19:55.423 INFO  [RES] IP Address <mydb3_10.30.0.165>: Checking for network match: IP address mask 255.255.255.0, network mask 255.255.255.0 and IP address 10.30.0.165, network address 10.30.0.0, role 3.
0000023c.00001ed0::2021/10/23-08:19:55.424 INFO  [RES] IP Address <mydb3_10.16.1.165>: Checking for network match: IP address mask 255.255.255.0, network mask 255.255.255.0 and IP address 10.16.1.165, network address 10.30.0.0, role 3.
0000023c.00001ed0::2021/10/23-08:19:55.425 INFO  [RES] IP Address <mydb3_10.16.1.165>: Checking for network match: IP address mask 255.255.255.0, network mask 255.255.255.0 and IP address 10.16.1.165, network address 10.16.1.0, role 3.
0000023c.00002860::2021/10/23-08:19:55.425 ERR   [RES] IP Address <mydb3_10.30.0.165>: Open: Unable to find netinterface for node 1 on network 21dd22f5-ec20-4f7b-95e9-bce2630ae612, status 5035.
0000023c.00002860::2021/10/23-08:19:55.425 WARN  [RHS] Resource mydb3_10.30.0.165 has indicated that it cannot come online on this node.
000010a8.00002728::2021/10/23-08:19:55.425 WARN  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3_10.30.0.165', gen(3) result 5015/0.
000010a8.00002728::2021/10/23-08:19:55.425 INFO  [RCM] Res mydb3_10.30.0.165: OnlinePending -> ProcessingFailure( CannotComeOnlineOnThisNode )
000010a8.00002728::2021/10/23-08:19:55.425 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) OnlinePending-->[ProcessingFailure to CannotComeOnlineOnThisNode].
000010a8.00000560::2021/10/23-08:19:55.425 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:569 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:19:55.425 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb3_10.30.0.165)
000010a8.00002728::2021/10/23-08:19:55.425 INFO  [RCM] IP address resource 'mydb3_10.30.0.165' cannot come online on this node right now, but not raising any failure events
000010a8.00002728::2021/10/23-08:19:55.425 INFO  [RCM] resource mydb3_10.30.0.165: failure count: 1, restartAction: 2 persistentState: 1.
000010a8.00002728::2021/10/23-08:19:55.425 INFO  [RCM] Since no top level resource will be offlined by this resource's failure, resetting restartAction to 1
000010a8.00002728::2021/10/23-08:19:55.425 INFO  [RCM] Res mydb3_10.30.0.165: [ProcessingFailure to CannotComeOnlineOnThisNode] -> WaitingToTerminate( CannotComeOnlineOnThisNode )
000010a8.00002728::2021/10/23-08:19:55.425 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) [ProcessingFailure to CannotComeOnlineOnThisNode]-->[WaitingToTerminate to CannotComeOnlineOnThisNode].
000010a8.00002728::2021/10/23-08:19:55.425 INFO  [RCM] Res mydb3_10.30.0.165: [WaitingToTerminate to CannotComeOnlineOnThisNode] -> Terminating( CannotComeOnlineOnThisNode )
000010a8.00002728::2021/10/23-08:19:55.425 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) [WaitingToTerminate to CannotComeOnlineOnThisNode]-->[Terminating to CannotComeOnlineOnThisNode].
000010a8.00000560::2021/10/23-08:19:55.425 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00000560::2021/10/23-08:19:55.425 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00000560::2021/10/23-08:19:55.425 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource b6741d13-b17c-40b3-9f00-284de4b58a02.
000010a8.00000560::2021/10/23-08:19:55.425 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource b6741d13-b17c-40b3-9f00-284de4b58a02.
000010a8.0000199c::2021/10/23-08:19:55.426 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:570 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:19:55.426 WARN  [RCM] resource 'mydb3_10.30.0.165' has exceeded its restart limit.
000010a8.00002728::2021/10/23-08:19:55.426 INFO  [RCM] Will retry online from long delay restart of mydb3_10.30.0.165 in 600000 milliseconds.
0000023c.00002acc::2021/10/23-08:19:55.426 INFO  [RES] IP Address <mydb3_10.30.0.165>: Terminating resource...
0000023c.00002acc::2021/10/23-08:19:55.426 INFO  [RES] IP Address <mydb3_10.30.0.165>: Address 10.30.0.165 on adapter [Unknown] offline.
000010a8.00002728::2021/10/23-08:19:55.426 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb3_10.30.0.165', gen(4) result 0/0.
000010a8.00002498::2021/10/23-08:19:55.426 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:55.426 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:55.426 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:55.426 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:55.426 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:55.426 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:55.426 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:55.426 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002728::2021/10/23-08:19:55.426 INFO  [RCM] Res mydb3_10.30.0.165: [Terminating to CannotComeOnlineOnThisNode] -> CannotComeOnlineOnThisNode( StateUnknown )
000010a8.00002728::2021/10/23-08:19:55.426 INFO  [RCM] TransitionToState(mydb3_10.30.0.165) [Terminating to CannotComeOnlineOnThisNode]-->CannotComeOnlineOnThisNode.
000010a8.00002498::2021/10/23-08:19:55.426 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:571 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:19:55.426 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00000560::2021/10/23-08:19:55.426 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00000560::2021/10/23-08:19:55.427 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00000560::2021/10/23-08:19:55.427 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00000560::2021/10/23-08:19:55.427 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00000560::2021/10/23-08:19:55.427 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00000560::2021/10/23-08:19:55.427 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00000560::2021/10/23-08:19:55.427 INFO  [RCM-rbtr] giving default token to group mydb3
0000023c.00001ed0::2021/10/23-08:19:55.428 INFO  [RES] IP Address <mydb3_10.16.1.165>: Online: Opened object handle for netinterface 0f1179de-8e47-40fc-931d-935472342602.
0000023c.00001ed0::2021/10/23-08:19:55.428 INFO  [RES] IP Address <mydb3_10.16.1.165>: Online: Registered notification for netinterface 0f1179de-8e47-40fc-931d-935472342602.
0000023c.00001ed0::2021/10/23-08:19:55.435 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000023c.00001ed0::2021/10/23-08:19:55.435 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000023c.00001ed0::2021/10/23-08:19:55.435 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000023c.00001ed0::2021/10/23-08:19:55.435 DBG   [ClNet]                  ConnectoidName: Ethernet
0000023c.00001ed0::2021/10/23-08:19:55.435 DBG   [ClNet]                  Netbios/TCP:    0
0000023c.00001ed0::2021/10/23-08:19:55.435 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000023c.00001ed0::2021/10/23-08:19:55.435 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000023c.00001ed0::2021/10/23-08:19:55.435 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000023c.00001ed0::2021/10/23-08:19:55.435 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000023c.00001ed0::2021/10/23-08:19:55.435 DBG   [ClNet]                  Netbios/TCP:    1
0000023c.00001ed0::2021/10/23-08:19:55.435 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000023c.00001ed0::2021/10/23-08:19:55.435 INFO  [RES] IP Address <mydb3_10.16.1.165>: NetBIOS is disabled for the resource. Deleting NBT value from the cluster database.
0000023c.00001ed0::2021/10/23-08:19:55.435 INFO  [RES] IP Address <mydb3_10.16.1.165>: Successfully deleted NBT interface information from database, status 0.
0000023c.00001ed0::2021/10/23-08:19:55.435 INFO  [RES] IP Address <mydb3_10.16.1.165>: Did not write IP interface information to database as it is already present.
0000023c.00001ed0::2021/10/23-08:19:55.435 INFO  [RES] IP Address <mydb3_10.16.1.165>: Created IP interface A50110AC.
000010a8.00000560::2021/10/23-08:19:55.436 DBG   [NETFTAPI] received NsiAddInstance for 10.16.1.165
000010a8.00002a74::2021/10/23-08:19:56.371 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb3, 2)
000010a8.00002a74::2021/10/23-08:19:56.371 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:572 from node 1. Action: causal, Target: CAUS
000010a8.00002a74::2021/10/23-08:19:56.371 INFO  [GUM] Node 1: Processing RequestLock 1:341
000010a8.000011f0::2021/10/23-08:19:56.410 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:158 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:56.410 INFO  [GUM] Node 1: Processing GrantLock to 1 (sent by 2 gumid: 25791)
000010a8.00002a74::2021/10/23-08:19:56.410 INFO  [GUM] Node 1: executing request locally, gumId:25792, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00002a74::2021/10/23-08:19:56.410 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb3,2)
000010a8.00002a74::2021/10/23-08:19:56.410 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5908)' because of 'Group is currently moving.'
000010a8.00002a74::2021/10/23-08:19:56.410 WARN  [DM] Aborting group transaction 85:85:32588+1
000010a8.00002a74::2021/10/23-08:19:56.410 WARN  [RCM] rcm::RcmApi::AddPossibleOwner: forwarded, no retry on error 5908
000010a8.00002a74::2021/10/23-08:19:57.466 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb3, 2)
000010a8.00002a74::2021/10/23-08:19:57.466 INFO  [GUM] Node 1: executing request locally, gumId:25792, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00002a74::2021/10/23-08:19:57.466 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb3,2)
000010a8.00002a74::2021/10/23-08:19:57.466 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5908)' because of 'Group is currently moving.'
000010a8.00002a74::2021/10/23-08:19:57.466 WARN  [DM] Aborting group transaction 85:85:32588+1
000010a8.00002a74::2021/10/23-08:19:57.466 WARN  [RCM] rcm::RcmApi::AddPossibleOwner: forwarded, no retry on error 5908
000010a8.00002a74::2021/10/23-08:19:58.514 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb3, 2)
000010a8.00002a74::2021/10/23-08:19:58.514 INFO  [GUM] Node 1: executing request locally, gumId:25792, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00002a74::2021/10/23-08:19:58.514 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb3,2)
000010a8.00002a74::2021/10/23-08:19:58.514 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5908)' because of 'Group is currently moving.'
000010a8.00002a74::2021/10/23-08:19:58.514 WARN  [DM] Aborting group transaction 85:85:32588+1
000010a8.00002a74::2021/10/23-08:19:58.514 WARN  [RCM] rcm::RcmApi::AddPossibleOwner: forwarded, no retry on error 5908
000010a8.00002a74::2021/10/23-08:19:58.916 DBG   [NETFTAPI] received NsiParameterNotification for 10.16.1.165 (IpDadStatePreferred)
000010a8.00002a74::2021/10/23-08:19:58.916 DBG   [NETFTAPI] Signaled NetftLocalAdd event for 10.16.1.165
000010a8.00002a74::2021/10/23-08:19:58.916 DBG   [NETFTAPI] Signaled NetftLocalConnect event for 10.16.1.165
000010a8.0000174c::2021/10/23-08:19:58.916 INFO  [IM] got event: Local endpoint 10.16.1.165:~0~ connected
0000023c.00001ed0::2021/10/23-08:19:59.100 INFO  [RES] IP Address <mydb3_10.16.1.165>: IpaOnlineThread: ProbePort property is not set.
0000023c.00001ed0::2021/10/23-08:19:59.100 INFO  [RHS] Resource mydb3_10.16.1.165 has come online. RHS is about to report status change to RCM
000010a8.00002a74::2021/10/23-08:19:59.100 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3_10.16.1.165', gen(0) result 0/0.
000010a8.00002a74::2021/10/23-08:19:59.100 INFO  [RCM] Res mydb3_10.16.1.165: OnlinePending -> Online( StateUnknown )
000010a8.00002a74::2021/10/23-08:19:59.100 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) OnlinePending-->Online.
0000023c.00001ed0::2021/10/23-08:19:59.100 INFO  [RES] IP Address <mydb3_10.16.1.165>: IP Address 10.16.1.165 on adapter vmxnet3 Ethernet Adapter online
000010a8.00000560::2021/10/23-08:19:59.100 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:573 from node 1. Action: causal, Target: CAUS
000010a8.00002498::2021/10/23-08:19:59.100 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:59.100 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:59.100 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:59.100 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:59.100 INFO  [RCM] Res mydb3_mydb3: WaitingToComeOnline -> OnlineCallIssued( StateUnknown )
000010a8.00002498::2021/10/23-08:19:59.100 INFO  [RCM] TransitionToState(mydb3_mydb3) WaitingToComeOnline-->OnlineCallIssued.
000010a8.00002728::2021/10/23-08:19:59.100 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:574 from node 1. Action: causal, Target: CAUS
000010a8.00002498::2021/10/23-08:19:59.100 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002498::2021/10/23-08:19:59.100 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002a74::2021/10/23-08:19:59.101 INFO  [RCM] Issuing Online(mydb3_mydb3) to RHS.
0000243c.00000a98::2021/10/23-08:19:59.101 INFO  [RES] Network Name <mydb3_mydb3>: Online called for resource mydb3_mydb3
000010a8.00002728::2021/10/23-08:19:59.101 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3_mydb3', gen(0) result 997/0.
000010a8.00002728::2021/10/23-08:19:59.101 INFO  [RCM] Res mydb3_mydb3: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00002728::2021/10/23-08:19:59.101 INFO  [RCM] TransitionToState(mydb3_mydb3) OnlineCallIssued-->OnlinePending.
0000243c.000026fc::2021/10/23-08:19:59.101 INFO  [RES] Network Name <mydb3_mydb3>: Entering Online thread
0000243c.000026fc::2021/10/23-08:19:59.101 INFO  [RES] Network Name <mydb3_mydb3>: Initializing config info
0000243c.000026fc::2021/10/23-08:19:59.104 INFO  [RES] Network Name: Agent: Initializing (df59581d-6cb0-41d3-a597-dbce46545dcd,Identity)
0000243c.000026fc::2021/10/23-08:19:59.104 INFO  [RES] Network Name <mydb3_mydb3>: Performing actual online of resource.
0000243c.00000a98::2021/10/23-08:19:59.104 INFO  [RES] Network Name: Agent: OnInitialize (df59581d-6cb0-41d3-a597-dbce46545dcd,Identity)
0000243c.00000a98::2021/10/23-08:19:59.105 INFO  [RES] Network Name: Agent: InitializeModule, Trying to initialize Module(df59581d-6cb0-41d3-a597-dbce46545dcd,Identity) when there is one already in Initialized/Idle state
0000243c.00000a98::2021/10/23-08:19:59.105 INFO  [RES] Network Name <mydb3_mydb3>: ReplyHandler Identity, result: 183
0000243c.000026fc::2021/10/23-08:19:59.105 INFO  [RES] Network Name <mydb3_mydb3>: InitializeADAware - ADAware value is 1
0000243c.000026fc::2021/10/23-08:19:59.106 INFO  [RES] Network Name <mydb3_mydb3>: Obtaining IP info for resource mydb3_10.16.1.165
0000243c.000026fc::2021/10/23-08:19:59.108 INFO  [RES] Network Name <mydb3_mydb3>: Using provider mydb3_10.16.1.165, ip address 10.16.1.165, mask 255.255.255.0, prefix length 24
0000243c.000026fc::2021/10/23-08:19:59.108 INFO  [RES] Network Name <mydb3_mydb3>: Obtaining IP info for resource mydb3_10.30.0.165
0000243c.000026fc::2021/10/23-08:19:59.109 INFO  [RES] Network Name <mydb3_mydb3>: Using provider mydb3_10.30.0.165, ip address 10.30.0.165, mask 255.255.255.0, prefix length 24
0000243c.000026fc::2021/10/23-08:19:59.109 INFO  [RES] Network Name <mydb3_mydb3>: Resource has 2 IPs
0000243c.000026fc::2021/10/23-08:19:59.110 INFO  [RES] Network Name <mydb3_mydb3>: IP: Type Ipv4, Address 10.16.1.165:~0~, Prefix 10.16.1.165/24, Online true, Transport
0000243c.000026fc::2021/10/23-08:19:59.110 INFO  [RES] Network Name <mydb3_mydb3>: IP: Type Ipv4, Address 10.30.0.165:~0~, Prefix 10.30.0.165/24, Online false, Transport
0000243c.000026fc::2021/10/23-08:19:59.110 INFO  [RES] Network Name: Agent: Initializing (df59581d-6cb0-41d3-a597-dbce46545dcd,Configuration)
0000243c.00000a98::2021/10/23-08:19:59.110 INFO  [RES] Network Name: Agent: OnInitialize (df59581d-6cb0-41d3-a597-dbce46545dcd,Configuration)
0000243c.00000a98::2021/10/23-08:19:59.110 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Offline
0000243c.00000a98::2021/10/23-08:19:59.110 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:df59581d-6cb0-41d3-a597-dbce46545dcd:Configuration
0000243c.00000a98::2021/10/23-08:19:59.111 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Waiting for ongoing slow strand to complete (if any)
0000243c.00000a98::2021/10/23-08:19:59.111 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Signaling main strand to initialize module
0000243c.00000a98::2021/10/23-08:19:59.112 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Calling initialize of the configuration implementation
0000243c.00000a98::2021/10/23-08:19:59.112 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Initializing an AD NetName (type Singleton)...
0000243c.00000a98::2021/10/23-08:19:59.112 INFO  [RES] Network Name: Agent: Initializing (df59581d-6cb0-41d3-a597-dbce46545dcd,Dns)
0000243c.00000a98::2021/10/23-08:19:59.112 INFO  [RES] Network Name: Agent: Initializing (df59581d-6cb0-41d3-a597-dbce46545dcd,Netbios)
0000243c.000029bc::2021/10/23-08:19:59.112 INFO  [RES] Network Name: Agent: OnInitialize (df59581d-6cb0-41d3-a597-dbce46545dcd,Dns)
0000243c.000029bc::2021/10/23-08:19:59.112 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.000029bc::2021/10/23-08:19:59.112 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:df59581d-6cb0-41d3-a597-dbce46545dcd:Dns
0000243c.000029bc::2021/10/23-08:19:59.112 INFO  [RES] Network Name: Agent: OnInitialize (df59581d-6cb0-41d3-a597-dbce46545dcd,Netbios)
0000243c.00000a98::2021/10/23-08:19:59.112 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Waiting for ongoing slow strand to complete (if any)
0000243c.000029bc::2021/10/23-08:19:59.112 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.000029bc::2021/10/23-08:19:59.112 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:df59581d-6cb0-41d3-a597-dbce46545dcd:Netbios
0000243c.000029bc::2021/10/23-08:19:59.112 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Signaling main strand to initialize module
0000243c.00000a98::2021/10/23-08:19:59.112 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: Waiting for ongoing slow strand to complete (if any)
0000243c.00000a98::2021/10/23-08:19:59.112 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: Signaling main strand to initialize module
0000243c.00000a98::2021/10/23-08:19:59.112 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: Initializing Name: mydb3, NetbiosName: mydb3, Type: Singleton
0000243c.000029bc::2021/10/23-08:19:59.112 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Initializing Name: mydb3, NetbiosName: mydb3, Type: Singleton
0000243c.00000db0::2021/10/23-08:19:59.112 INFO  [RES] Network Name: Agent: OnInitializeReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Dns): 0, Prev.State: Alive
0000243c.00000db0::2021/10/23-08:19:59.112 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Initializing NetName (type Singleton, state Initializing) Module Dns, result 0, remaining... 2 (0)
0000243c.00000a98::2021/10/23-08:19:59.112 INFO  [RES] Network Name: [NNLIB] NetbiosServer::SetName - Transport address len 11, address suffix len 24
0000243c.00000db0::2021/10/23-08:19:59.115 INFO  [RES] Network Name: [NNLIB] Registered server name mydb3 on transport \Device\NetbiosSmb, flags 14
0000243c.00000db0::2021/10/23-08:19:59.116 INFO  [RES] Network Name: [NNLIB] Enabled scope for server name mydb3
0000243c.00000db0::2021/10/23-08:19:59.116 INFO  [RES] Network Name: [NNLIB] Redirector Cache Flushed (0)
0000243c.00000db0::2021/10/23-08:19:59.116 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: Registered Name: mydb3 into Netbios (Type: Singleton), result: 0 (0 transports registered)
0000243c.00002994::2021/10/23-08:19:59.116 INFO  [RES] Network Name: Agent: OnInitializeReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Netbios): 0, Prev.State: Alive
0000243c.00002994::2021/10/23-08:19:59.116 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Initializing NetName (type Singleton, state Initializing) Module Netbios, result 0, remaining... 1 (0)
0000243c.00002994::2021/10/23-08:19:59.116 INFO  [RES] Network Name: Agent: Initializing (df59581d-6cb0-41d3-a597-dbce46545dcd,Client)
0000243c.00002994::2021/10/23-08:19:59.116 INFO  [RES] Network Name: Agent: OnInitialize (df59581d-6cb0-41d3-a597-dbce46545dcd,Client)
0000243c.00002994::2021/10/23-08:19:59.116 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.00002994::2021/10/23-08:19:59.116 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:df59581d-6cb0-41d3-a597-dbce46545dcd:Client
0000243c.00002994::2021/10/23-08:19:59.116 INFO  [RES] Network Name <mydb3_mydb3>: Client: Waiting for ongoing slow strand to complete (if any)
0000243c.00002994::2021/10/23-08:19:59.116 INFO  [RES] Network Name <mydb3_mydb3>: Client: Signaling main strand to initialize module
0000243c.00002994::2021/10/23-08:19:59.116 INFO  [RES] Network Name <mydb3_mydb3>: Client: Initializing Name: mydb3, NetbiosName: mydb3, Type: Singleton
0000243c.00002994::2021/10/23-08:19:59.117 INFO  [RES] Network Name: [NNLIB] NetbiosServer::SetName - Transport address len 11, address suffix len 24
0000243c.00002994::2021/10/23-08:19:59.117 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 46, result size 0 (status: 0, subStatus: 0)
0000243c.00002994::2021/10/23-08:19:59.117 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb3, status: 0, subStatus: 0
0000243c.00002994::2021/10/23-08:19:59.118 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 46, result size 0 (status: 0, subStatus: 0)
0000243c.00002994::2021/10/23-08:19:59.118 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb3, status: 0, subStatus: 0
0000243c.00002994::2021/10/23-08:19:59.122 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet]                  DNS Suffix:
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00002994::2021/10/23-08:19:59.122 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00002994::2021/10/23-08:19:59.122 DBG   [ClNet]                  DNS Suffix:
0000243c.00002994::2021/10/23-08:19:59.122 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00002994::2021/10/23-08:19:59.123 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00002994::2021/10/23-08:19:59.123 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00002994::2021/10/23-08:19:59.123 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00002994::2021/10/23-08:19:59.123 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.165 Prefix: 10.16.1.165/24 (Actual address: 10.16.1.165), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00002994::2021/10/23-08:19:59.123 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.165 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.165 Prefix: 10.30.0.165/24)
0000243c.00002994::2021/10/23-08:19:59.123 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00002994::2021/10/23-08:19:59.123 INFO  [RES] Network Name <mydb3_mydb3>: Client: Final alias is 10.16.1.165
0000243c.00002994::2021/10/23-08:19:59.123 INFO  [RES] Network Name: [NNLIB] Adding alias 10.16.1.165 for target mydb3
0000243c.00002994::2021/10/23-08:19:59.125 INFO  [RES] Network Name <mydb3_mydb3>: Client: RegisterFqdnWithLsa - Registering FQDN 'mydb3.domain.local' with LSA
0000243c.00002994::2021/10/23-08:19:59.126 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 72, result size 0 (status: 0, subStatus: 0)
0000243c.00002994::2021/10/23-08:19:59.126 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb3.domain.local, status: 0, subStatus: 0
0000243c.00002994::2021/10/23-08:19:59.135 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 152, result size 0 (status: 0, subStatus: 0)
0000243c.00002994::2021/10/23-08:19:59.135 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 152, result size 0 (status: 0, subStatus: 0)
0000243c.00002994::2021/10/23-08:19:59.135 INFO  [RES] Network Name: [NNLIB] Success on credential operation add on Account mydb3$, status: 0 (subStatus: 0)
0000243c.00002994::2021/10/23-08:19:59.135 INFO  [RES] Network Name <mydb3_mydb3>: Client: Registered Name: mydb3 into LSA (Type: Singleton), result: 0
0000243c.00002994::2021/10/23-08:19:59.136 INFO  [RES] Network Name: Agent: OnInitializeReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Client): 0, Prev.State: Alive
0000243c.00002994::2021/10/23-08:19:59.136 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Initializing NetName (type Singleton, state Initializing) Module Client, result 0, remaining... 0 (0)
0000243c.00002994::2021/10/23-08:19:59.136 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Initialized
0000243c.00000a98::2021/10/23-08:19:59.136 INFO  [RES] Network Name: Agent: OnInitializeReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Configuration): 0, Prev.State: Alive
0000243c.00000a98::2021/10/23-08:19:59.136 INFO  [RES] Network Name <mydb3_mydb3>: SyncReplyHandler Configuration, result: 0
0000243c.00000a98::2021/10/23-08:19:59.136 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.000026fc::2021/10/23-08:19:59.136 INFO  [RES] Network Name <mydb3_mydb3>: PerformOnline - Initialization of Configuration module finished with result: 0
0000243c.00002994::2021/10/23-08:19:59.136 INFO  [RES] Network Name: Agent: Initializing (df59581d-6cb0-41d3-a597-dbce46545dcd,AccountAD)
0000243c.00002994::2021/10/23-08:19:59.136 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Rechecking Dns
0000243c.00000a98::2021/10/23-08:19:59.136 INFO  [RES] Network Name: Agent: OnInitialize (df59581d-6cb0-41d3-a597-dbce46545dcd,AccountAD)
0000243c.00000a98::2021/10/23-08:19:59.136 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.00000a98::2021/10/23-08:19:59.136 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:df59581d-6cb0-41d3-a597-dbce46545dcd:AccountAD
0000243c.00000db0::2021/10/23-08:19:59.136 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Dns - Rechecking config internally
0000243c.00000a98::2021/10/23-08:19:59.136 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: Waiting for ongoing slow strand to complete (if any)
0000243c.00000a98::2021/10/23-08:19:59.136 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: Signaling main strand to initialize module
0000243c.00000a98::2021/10/23-08:19:59.136 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: Initializing Name: mydb3, NetbiosName: mydb3, Type: Singleton, Created: true
0000243c.000026fc::2021/10/23-08:19:59.136 INFO  [RES] Network Name: Agent: Initializing (df59581d-6cb0-41d3-a597-dbce46545dcd,AdminShare)
0000243c.000026fc::2021/10/23-08:19:59.136 INFO  [RHS] Resource mydb3_mydb3 has come online. RHS is about to report status change to RCM
0000243c.00002994::2021/10/23-08:19:59.136 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Sending broadcast credentials to all Identity clones after initialization
000010a8.00002728::2021/10/23-08:19:59.136 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3_mydb3', gen(0) result 0/0.
000010a8.00002728::2021/10/23-08:19:59.136 INFO  [RCM] Res mydb3_mydb3: OnlinePending -> Online( StateUnknown )
000010a8.00002728::2021/10/23-08:19:59.136 INFO  [RCM] TransitionToState(mydb3_mydb3) OnlinePending-->Online.
000010a8.00000560::2021/10/23-08:19:59.136 INFO  [RCM] rcm::RcmApi::BroadcastControl: Sending NETNAME_CREDS_UPDATED to mydb3_mydb3 on all nodes.
000010a8.00000560::2021/10/23-08:19:59.136 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:575 from node 1. Action: /rcm/mrr/BroadcastControl, Target: RCMA
000010a8.00002a74::2021/10/23-08:19:59.136 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002a74::2021/10/23-08:19:59.136 INFO  [RCM-rbtr] giving default token to group mydb3
000010a8.00002a74::2021/10/23-08:19:59.136 INFO  [RCM] Res mydb3: WaitingToComeOnline -> OnlineCallIssued( StateUnknown )
000010a8.00002a74::2021/10/23-08:19:59.136 INFO  [RCM] TransitionToState(mydb3) WaitingToComeOnline-->OnlineCallIssued.
000010a8.00002a74::2021/10/23-08:19:59.136 INFO  [RCM] Issuing Online(mydb3) to RHS.
000010a8.0000199c::2021/10/23-08:19:59.137 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:576 from node 1. Action: causal, Target: CAUS
0000243c.000029bc::2021/10/23-08:19:59.137 INFO  [RES] Network Name: Agent: OnInitialize (df59581d-6cb0-41d3-a597-dbce46545dcd,AdminShare)
0000243c.000029bc::2021/10/23-08:19:59.137 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
0000243c.000029bc::2021/10/23-08:19:59.137 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:df59581d-6cb0-41d3-a597-dbce46545dcd:AdminShare
0000243c.000029bc::2021/10/23-08:19:59.137 INFO  [RES] Network Name <mydb3_mydb3>: AdminShare: Waiting for ongoing slow strand to complete (if any)
0000243c.000029bc::2021/10/23-08:19:59.137 INFO  [RES] Network Name <mydb3_mydb3>: AdminShare: Signaling main strand to initialize module
0000243c.00000670::2021/10/23-08:19:59.137 INFO  [RES] Network Name <mydb3_mydb3>: Netname received credentials update
0000243c.000029bc::2021/10/23-08:19:59.137 INFO  [RES] Network Name <mydb3_mydb3>: AdminShare: Initializing Name: mydb3, NetbiosName: mydb3, Type: Singleton
0000243c.00000670::2021/10/23-08:19:59.137 INFO  [RES] Network Name <mydb3_mydb3>: InitializeADAware - ADAware value is 1
000010a8.00002498::2021/10/23-08:19:59.137 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3', gen(3) result 997/0.
000010a8.00002498::2021/10/23-08:19:59.137 INFO  [RCM] Res mydb3: OnlineCallIssued -> OnlinePending( StateUnknown )
000010a8.00002498::2021/10/23-08:19:59.137 INFO  [RCM] TransitionToState(mydb3) OnlineCallIssued-->OnlinePending.
0000243c.000009d0::2021/10/23-08:19:59.137 INFO  [RES] Network Name: Agent: InitializeModule, Trying to initialize Module(df59581d-6cb0-41d3-a597-dbce46545dcd,Identity) when there is one already in Initialized/Idle state
0000243c.00000670::2021/10/23-08:19:59.137 INFO  [RES] Network Name <mydb3_mydb3>: HandleCredentialsUpdate - Identity module already exists.
00000054.000023a8::2021/10/23-08:19:59.139 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] The DeadLockTimeout property has a value of 300000
00000054.000023a8::2021/10/23-08:19:59.140 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] The PendingTimeout property has a value of 180000
00000054.000023a8::2021/10/23-08:19:59.142 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Connect to SQL Server ...
0000243c.000029bc::2021/10/23-08:19:59.144 INFO  [RES] Network Name <mydb3_mydb3>: AdminShare: Creation of disk admin shares succeeded
0000243c.00000db0::2021/10/23-08:19:59.145 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet]                  DNS Suffix:
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00000db0::2021/10/23-08:19:59.145 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00000db0::2021/10/23-08:19:59.145 DBG   [ClNet]                  DNS Suffix:
0000243c.00000db0::2021/10/23-08:19:59.145 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.165 Prefix: 10.16.1.165/24 (Actual address: 10.16.1.165), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.165 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.165 Prefix: 10.30.0.165/24)
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.165
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.165
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.165
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.00000db0::2021/10/23-08:19:59.146 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Registering into DNS Name: mydb3 (Type: Singleton)...
0000243c.00000db0::2021/10/23-08:19:59.154 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Impersonating VCO User 'mydb3$' to Update DNS registration.  IsCore? false
0000243c.000029bc::2021/10/23-08:19:59.154 INFO  [RES] Network Name <mydb3_mydb3>: Identity: Get Token Request, currently has a token
0000243c.00000db0::2021/10/23-08:19:59.154 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.00000db0::2021/10/23-08:19:59.154 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.00000db0::2021/10/23-08:19:59.154 INFO  [RES] Network Name: [NNLIB] Registering name mydb3 on DNS Network: Cluster Network 1, with 2 DNS Servers, 2 Virtual Addresses, 1 Domain Names
0000243c.00000db0::2021/10/23-08:19:59.154 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000db0::2021/10/23-08:19:59.154 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000db0::2021/10/23-08:19:59.154 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.30.0.165
0000243c.00000db0::2021/10/23-08:19:59.154 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.165
0000243c.00000db0::2021/10/23-08:19:59.154 INFO  [RES] Network Name: [NNLIB] Registering: mydb3.domain.local
00000054.000023a8::2021/10/23-08:19:59.158 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] The connection was established successfully
00000054.000023a8::2021/10/23-08:19:59.159 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Current SQL Instance is not part of Failover clustering
00000054.000023a8::2021/10/23-08:19:59.159 INFO  [RES] SQL Server Availability Group: [hadrag] Maximum VerboseLogging among all availability group on the server is (0)
00000054.000023a8::2021/10/23-08:19:59.159 INFO  [RES] SQL Server Availability Group: [hadrag] Minimum HealthCheckTimeout among all availability group on the server is (30000)
0000243c.00002994::2021/10/23-08:19:59.181 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: BroadcastCredentialsUpdateImp sent
0000243c.00002994::2021/10/23-08:19:59.181 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Number of IPs that match current node id is 1. Registering mydb3 for multichannel support
0000243c.00002994::2021/10/23-08:19:59.185 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Registering netname for multichannel support returned 0
0000243c.00002994::2021/10/23-08:19:59.185 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Credentials Update - Configuration module sending Recheck config to Identity
0000243c.000009d0::2021/10/23-08:19:59.185 INFO  [RES] Network Name: Agent: -- listing 5 instances ---------------------------------------------
0000243c.00002994::2021/10/23-08:19:59.185 INFO  [RES] Network Name <mydb3_mydb3>: Identity: OnRecheckConfig, nothing changed
0000243c.000009d0::2021/10/23-08:19:59.185 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 1763b060-dff9-4961-8280-b1b5c0f92039:
0000243c.00002994::2021/10/23-08:19:59.185 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: InternalReplyHandler: 0
0000243c.000009d0::2021/10/23-08:19:59.185 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.185 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.185 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.185 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.185 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.185 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.000009d0::2021/10/23-08:19:59.185 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.185 INFO  [RES] Network Name: Agent: --- 7 modules for instance: df59581d-6cb0-41d3-a597-dbce46545dcd:
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initializing/Reading (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initializing/Writing (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: --- 7 modules for instance: eb44dd7f-7717-4f70-b74f-a2d373c3217a:
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: --- 7 modules for instance: ed158bf7-8c56-4e3e-9187-15f9c63678a5:
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: --- 7 modules for instance: f70cf510-b293-448c-89c9-9313e8be742c:
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.186 INFO  [RES] Network Name: Agent: -- 0 Orphan modules
0000243c.00000a98::2021/10/23-08:19:59.190 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: CheckIfPasswordIsInSync for mydb3 returned 0
0000243c.00000a98::2021/10/23-08:19:59.190 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: OnInitializeEnd: 0
0000243c.00000a98::2021/10/23-08:19:59.190 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: OnInitializeEnd: Starting health check timer in 3600 seconds
0000243c.00000a98::2021/10/23-08:19:59.191 INFO  [RES] Network Name: Agent: OnInitializeReply (df59581d-6cb0-41d3-a597-dbce46545dcd,AccountAD): 0, Prev.State: Alive
0000243c.00000a98::2021/10/23-08:19:59.191 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: AccountADInitReplyHandler - Received result 0 from AccountAD
00000054.000023a8::2021/10/23-08:19:59.206 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Failed to execute SQL command to perform the requested operation
00000054.000023a8::2021/10/23-08:19:59.206 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] ODBC Error: [42000] [Microsoft][SQL Server Native Client 11.0][SQL Server]The availability replica for availability group 'mydb3' on this instance of SQL Server cannot become the primary replica. One or more databases are not synchronized or have not joined the availability group. If the availability replica uses the asynchronous-commit mode, consider performing a forced manual failover (with possible data loss).
00000054.000023a8::2021/10/23-08:19:59.206 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Otherwise, once all local secondary databases are joined and synchronized, you can perform a planned manual failover to this secondary replica (without data loss). For more information, see SQL Server Books Online. (41142)
00000054.000023a8::2021/10/23-08:19:59.206 ERR   [RES] SQL Server Availability Group <mydb3>: [hadrag] Failed to execute availability group command stored procedure
00000054.000023a8::2021/10/23-08:19:59.206 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Disconnect from SQL Server
00000054.000023a8::2021/10/23-08:19:59.206 WARN  [RHS] Online for resource mydb3 failed.
000010a8.00000560::2021/10/23-08:19:59.207 WARN  [RCM] HandleMonitorReply: ONLINERESOURCE for 'mydb3', gen(3) result 5018/0.
00000054.000023a8::2021/10/23-08:19:59.207 INFO  [RHS-WER] Scheduling WER ERROR report in 10.000. ReportId fdaadc5a-1915-4fb4-ba9f-9508c026065b;
000010a8.00000560::2021/10/23-08:19:59.207 INFO  [RCM] Res mydb3: OnlinePending -> ProcessingFailure( StateUnknown )
000010a8.00000560::2021/10/23-08:19:59.207 INFO  [RCM] TransitionToState(mydb3) OnlinePending-->ProcessingFailure.
000010a8.00000560::2021/10/23-08:19:59.207 WARN  [RCM] rcm::RcmResource::HandleFailure: (mydb3)
000010a8.00002728::2021/10/23-08:19:59.207 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:577 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:19:59.207 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00002728::2021/10/23-08:19:59.207 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00002728::2021/10/23-08:19:59.207 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 03747308-1442-4ac6-8400-2a736435caa1.
000010a8.00002728::2021/10/23-08:19:59.207 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 03747308-1442-4ac6-8400-2a736435caa1.
000010a8.00002728::2021/10/23-08:19:59.207 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:578 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:19:59.207 INFO  [RCM] resource mydb3: failure count: 2, restartAction: 2 persistentState: 1.
000010a8.00000560::2021/10/23-08:19:59.207 INFO  [RCM] numDependents is zero, auto-returning true
000010a8.00000560::2021/10/23-08:19:59.207 INFO  [RCM] Resource mydb3 is causing group mydb3 to failover.
000010a8.00000560::2021/10/23-08:19:59.207 INFO  [RCM] rcm::RcmGroup::Failover: (mydb3)
000010a8.00000560::2021/10/23-08:19:59.207 WARN  [RCM] Not failing over group mydb3, failoverCount 2, failoverThresholdSetting 4294967295, lastFailover 2021/10/23-03:16:45.280
000010a8.00000560::2021/10/23-08:19:59.208 INFO  [RCM] Will retry online from long delay restart of mydb3 in 600000 milliseconds.
000010a8.00000560::2021/10/23-08:19:59.208 INFO  [RCM] mydb3_10.30.0.165 merits neither a notification nor a delayed restart
000010a8.00000560::2021/10/23-08:19:59.208 INFO  [RCM] mydb3_mydb3 merits neither a notification nor a delayed restart
000010a8.00000560::2021/10/23-08:19:59.208 INFO  [RCM] mydb3_10.16.1.165 merits neither a notification nor a delayed restart
000010a8.00000560::2021/10/23-08:19:59.208 INFO  [RCM] Res mydb3: ProcessingFailure -> WaitingToTerminate( Failed )
000010a8.00000560::2021/10/23-08:19:59.208 INFO  [RCM] TransitionToState(mydb3) ProcessingFailure-->[WaitingToTerminate to Failed].
000010a8.0000199c::2021/10/23-08:19:59.208 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:579 from node 1. Action: causal, Target: CAUS
000010a8.00000560::2021/10/23-08:19:59.208 INFO  [RCM] Res mydb3: [WaitingToTerminate to Failed] -> Terminating( Failed )
000010a8.00000560::2021/10/23-08:19:59.208 INFO  [RCM] TransitionToState(mydb3) [WaitingToTerminate to Failed]-->[Terminating to Failed].
00000054.000029a8::2021/10/23-08:19:59.208 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Connect to SQL Server ...
00000054.000029a8::2021/10/23-08:19:59.214 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] The connection was established successfully
0000243c.00000db0::2021/10/23-08:19:59.237 INFO  [RES] Network Name: [NNLIB] DNS Record there for mydb3.domain.local, proceeding
00000054.000029a8::2021/10/23-08:19:59.252 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Disconnect from SQL Server
00000054.000029a8::2021/10/23-08:19:59.252 INFO  [RES] SQL Server Availability Group <mydb3>: [hadrag] Offline call successful in Terminate function
000010a8.0000199c::2021/10/23-08:19:59.252 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'mydb3', gen(4) result 0/0.
000010a8.0000199c::2021/10/23-08:19:59.252 INFO  [RCM] Res mydb3: [Terminating to Failed] -> Failed( StateUnknown )
000010a8.0000199c::2021/10/23-08:19:59.252 INFO  [RCM] TransitionToState(mydb3) [Terminating to Failed]-->Failed.
000010a8.0000199c::2021/10/23-08:19:59.252 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Pending --> Failed)
000010a8.00000560::2021/10/23-08:19:59.252 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:580 from node 1. Action: causal, Target: CAUS
0000243c.00000db0::2021/10/23-08:19:59.398 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn mydb3.domain.local (ipv4Count 2, ipv6Count 0)
0000243c.00000db0::2021/10/23-08:19:59.398 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.00000db0::2021/10/23-08:19:59.482 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner mydb3.domain.local (registered sets: 1, ipv4Count 2, ipv6Count 0, ptrCount 2)
0000243c.00000db0::2021/10/23-08:19:59.482 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.00000db0::2021/10/23-08:19:59.482 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Completed DNS Registration for Name: mydb3 (Type: Singleton)
0000243c.00000db0::2021/10/23-08:19:59.482 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: InternalReplyHandler: 0
0000243c.000009d0::2021/10/23-08:19:59.482 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Updating status after a DNS registration
0000243c.000009d0::2021/10/23-08:19:59.482 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Last Dns Update time changed
000010a8.00002a74::2021/10/23-08:19:59.482 INFO  [GUM] Node 1: executing request locally, gumId:25792, my action: /dm/update, # of updates: 1
000010a8.00002a74::2021/10/23-08:19:59.483 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:581 from node 1. Action: gum/do-update, Target: GUMA
0000243c.000009d0::2021/10/23-08:19:59.527 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.000009d0::2021/10/23-08:19:59.527 INFO  [RES] Network Name <mydb3_mydb3>: Client: Synching with slow operation
0000243c.000009d0::2021/10/23-08:19:59.533 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet]                  DNS Suffix:
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000009d0::2021/10/23-08:19:59.533 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000009d0::2021/10/23-08:19:59.533 DBG   [ClNet]                  DNS Suffix:
0000243c.000009d0::2021/10/23-08:19:59.533 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000009d0::2021/10/23-08:19:59.536 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000009d0::2021/10/23-08:19:59.536 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000009d0::2021/10/23-08:19:59.536 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000009d0::2021/10/23-08:19:59.536 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.165 Prefix: 10.16.1.165/24 (Actual address: 10.16.1.165), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000009d0::2021/10/23-08:19:59.536 INFO  [RES] Network Name: [NNLIB] Adding address 10.30.0.165 to Networks, Network: Cluster Network 1 [0], (Matching Addr: 10.30.0.165 Prefix: 10.30.0.165/24)
0000243c.000009d0::2021/10/23-08:19:59.536 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000009d0::2021/10/23-08:19:59.536 INFO  [RES] Network Name <mydb3_mydb3>: Client: Final alias is 10.16.1.165
0000243c.000009d0::2021/10/23-08:19:59.536 INFO  [RES] Network Name <mydb3_mydb3>: Client: RegisterFqdnWithLsa - Found FQDN mydb3.domain.local that is already registered with LSA
0000243c.000009d0::2021/10/23-08:19:59.536 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: InternalReplyHandler: 0
000010a8.00002a74::2021/10/23-08:19:59.566 INFO  [RCM] rcm::RcmApi::AddPossibleOwner: (mydb3, 2)
000010a8.00002a74::2021/10/23-08:19:59.566 INFO  [GUM] Node 1: executing request locally, gumId:25793, my action: /rcm/gum/AddPossibleOwner, # of updates: 1
000010a8.00002a74::2021/10/23-08:19:59.566 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb3,2)
000010a8.00002a74::2021/10/23-08:19:59.566 WARN  mscs::GumAgent::ExecuteHandlerLocally: (5010)' because of 'The specified node is already a possible owner.'
000010a8.00002a74::2021/10/23-08:19:59.566 WARN  [DM] Aborting group transaction 85:85:32589+1
000010a8.00002a74::2021/10/23-08:19:59.566 ERR   [RCM] rcm::RcmApi::AddPossibleOwner: (5010)' because of 'Gum handler completed as failed'
000010a8.00002a74::2021/10/23-08:19:59.611 INFO  [RCM] rcm::RcmApi::MoveGroup: (Group:mydb3 Dest:2 Flags:0 MoveType:MoveType::Manual Cur.State:Failed, ContextSize:0)
000010a8.00002a74::2021/10/23-08:19:59.611 INFO  [RCM-plcmt] this node is director, calling approve placement
000010a8.00002a74::2021/10/23-08:19:59.611 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter NodeDownFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter NodeShuttingDownFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter CurrentNodeFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter PausedNodeFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] rcm::RcmGroup::NodeIsPossibleOwner: Group mydb3: Node:2 IsPossibleOwner:true
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter PossibleOwnerFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter QueuingPerviouslyRejectedFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter PreferredOwnerWaitFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter AntiAffinityFilter
000010a8.00000560::2021/10/23-08:19:59.612 INFO  [RCM] applying timely STM connectivity snapshot for group mydb3
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter StmFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter DependentCsvSiteFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter GroupIntelligenceFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM-plcmt] Group mydb3 allowed to move to node 2 by filter AvailabilitySetFilter
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] rcm::RcmGroup::Move: (mydb3, 2, MoveType::Manual)
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] rcm::RcmGroup::Move: Bringing group 'mydb3' offline first...
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] Res mydb3: Failed -> Offline( StateUnknown )
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] TransitionToState(mydb3) Failed-->Offline.
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Failed --> Offline)
000010a8.00000560::2021/10/23-08:19:59.612 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:582 from node 1. Action: causal, Target: CAUS
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] Res mydb3_mydb3: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] TransitionToState(mydb3_mydb3) Online-->WaitingToGoOffline.
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Offline --> Pending)
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] Res mydb3_mydb3: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] TransitionToState(mydb3_mydb3) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] Res mydb3_10.16.1.165: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) Online-->WaitingToGoOffline.
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] 'mydb3_10.16.1.165' cannot go offline yet; Dependent Resource 'mydb3_mydb3' is in state OfflineCallIssued.
000010a8.00002a74::2021/10/23-08:19:59.612 INFO  [RCM] Res mydb3_10.16.1.165: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.0000199c::2021/10/23-08:19:59.612 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:583 from node 1. Action: causal, Target: CAUS
0000243c.00000db0::2021/10/23-08:19:59.613 INFO  [RES] Network Name <mydb3_mydb3>: Offline called for resource mydb3_mydb3
000010a8.00002a74::2021/10/23-08:19:59.613 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb3_mydb3', gen(0) result 997/0.
000010a8.00002a74::2021/10/23-08:19:59.613 INFO  [RCM] Res mydb3_mydb3: OfflineCallIssued -> OfflinePending( StateUnknown )
000010a8.00002a74::2021/10/23-08:19:59.613 INFO  [RCM] TransitionToState(mydb3_mydb3) OfflineCallIssued-->OfflinePending.
0000243c.00002b50::2021/10/23-08:19:59.613 INFO  [RES] Network Name <mydb3_mydb3>: Entering Offline thread
0000243c.00002b50::2021/10/23-08:19:59.613 INFO  [RES] Network Name <mydb3_mydb3>: Performing actual offline of resource.
0000243c.00002b50::2021/10/23-08:19:59.613 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,AdminShare)
0000243c.00000db0::2021/10/23-08:19:59.613 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,AdminShare)
0000243c.00000db0::2021/10/23-08:19:59.613 INFO  [RES] Network Name <mydb3_mydb3>: AdminShare: Canceling work, state: Closing/Idle
0000243c.00000db0::2021/10/23-08:19:59.613 INFO  [RES] Network Name <mydb3_mydb3>: AdminShare: OnCloseBase, previous state: Initialized/Idle
0000243c.00000db0::2021/10/23-08:19:59.615 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,AdminShare) result: 0
0000243c.00000db0::2021/10/23-08:19:59.615 INFO  [RES] Network Name <mydb3_mydb3>: SyncReplyHandler Configuration, result: 0
0000243c.00002b50::2021/10/23-08:19:59.615 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,Configuration)
0000243c.00000db0::2021/10/23-08:19:59.615 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,Configuration)
0000243c.00000db0::2021/10/23-08:19:59.615 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Canceling work, state: Closing/Idle
0000243c.00000db0::2021/10/23-08:19:59.615 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: OnCloseBase, previous state: Initialized/Idle
0000243c.00000db0::2021/10/23-08:19:59.615 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Closing... (PreviousState: Initialized, Created: true, Type: Singleton)
0000243c.00000db0::2021/10/23-08:19:59.615 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,AccountAD)
0000243c.00000db0::2021/10/23-08:19:59.615 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,Dns)
0000243c.00000db0::2021/10/23-08:19:59.615 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,Client)
0000243c.000009d0::2021/10/23-08:19:59.615 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,AccountAD)
0000243c.000009d0::2021/10/23-08:19:59.616 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,Dns)
0000243c.00000a98::2021/10/23-08:19:59.616 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: Canceling work, state: Closing/Idle
0000243c.00000a98::2021/10/23-08:19:59.616 INFO  [RES] Network Name <mydb3_mydb3>: AccountAD: OnCloseBase, previous state: Initialized/Idle
0000243c.000009d0::2021/10/23-08:19:59.616 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,Client)
0000243c.000009d0::2021/10/23-08:19:59.616 INFO  [RES] Network Name <mydb3_mydb3>: Client: Canceling work, state: Closing/Idle
0000243c.00002994::2021/10/23-08:19:59.616 INFO  [RES] Network Name <mydb3_mydb3>: Dns: Canceling work, state: Closing/Idle
0000243c.000009d0::2021/10/23-08:19:59.616 INFO  [RES] Network Name <mydb3_mydb3>: Client: OnCloseBase, previous state: Initialized/Idle
0000243c.00002994::2021/10/23-08:19:59.616 INFO  [RES] Network Name <mydb3_mydb3>: Dns: OnCloseBase, previous state: Initialized/Idle
0000243c.000009d0::2021/10/23-08:19:59.616 INFO  [RES] Network Name: [NNLIB] Removing alias 10.16.1.165 for target mydb3
0000243c.000029bc::2021/10/23-08:19:59.616 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Dns) result: 0
0000243c.000029bc::2021/10/23-08:19:59.616 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Closing NetName (type Singleton) Module Dns, result 0, remaining... 3 (0)
0000243c.00000a98::2021/10/23-08:19:59.617 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,AccountAD) result: 0
0000243c.00000a98::2021/10/23-08:19:59.617 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Closing NetName (type Singleton) Module AccountAD, result 0, remaining... 2 (0)
0000243c.000009d0::2021/10/23-08:19:59.618 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 124, result size 0 (status: 0, subStatus: 0)
0000243c.000009d0::2021/10/23-08:19:59.618 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 124, result size 0 (status: 0, subStatus: 0)
0000243c.000009d0::2021/10/23-08:19:59.618 INFO  [RES] Network Name: [NNLIB] Success on credential operation remove on Account mydb3$, status: 0 (subStatus: 0)
0000243c.000009d0::2021/10/23-08:19:59.619 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 72, result size 0 (status: 0, subStatus: 0)
0000243c.000009d0::2021/10/23-08:19:59.619 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb3.domain.local, status: 0, subStatus: 0
0000243c.000009d0::2021/10/23-08:19:59.619 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 46, result size 0 (status: 0, subStatus: 0)
0000243c.000009d0::2021/10/23-08:19:59.619 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb3, status: 0, subStatus: 0
0000243c.000009d0::2021/10/23-08:19:59.620 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 46, result size 0 (status: 0, subStatus: 0)
0000243c.000009d0::2021/10/23-08:19:59.620 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb3, status: 0, subStatus: 0
0000243c.000009d0::2021/10/23-08:19:59.620 INFO  [RES] Network Name <mydb3_mydb3>: Client: Unregistering netname for multichannel support returned 0
0000243c.000009d0::2021/10/23-08:19:59.620 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Client) result: 0
0000243c.000009d0::2021/10/23-08:19:59.620 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Closing NetName (type Singleton) Module Client, result 0, remaining... 1 (0)
0000243c.000009d0::2021/10/23-08:19:59.620 INFO  [RES] Network Name: Agent: Closing (df59581d-6cb0-41d3-a597-dbce46545dcd,Netbios)
0000243c.000009d0::2021/10/23-08:19:59.620 INFO  [RES] Network Name: Agent: OnClose (df59581d-6cb0-41d3-a597-dbce46545dcd,Netbios)
0000243c.000009d0::2021/10/23-08:19:59.620 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: Canceling work, state: Closing/Idle
0000243c.000009d0::2021/10/23-08:19:59.620 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: OnCloseBase, previous state: Initialized/Idle
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: [NNLIB] Deregistered server name mydb3 on transport \Device\NetbiosSmb
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: [NNLIB] Deleted server name: mydb3 from all transports
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: [NNLIB] Deleting Server Name for server name: mydb3, ret: 0
0000243c.00000a98::2021/10/23-08:19:59.622 INFO  [RES] Network Name <mydb3_mydb3>: Netbios: Cleaning up transports
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Netbios) result: 0
0000243c.00000a98::2021/10/23-08:19:59.622 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Finish Closing NetName (type Singleton) Module Netbios, result 0, remaining... 0 (0)
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: -- listing 5 instances ---------------------------------------------
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 1763b060-dff9-4961-8280-b1b5c0f92039:
0000243c.00000db0::2021/10/23-08:19:59.622 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Closed
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.00000db0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: OnCloseReply (df59581d-6cb0-41d3-a597-dbce46545dcd,Configuration) result: 0
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.00000db0::2021/10/23-08:19:59.622 INFO  [RES] Network Name <mydb3_mydb3>: SyncReplyHandler Configuration, result: 0
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.622 INFO  [RES] Network Name: Agent: --- 7 modules for instance: df59581d-6cb0-41d3-a597-dbce46545dcd:
0000243c.00002b50::2021/10/23-08:19:59.622 INFO  [RHS] Resource mydb3_mydb3 has come offline. RHS is about to report resource status to RCM.
000010a8.00000560::2021/10/23-08:19:59.622 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb3_mydb3', gen(0) result 0/0.
000010a8.00000560::2021/10/23-08:19:59.623 INFO  [RCM] Res mydb3_mydb3: OfflinePending -> OfflineSavingCheckpoints( StateUnknown )
000010a8.00000560::2021/10/23-08:19:59.623 INFO  [RCM] TransitionToState(mydb3_mydb3) OfflinePending-->OfflineSavingCheckpoints.
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
000010a8.00000560::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
000010a8.00000560::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00000560::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
000010a8.00000560::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: --- 7 modules for instance: eb44dd7f-7717-4f70-b74f-a2d373c3217a:
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id df59581d-6cb0-41d3-a597-dbce46545dcd and name mydb3_mydb3
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id df59581d-6cb0-41d3-a597-dbce46545dcd
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource df59581d-6cb0-41d3-a597-dbce46545dcd in RcmResource
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource df59581d-6cb0-41d3-a597-dbce46545dcd
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource df59581d-6cb0-41d3-a597-dbce46545dcd.
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource df59581d-6cb0-41d3-a597-dbce46545dcd.
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource df59581d-6cb0-41d3-a597-dbce46545dcd finished, about to signal Checkpoint completion
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] Res mydb3_mydb3: OfflineSavingCheckpoints -> Offline( StateUnknown )
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] TransitionToState(mydb3_mydb3) OfflineSavingCheckpoints-->Offline.
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: --- 7 modules for instance: ed158bf7-8c56-4e3e-9187-15f9c63678a5:
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
000010a8.00000560::2021/10/23-08:19:59.623 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:584 from node 1. Action: causal, Target: CAUS
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: --- 7 modules for instance: f70cf510-b293-448c-89c9-9313e8be742c:
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource df59581d-6cb0-41d3-a597-dbce46545dcd
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id df59581d-6cb0-41d3-a597-dbce46545dcd and name mydb3_mydb3
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-08:19:59.623 INFO  [RES] Network Name: Agent: -- 0 Orphan modules
000010a8.0000199c::2021/10/23-08:19:59.623 INFO  [RCM] Res mydb3_10.16.1.165: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.0000199c::2021/10/23-08:19:59.623 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:585 from node 1. Action: causal, Target: CAUS
0000023c.00002acc::2021/10/23-08:19:59.623 INFO  [RES] IP Address <mydb3_10.16.1.165>: Taking resource offline...
0000023c.00002acc::2021/10/23-08:19:59.623 INFO  [RES] IP Address <mydb3_10.16.1.165>: Deleting IP address 10.16.1.165.
0000023c.00002acc::2021/10/23-08:19:59.623 INFO  [RES] IP Address <mydb3_10.16.1.165>: Address 10.16.1.165 on adapter vmxnet3 Ethernet Adapter offline.
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb3_10.16.1.165', gen(0) result 0/0.
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] Res mydb3_10.16.1.165: OfflineCallIssued -> OfflineSavingCheckpoints( StateUnknown )
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) OfflineCallIssued-->OfflineSavingCheckpoints.
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id e4c0a555-70a1-4277-9e63-eb4511c6d6a2 and name mydb3_10.16.1.165
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id e4c0a555-70a1-4277-9e63-eb4511c6d6a2
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2 in RcmResource
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2.
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2.
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2 finished, about to signal Checkpoint completion
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [RCM] Res mydb3_10.16.1.165: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [RCM] TransitionToState(mydb3_10.16.1.165) OfflineSavingCheckpoints-->Offline.
000010a8.00002728::2021/10/23-08:19:59.623 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb3, Pending --> Offline)
000010a8.00002a74::2021/10/23-08:19:59.623 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:586 from node 1. Action: causal, Target: CAUS
000010a8.00002728::2021/10/23-08:19:59.624 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource e4c0a555-70a1-4277-9e63-eb4511c6d6a2
000010a8.00002728::2021/10/23-08:19:59.624 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id e4c0a555-70a1-4277-9e63-eb4511c6d6a2 and name mydb3_10.16.1.165
000010a8.00002a74::2021/10/23-08:19:59.624 INFO  [RCM] rcm::QueuedMovesHolder::RemoveGroup: (mydb3) GroupBeingMoved: true AllowMoveCancel: false NotifyMoveFailure: false
000010a8.0000199c::2021/10/23-08:19:59.624 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:587 from node 1. Action: causal, Target: CAUS
000010a8.00002a74::2021/10/23-08:19:59.624 INFO  [GUM] Node 1: executing request locally, gumId:25793, my action: /rcm/gum/GroupMoveOperation, # of updates: 1
000010a8.00002a74::2021/10/23-08:19:59.624 INFO  [RCM] rcm::RcmGum::GroupMoveOperation(1)
000010a8.00002a74::2021/10/23-08:19:59.624 INFO  [RCM] move of group mydb3 from db-node-primary(1) to db-node-secondary(2) of type MoveType::Manual is about to succeed, failoverCount=1, lastFailoverTime=2021/10/23-03:16:45.280 targeted=true
000010a8.00002a74::2021/10/23-08:19:59.624 INFO  MTimer(OneGroupMovetimer): [Total: 0 ms ( 0 s )]
000010a8.00002a74::2021/10/23-08:19:59.624 INFO  [RCM] processed 1 group moves, 0 failures
000010a8.00002a74::2021/10/23-08:19:59.624 INFO  [DM] An empty single transaction is cancelled 85:85:32589+1::0
000010a8.00002a74::2021/10/23-08:19:59.624 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:588 from node 1. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:19:59.625 DBG   [NETFTAPI] received NsiDeleteInstance for 10.16.1.165
000010a8.0000199c::2021/10/23-08:19:59.625 WARN  [NETFTAPI] Failed to query parameters for 10.16.1.165 (status 0x80070490)
000010a8.0000199c::2021/10/23-08:19:59.625 DBG   [NETFTAPI] Signaled NetftLocalRemove event for 10.16.1.165
000010a8.0000199c::2021/10/23-08:19:59.654 ERR   [RCM] s_RcmRpcGetResourceState: (5908)' because of ''mydb3' is owned by node 2, not 1.'
000010a8.000011f0::2021/10/23-08:19:59.664 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:159 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:59.664 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:160 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:59.664 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:161 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:59.664 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:162 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:59.664 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:163 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:59.664 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:164 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:59.664 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:165 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:59.675 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:166 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:59.675 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:167 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:19:59.677 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:168 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:20:03.345 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:169 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:20:03.345 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:170 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:20:03.381 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:171 from node 2. Action: /rcm/mrr/BroadcastControl, Target: RCMA
000010a8.000011f0::2021/10/23-08:20:03.382 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:172 from node 2. Action: causal, Target: CAUS
0000243c.000009d0::2021/10/23-08:20:03.382 INFO  [RES] Network Name <mydb3_mydb3>: Netname received credentials update
0000243c.000009d0::2021/10/23-08:20:03.382 INFO  [RES] Network Name <mydb3_mydb3>: InitializeADAware - ADAware value is 1
0000243c.00000db0::2021/10/23-08:20:03.382 INFO  [RES] Network Name: Agent: InitializeModule, Trying to initialize Module(df59581d-6cb0-41d3-a597-dbce46545dcd,Identity) when there is one already in Initialized/Idle state
0000243c.000009d0::2021/10/23-08:20:03.382 INFO  [RES] Network Name <mydb3_mydb3>: HandleCredentialsUpdate - Identity module already exists.
000010a8.000011f0::2021/10/23-08:20:03.383 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:173 from node 2. Action: causal, Target: CAUS
0000243c.00000db0::2021/10/23-08:20:03.385 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: Credentials Update - Configuration module sending Recheck config to Identity
0000243c.00000db0::2021/10/23-08:20:03.385 INFO  [RES] Network Name <mydb3_mydb3>: Identity: OnRecheckConfig, nothing changed
0000243c.00000db0::2021/10/23-08:20:03.385 INFO  [RES] Network Name <mydb3_mydb3>: Configuration: InternalReplyHandler: 0
000010a8.000011f0::2021/10/23-08:20:03.428 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:174 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:20:03.428 INFO  [GUM] Node 1: Processing RequestLock 2:51
000010a8.000011f0::2021/10/23-08:20:03.428 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:589 from node 1. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:20:03.428 INFO  [GUM] Node 1: Processing GrantLock to 2 (sent by 1 gumid: 25793)
000010a8.000011f0::2021/10/23-08:20:03.467 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:175 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00002a74::2021/10/23-08:20:03.467 INFO  [GUM] Node 1: Executing locally gumId: 25794, updates: 2, first action: /dm/update
000010a8.000011f0::2021/10/23-08:20:03.513 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:176 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00002a74::2021/10/23-08:20:03.513 INFO  [GUM] Node 1: Executing locally gumId: 25795, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:20:03.558 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:177 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:20:03.558 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:178 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-08:20:03.606 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:179 from node 2. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:20:03.607 INFO  [GUM] Node 1: Executing locally gumId: 25796, updates: 1, first action: /rcm/gum/RemovePossibleOwner
000010a8.0000199c::2021/10/23-08:20:03.607 INFO  [RCM] rcm::RcmGum::RemovePossibleOwner(mydb3,1)
000010a8.0000199c::2021/10/23-08:20:03.607 INFO  [RCM] Removing node 1 from resource 'mydb3'.
000010a8.000011f0::2021/10/23-08:20:03.651 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:180 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00002a74::2021/10/23-08:20:03.651 INFO  [GUM] Node 1: Executing locally gumId: 25797, updates: 1, first action: /rcm/gum/SetGroupPreferredOwners
000010a8.00002a74::2021/10/23-08:20:03.651 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb3,<vector len='1'>
000010a8.00002a74::2021/10/23-08:20:03.651 INFO      <item>2</item>
000010a8.00002a74::2021/10/23-08:20:03.651 INFO  </vector>
000010a8.00002a74::2021/10/23-08:20:03.651 INFO  )
000010a8.000011f0::2021/10/23-08:20:03.696 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:181 from node 2. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:20:03.697 INFO  [GUM] Node 1: Executing locally gumId: 25798, updates: 1, first action: /rcm/gum/AddPossibleOwner
000010a8.0000199c::2021/10/23-08:20:03.697 INFO  [RCM] rcm::RcmGum::AddPossibleOwner(mydb3,1)
000010a8.0000199c::2021/10/23-08:20:03.697 INFO  [RCM] Adding node 1 to resource 'mydb3'.
000010a8.000011f0::2021/10/23-08:20:03.739 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:182 from node 2. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:20:03.740 INFO  [GUM] Node 1: Executing locally gumId: 25799, updates: 1, first action: /rcm/gum/SetGroupPreferredOwners
000010a8.0000199c::2021/10/23-08:20:03.740 INFO  [RCM] rcm::RcmGum::SetGroupPreferredOwners(mydb3,<vector len='2'>
000010a8.0000199c::2021/10/23-08:20:03.740 INFO      <item>2</item>
000010a8.0000199c::2021/10/23-08:20:03.740 INFO      <item>1</item>
000010a8.0000199c::2021/10/23-08:20:03.740 INFO  </vector>
000010a8.0000199c::2021/10/23-08:20:03.740 INFO  )
00000054.00000850::2021/10/23-08:20:09.197 INFO  [RHS-WER] About to send WER ERROR report. Dump policy 0x137701110; ReportId acba8145-8da4-42ba-8dd0-0eebeb93e80f; Failure time 2021/10/23-03:19:59.193
00000054.00002b4c::2021/10/23-08:20:09.204 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="System">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_1.evtx.
00000054.00000914::2021/10/23-08:20:09.205 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Application">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_2.evtx.
00000054.00002a80::2021/10/23-08:20:09.206 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-WindowsUpdateClient/Operational">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_3.evtx.
00000054.00002938::2021/10/23-08:20:09.208 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-FailoverClustering/Operational">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_4.evtx.
00000054.00001a10::2021/10/23-08:20:09.209 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-Kernel-IoTrace/Diagnostic">*[System[TimeCreated[timediff(@SystemTime) &lt;= 600000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_5.evtx.
00000054.00002384::2021/10/23-08:20:09.209 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-RPC/Debug">*[System[TimeCreated[timediff(@SystemTime) &lt;= 600000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_6.evtx.
00000054.00001a10::2021/10/23-08:20:09.239 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_5.evtx completed.
00000054.00001a10::2021/10/23-08:20:09.239 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-Kernel-LiveDump/Analytic">*[System[TimeCreated[timediff(@SystemTime) &lt;= 1800000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_7.evtx.
00000054.00002384::2021/10/23-08:20:09.239 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_6.evtx completed.
00000054.00002384::2021/10/23-08:20:09.239 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-FailoverClustering/Diagnostic">*[System[TimeCreated[timediff(@SystemTime) &lt;= 600000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_8.evtx.
00000054.00002a80::2021/10/23-08:20:09.246 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_3.evtx completed.
00000054.00002a80::2021/10/23-08:20:09.246 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-FailoverClustering/DiagnosticVerbose">*[System[TimeCreated[timediff(@SystemTime) &lt;= 300000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_9.evtx.
00000054.00002b80::2021/10/23-08:20:09.266 INFO  [RHS-WER] Capturing log by relogging events from ClusterLogger to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_14.etl for time range 2021/10/23-03:09:59.193 - 2021/10/23-03:19:59.193.
00000054.00001bdc::2021/10/23-08:20:09.266 INFO  [RHS-WER] Capturing log by relogging events from ClusterRhsErrorLogger to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_15.etl for time range 2021/10/23-03:09:59.193 - 2021/10/23-03:19:59.193.
00000054.00002b80::2021/10/23-08:20:09.267 WARN  [RHS-WER] Capture ClusterLogger failed HrError(0x80070002).
00000054.00001bdc::2021/10/23-08:20:09.267 WARN  [RHS-WER] Capture ClusterRhsErrorLogger failed HrError(0x80070002).
00000054.00001a10::2021/10/23-08:20:09.272 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_7.evtx completed.
00000054.00001a10::2021/10/23-08:20:09.272 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-FailoverClustering-CsvFs/Operational">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_10.evtx.
00000054.00001a10::2021/10/23-08:20:09.293 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_10.evtx completed.
00000054.00001a10::2021/10/23-08:20:09.293 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-FailoverClustering-NetFt/Operational">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_11.evtx.
00000054.00002938::2021/10/23-08:20:09.306 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_4.evtx completed.
00000054.00002938::2021/10/23-08:20:09.307 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-ClusterAwareUpdating/Admin">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_12.evtx.
00000054.00001a10::2021/10/23-08:20:09.316 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_11.evtx completed.
00000054.00001a10::2021/10/23-08:20:09.316 INFO  [RHS-WER] Capturing log using query <QueryList><Query Id="0"><Select Path="Microsoft-Windows-ClusterAwareUpdating-Management/Adminn">*[System[TimeCreated[timediff(@SystemTime) &lt;= 86400000]]]</Select></Query></QueryList> to C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_13.evtx.
00000054.00002938::2021/10/23-08:20:09.321 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_12.evtx completed.
00000054.00001a10::2021/10/23-08:20:09.332 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_13.evtx completed.
00000054.00002b4c::2021/10/23-08:20:09.438 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_1.evtx completed.
00000054.00002a80::2021/10/23-08:20:09.788 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_9.evtx completed.
00000054.00000914::2021/10/23-08:20:13.758 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_2.evtx completed.
00000054.00002384::2021/10/23-08:20:24.238 INFO  [RHS-WER] Capture C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_8.evtx completed.
00000054.00000850::2021/10/23-08:20:24.239 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_1.evtx to WER report.
00000054.00000850::2021/10/23-08:20:24.239 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_2.evtx to WER report.
00000054.00000850::2021/10/23-08:20:24.240 WARN  [RHS-WER] Failed to add file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_3.evtx to WER report 0x80070002.
00000054.00000850::2021/10/23-08:20:24.240 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_4.evtx to WER report.
00000054.00000850::2021/10/23-08:20:24.240 WARN  [RHS-WER] Failed to add file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_5.evtx to WER report 0x80070002.
00000054.00000850::2021/10/23-08:20:24.241 WARN  [RHS-WER] Failed to add file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_6.evtx to WER report 0x80070002.
00000054.00000850::2021/10/23-08:20:24.241 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_7.evtx to WER report.
00000054.00000850::2021/10/23-08:20:24.242 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_8.evtx to WER report.
00000054.00000850::2021/10/23-08:20:24.242 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_9.evtx to WER report.
00000054.00000850::2021/10/23-08:20:24.243 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_10.evtx to WER report.
00000054.00000850::2021/10/23-08:20:24.243 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_11.evtx to WER report.
00000054.00000850::2021/10/23-08:20:24.244 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_12.evtx to WER report.
00000054.00000850::2021/10/23-08:20:24.245 INFO  [RHS-WER] Added file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_13.evtx to WER report.
00000054.00000850::2021/10/23-08:20:24.245 WARN  [RHS-WER] Failed to add file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_14.etl to WER report 0x80070002.
00000054.00000850::2021/10/23-08:20:24.245 WARN  [RHS-WER] Failed to add file C:\Windows\Cluster\Reports\CLUSWER_RHS_ERROR_acba8145-8da4-42ba-8dd0-0eebeb93e80f_15.etl to WER report 0x80070002.
00000054.00000850::2021/10/23-08:20:25.650 INFO  [RHS-WER] WER ERROR report is submitted with flags 0x74. Result : WerDisabled.
0000023c.00002acc::2021/10/23-08:20:42.936 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000197c::2021/10/23-08:21:42.946 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000011f0::2021/10/23-08:22:16.131 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:183 from node 2. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:22:16.131 INFO  [GUM] Node 1: Executing locally gumId: 25800, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:22:16.176 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:184 from node 2. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:22:16.176 INFO  [GUM] Node 1: Executing locally gumId: 25801, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:22:16.393 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:185 from node 2. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:22:16.393 INFO  [GUM] Node 1: Executing locally gumId: 25802, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:22:16.626 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:186 from node 2. Action: gum/do-update, Target: GUMA
000010a8.0000199c::2021/10/23-08:22:16.626 INFO  [GUM] Node 1: Executing locally gumId: 25803, updates: 1, first action: /dm/update
000010a8.000011f0::2021/10/23-08:22:16.671 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:187 from node 2. Action: gum/do-update, Target: GUMA
000010a8.00000478::2021/10/23-08:22:16.671 INFO  [GUM] Node 1: Executing locally gumId: 25804, updates: 1, first action: /dm/update
0000023c.0000197c::2021/10/23-08:22:42.968 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000197c::2021/10/23-08:23:42.979 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000199c::2021/10/23-08:24:30.887 WARN  Unhandled exception on the thread 6556, exception The requested operation is not supported.
0000023c.0000197c::2021/10/23-08:24:43.004 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000197c::2021/10/23-08:25:43.007 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002384::2021/10/23-08:26:43.082 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001954::2021/10/23-08:27:40.470 INFO  [RCM] Delay-restarting mydb1_10.30.0.163 and any waiting dependents.
000010a8.00001954::2021/10/23-08:27:40.470 INFO  [RCM] Resource mydb1_10.30.0.163 is not in the right state to be restarted
0000023c.00002384::2021/10/23-08:27:43.033 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002af4::2021/10/23-08:28:43.066 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002844::2021/10/23-08:29:30.908 WARN  Unhandled exception on the thread 10308, exception The requested operation is not supported.
0000023c.00002af4::2021/10/23-08:29:43.073 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000528::2021/10/23-08:30:43.083 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000528::2021/10/23-08:31:43.094 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000528::2021/10/23-08:32:43.113 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000850::2021/10/23-08:33:43.128 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001954::2021/10/23-08:34:30.487 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.00001954::2021/10/23-08:34:30.487 INFO  [GEM] Node 1:     Target: CAUS, Action: causal, Count: 129
000010a8.00001954::2021/10/23-08:34:30.487 INFO  [GEM] Node 1:     Target: GUMA, Action: gum/do-update, Count: 116
000010a8.00001954::2021/10/23-08:34:30.487 INFO  [GEM] Node 1:     Target: MISC, Action: Other Messages, Count: 2
000010a8.00001954::2021/10/23-08:34:30.487 INFO  [GEM] Node 1: ---- 247 Total Messages
000010a8.0000109c::2021/10/23-08:34:30.930 WARN  Unhandled exception on the thread 4252, exception The requested operation is not supported.
0000023c.00000850::2021/10/23-08:34:43.157 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028d0::2021/10/23-08:35:43.175 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028d0::2021/10/23-08:36:43.191 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ff0::2021/10/23-08:37:43.196 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ff0::2021/10/23-08:38:43.224 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001954::2021/10/23-08:39:30.958 WARN  Unhandled exception on the thread 6484, exception The requested operation is not supported.
0000023c.00002848::2021/10/23-08:39:43.233 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002848::2021/10/23-08:40:43.259 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002848::2021/10/23-08:41:43.271 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002424::2021/10/23-08:42:43.291 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002424::2021/10/23-08:43:43.293 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002ba4::2021/10/23-08:44:30.986 WARN  Unhandled exception on the thread 11172, exception The requested operation is not supported.
0000023c.000006ac::2021/10/23-08:44:43.318 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001b7c::2021/10/23-08:44:57.974 INFO  [CSVREMPRV] ClusterGetAllSnapshotsFromDatabase, EXIT, status:0
000010a8.00001b7c::2021/10/23-08:44:57.975 INFO  [CSVPRV] ClusterGetAllSnapshotsFromDatabase: status 0
000010a8.00002900::2021/10/23-08:45:30.124 INFO  [CSVREMPRV] ClusterGetAllSnapshotsFromDatabase, EXIT, status:0
000010a8.00002900::2021/10/23-08:45:30.124 INFO  [CSVPRV] ClusterGetAllSnapshotsFromDatabase: status 0
0000023c.000006ac::2021/10/23-08:45:43.321 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002ba4::2021/10/23-08:46:15.316 INFO  [CSVREMPRV] ClusterGetAllSnapshotsFromDatabase, EXIT, status:0
000010a8.00002ba4::2021/10/23-08:46:15.316 INFO  [CSVPRV] ClusterGetAllSnapshotsFromDatabase: status 0
000010a8.000019b8::2021/10/23-08:46:28.402 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~57260~.
000010a8.00002ba4::2021/10/23-08:46:28.402 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~57260~).
000010a8.00002ba4::2021/10/23-08:46:28.402 INFO  [SV] Got a new incoming stream from 10.16.1.75:~57260~
000010a8.000019b8::2021/10/23-08:46:28.407 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~57262~.
000010a8.00002900::2021/10/23-08:46:28.407 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~57262~).
000010a8.00002900::2021/10/23-08:46:28.407 INFO  [SV] Got a new incoming stream from 10.16.1.75:~57262~
000010a8.00002900::2021/10/23-08:46:28.414 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00002900::2021/10/23-08:46:28.414 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00002ba4::2021/10/23-08:46:28.418 WARN  [CHANNEL 10.16.1.75:~57260~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00002ba4::2021/10/23-08:46:28.418 WARN  [CHANNEL 10.16.1.75:~57260~] failure, status 10054
000010a8.00002ba4::2021/10/23-08:46:28.418 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~57260~ has failed with status 10054'
000010a8.00002ba4::2021/10/23-08:46:28.418 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
0000023c.00001cd0::2021/10/23-08:46:43.357 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000019b8::2021/10/23-08:46:44.108 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~46516~.
000010a8.00001b7c::2021/10/23-08:46:44.108 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~46516~).
000010a8.00001b7c::2021/10/23-08:46:44.108 INFO  [SV] Got a new incoming stream from 10.16.1.75:~46516~
000010a8.000019b8::2021/10/23-08:46:44.112 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~46518~.
000010a8.00002ba4::2021/10/23-08:46:44.112 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~46518~).
000010a8.00002ba4::2021/10/23-08:46:44.112 INFO  [SV] Got a new incoming stream from 10.16.1.75:~46518~
000010a8.00002ba4::2021/10/23-08:46:44.209 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00002ba4::2021/10/23-08:46:44.209 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00001b7c::2021/10/23-08:46:44.212 WARN  [CHANNEL 10.16.1.75:~46516~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00001b7c::2021/10/23-08:46:44.213 WARN  [CHANNEL 10.16.1.75:~46516~] failure, status 10054
000010a8.00001b7c::2021/10/23-08:46:44.213 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~46516~ has failed with status 10054'
000010a8.00001b7c::2021/10/23-08:46:44.213 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:47:37.912 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~32776~.
000010a8.00002ba4::2021/10/23-08:47:37.912 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~32776~).
000010a8.00002ba4::2021/10/23-08:47:37.912 INFO  [SV] Got a new incoming stream from 10.16.1.75:~32776~
000010a8.000019b8::2021/10/23-08:47:37.968 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~32784~.
000010a8.00002900::2021/10/23-08:47:37.968 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~32784~).
000010a8.00002900::2021/10/23-08:47:37.968 INFO  [SV] Got a new incoming stream from 10.16.1.75:~32784~
000010a8.00002900::2021/10/23-08:47:37.972 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 542393671, 168636718, 65536'
000010a8.00002900::2021/10/23-08:47:37.972 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00002ba4::2021/10/23-08:47:37.976 WARN  [CHANNEL 10.16.1.75:~32776~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00002ba4::2021/10/23-08:47:37.976 WARN  [CHANNEL 10.16.1.75:~32776~] failure, status 10054
000010a8.00002ba4::2021/10/23-08:47:37.976 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~32776~ has failed with status 10054'
000010a8.00002ba4::2021/10/23-08:47:37.976 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
0000023c.00001cd0::2021/10/23-08:47:43.356 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000019b8::2021/10/23-08:48:06.312 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~33622~.
000010a8.00002ba4::2021/10/23-08:48:06.312 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~33622~).
000010a8.00002ba4::2021/10/23-08:48:06.312 INFO  [SV] Got a new incoming stream from 10.16.1.75:~33622~
000010a8.00002ba4::2021/10/23-08:48:06.312 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 1073741824, 1634926592, 65536'
000010a8.00002ba4::2021/10/23-08:48:06.312 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:48:16.977 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~35274~.
000010a8.00002ba4::2021/10/23-08:48:16.977 INFO  [SV] New real route: local (10.16.1.161:~3343~) to remote  (10.16.1.75:~35274~).
000010a8.00002ba4::2021/10/23-08:48:16.977 INFO  [SV] Got a new incoming stream from 10.16.1.75:~35274~
000010a8.00002ba4::2021/10/23-08:48:16.978 WARN  [CHANNEL 10.16.1.75:~35274~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00002ba4::2021/10/23-08:48:16.979 WARN  [CHANNEL 10.16.1.75:~35274~] failure, status 10054
000010a8.00002ba4::2021/10/23-08:48:16.979 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~35274~ has failed with status 10054'
000010a8.00002ba4::2021/10/23-08:48:16.979 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:48:35.964 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~52634~.
000010a8.00002ba4::2021/10/23-08:48:35.964 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~52634~).
000010a8.00002ba4::2021/10/23-08:48:35.964 INFO  [SV] Got a new incoming stream from 10.16.1.75:~52634~
000010a8.00002ba4::2021/10/23-08:48:35.965 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 1073741824, 1634926592, 65536'
000010a8.00002ba4::2021/10/23-08:48:35.965 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
0000023c.0000258c::2021/10/23-08:48:43.382 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000019b8::2021/10/23-08:48:46.642 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~54548~.
000010a8.00002ba4::2021/10/23-08:48:46.642 INFO  [SV] New real route: local (10.16.1.162:~3343~) to remote  (10.16.1.75:~54548~).
000010a8.00002ba4::2021/10/23-08:48:46.642 INFO  [SV] Got a new incoming stream from 10.16.1.75:~54548~
000010a8.00002ba4::2021/10/23-08:48:46.655 WARN  [CHANNEL 10.16.1.75:~54548~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00002ba4::2021/10/23-08:48:46.655 WARN  [CHANNEL 10.16.1.75:~54548~] failure, status 10054
000010a8.00002ba4::2021/10/23-08:48:46.655 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~54548~ has failed with status 10054'
000010a8.00002ba4::2021/10/23-08:48:46.655 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:48:58.158 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~48536~.
000010a8.00002ba4::2021/10/23-08:48:58.158 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~48536~).
000010a8.00002ba4::2021/10/23-08:48:58.158 INFO  [SV] Got a new incoming stream from 10.16.1.75:~48536~
000010a8.00002ba4::2021/10/23-08:48:58.158 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (30)' because of '[Schannel] Received wrong header info: 1073741824, 1634926592, 65536'
000010a8.00002ba4::2021/10/23-08:48:58.158 WARN  mscs::ListenerWorker::operator (): HrError(0x0000001e)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.000019b8::2021/10/23-08:49:08.547 INFO  [ACCEPT] 0.0.0.0:~3343~: Accepted inbound connection from remote endpoint 10.16.1.75:~54448~.
000010a8.00002ba4::2021/10/23-08:49:08.547 INFO  [SV] New real route: local (10.16.1.163:~3343~) to remote  (10.16.1.75:~54448~).
000010a8.00002ba4::2021/10/23-08:49:08.547 INFO  [SV] Got a new incoming stream from 10.16.1.75:~54448~
000010a8.00002ba4::2021/10/23-08:49:08.589 WARN  [CHANNEL 10.16.1.75:~54448~]/recv: Failed to retrieve the results of overlapped I/O: 10054
000010a8.00002ba4::2021/10/23-08:49:08.589 WARN  [CHANNEL 10.16.1.75:~54448~] failure, status 10054
000010a8.00002ba4::2021/10/23-08:49:08.589 ERR   mscs_security::SchannelSecurityContext::AuthenticateAndAuthorize: (10054)' because of 'channel to remote endpoint 10.16.1.75:~54448~ has failed with status 10054'
000010a8.00002ba4::2021/10/23-08:49:08.589 WARN  mscs::ListenerWorker::operator (): HrError(0x00002746)' because of '[SV] Schannel Authentication or Authorization Failed'
000010a8.00002ba4::2021/10/23-08:49:15.386 INFO  [CSVPRV] ClusterPurgeSnapshots, EXIT
000010a8.00002900::2021/10/23-08:49:31.018 WARN  Unhandled exception on the thread 10496, exception The requested operation is not supported.
0000023c.0000258c::2021/10/23-08:49:43.381 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000258c::2021/10/23-08:50:43.395 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000258c::2021/10/23-08:51:43.401 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000258c::2021/10/23-08:52:43.428 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000bc8::2021/10/23-08:53:43.437 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002ba4::2021/10/23-08:54:31.046 WARN  Unhandled exception on the thread 11172, exception The requested operation is not supported.
0000023c.00000bc8::2021/10/23-08:54:43.445 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000754::2021/10/23-08:55:43.457 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000754::2021/10/23-08:56:43.493 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000017f0::2021/10/23-08:57:43.481 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000017f0::2021/10/23-08:58:43.502 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001b7c::2021/10/23-08:59:31.054 WARN  Unhandled exception on the thread 7036, exception The requested operation is not supported.
0000023c.00000d50::2021/10/23-08:59:43.516 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000d50::2021/10/23-09:00:43.540 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000d50::2021/10/23-09:01:43.544 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001290::2021/10/23-09:02:43.568 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001290::2021/10/23-09:03:43.578 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000009fc::2021/10/23-09:04:31.075 WARN  Unhandled exception on the thread 2556, exception The requested operation is not supported.
0000023c.00002164::2021/10/23-09:04:43.601 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002164::2021/10/23-09:05:43.618 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000574::2021/10/23-09:06:43.650 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000574::2021/10/23-09:07:43.643 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000016b8::2021/10/23-09:08:43.669 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000002f0::2021/10/23-09:09:31.464 WARN  Unhandled exception on the thread 752, exception The requested operation is not supported.
0000023c.000016b8::2021/10/23-09:09:43.671 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000016b8::2021/10/23-09:10:43.678 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000024e4::2021/10/23-09:11:43.695 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000024e4::2021/10/23-09:12:43.711 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000c74::2021/10/23-09:13:43.709 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000081c::2021/10/23-09:14:31.140 WARN  Unhandled exception on the thread 2076, exception The requested operation is not supported.
0000023c.00000c74::2021/10/23-09:14:43.744 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000630::2021/10/23-09:15:43.742 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000630::2021/10/23-09:16:43.754 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000021e0::2021/10/23-09:17:43.758 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.00000db0::2021/10/23-09:17:44.876 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000023c.000021e0::2021/10/23-09:18:43.791 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001670::2021/10/23-09:19:31.162 WARN  Unhandled exception on the thread 5744, exception The requested operation is not supported.
0000023c.000021e0::2021/10/23-09:19:43.784 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002134::2021/10/23-09:20:43.818 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002134::2021/10/23-09:21:43.813 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001bf0::2021/10/23-09:22:43.822 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001bf0::2021/10/23-09:23:43.830 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000002f0::2021/10/23-09:24:31.189 WARN  Unhandled exception on the thread 752, exception The requested operation is not supported.
0000023c.00001810::2021/10/23-09:24:43.858 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001810::2021/10/23-09:25:43.867 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a84::2021/10/23-09:26:43.878 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a84::2021/10/23-09:27:43.886 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000023e0::2021/10/23-09:28:43.894 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000025d0::2021/10/23-09:29:31.224 WARN  Unhandled exception on the thread 9680, exception The requested operation is not supported.
0000023c.000023e0::2021/10/23-09:29:43.901 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000023e0::2021/10/23-09:30:43.908 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.00000db0::2021/10/23-09:31:33.240 INFO  [RES] Network Name <Cluster Name>: AccountAD: Netname's current last logon age is greater than the maximum age. Refresh token will be performed.
0000243c.00000db0::2021/10/23-09:31:33.240 INFO  [RES] Network Name <Cluster Name>: AccountAD: Refreshing token
0000243c.00000db0::2021/10/23-09:31:33.240 INFO  [RES] Network Name <Cluster Name>: Identity: OnRecheckConfig, forcing recheck of configuration
0000243c.00000db0::2021/10/23-09:31:33.240 INFO  [RES] Network Name <Cluster Name>: Identity: Obtaining new token
0000243c.00000db0::2021/10/23-09:31:33.247 INFO  [RES] Network Name: [NNLIB] Priming local KDC cache to \\dc1.domain.local for domain domain.local
0000243c.00000db0::2021/10/23-09:31:33.247 INFO  [RES] Network Name: [NNLIB] PopulateKerbKDCLookupCache - DC flags 0
0000243c.00000db0::2021/10/23-09:31:33.248 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 98, result size 0 (status: 0, subStatus: 0)
0000243c.00000db0::2021/10/23-09:31:33.248 INFO  [RES] Network Name: [NNLIB] Priming local KDC cache to \\dc1.domain.local for domain label domain
0000243c.00000db0::2021/10/23-09:31:33.249 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 86, result size 0 (status: 0, subStatus: 0)
0000243c.00000db0::2021/10/23-09:31:33.299 INFO  [RES] Network Name: [NNLIB] LogonUserCall - LogonUserExEx successful
0000243c.00000db0::2021/10/23-09:31:33.299 INFO  [RES] Network Name <Cluster Name>: Identity: Obtaining Windows Token for Name: db-aag, SamName: db-aag$, Type: Singleton, Result: 0, LastDC: \\dc1.domain.local
0000243c.00000db0::2021/10/23-09:31:33.299 INFO  [RES] Network Name <Cluster Name>: AccountAD: InternalReplyHandler: 0
0000243c.00000db0::2021/10/23-09:31:36.922 INFO  [RES] Network Name <Cluster Name>: Dns: Re-registering DNS records because time '86407' between previous registration and now is greater than '86400'
0000243c.00000db0::2021/10/23-09:31:36.922 INFO  [RES] Network Name <Cluster Name>: Dns: Stopping health check because DNS recheck configuration is needed
0000243c.00000db0::2021/10/23-09:31:36.922 INFO  [RES] Network Name <Cluster Name>: Dns: Dns - Rechecking config internally
0000243c.00000db0::2021/10/23-09:31:36.927 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.00000db0::2021/10/23-09:31:36.927 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.00000db0::2021/10/23-09:31:36.927 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.00000db0::2021/10/23-09:31:36.927 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.00000db0::2021/10/23-09:31:36.928 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.00000db0::2021/10/23-09:31:36.928 DBG   [ClNet]                  DNS Suffix:
0000243c.00000db0::2021/10/23-09:31:36.928 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.00000db0::2021/10/23-09:31:36.928 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.00000db0::2021/10/23-09:31:36.928 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.00000db0::2021/10/23-09:31:36.928 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.00000db0::2021/10/23-09:31:36.928 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.00000db0::2021/10/23-09:31:36.928 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.00000db0::2021/10/23-09:31:36.928 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.00000db0::2021/10/23-09:31:36.928 DBG   [ClNet]                  DNS Suffix:
0000243c.00000db0::2021/10/23-09:31:36.928 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.162 Prefix: 10.16.1.162/24 (Actual address: 10.16.1.162), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB] Network: Cluster Network 1
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]    Dom.N: domain.local
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]  OnlySiteLocal: 0
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.162
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB] Adapter: 3dec0a8e-60fc-4af3-9c0b-72c4c67fcac1
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]   N.Idx: 0
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]    Name: Ethernet
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]    Desc: vmxnet3 Ethernet Adapter
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]   Dom.N:
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.161
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.162
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB]    Intf.Addr: 10.16.1.163
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name: [NNLIB] A.Dom.N: domain.local
0000243c.00000db0::2021/10/23-09:31:36.929 INFO  [RES] Network Name <Cluster Name>: Dns: Registering into DNS Name: db-aag (Type: Singleton)...
0000243c.00000db0::2021/10/23-09:31:36.939 INFO  [RES] Network Name <Cluster Name>: Dns: Impersonating VCO User 'db-aag$' to Update DNS registration.  IsCore? true
0000243c.00000a98::2021/10/23-09:31:36.939 INFO  [RES] Network Name <Cluster Name>: Identity: Get Token Request, currently has a token
0000243c.00000db0::2021/10/23-09:31:36.939 INFO  [RES] Network Name:  [NN] IdentityLocal Begin Impersonating
0000243c.00000db0::2021/10/23-09:31:36.939 INFO  [RES] Network Name: [NNLIB] Network 1: 1 Domain Names, 1 IP Prefixes, 2 DNS Servers
0000243c.00000db0::2021/10/23-09:31:36.939 INFO  [RES] Network Name: [NNLIB] Registering name db-aag on DNS Network: Cluster Network 1, with 2 DNS Servers, 1 Virtual Addresses, 1 Domain Names
0000243c.00000db0::2021/10/23-09:31:36.939 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.30.0.3
0000243c.00000db0::2021/10/23-09:31:36.939 INFO  [RES] Network Name: [NNLIB]    DNS.S: 10.16.1.70
0000243c.00000db0::2021/10/23-09:31:36.939 INFO  [RES] Network Name: [NNLIB]   V.Addr: 10.16.1.162
0000243c.00000db0::2021/10/23-09:31:36.939 INFO  [RES] Network Name: [NNLIB] Registering: db-aag.domain.local
0000243c.00000db0::2021/10/23-09:31:37.020 INFO  [RES] Network Name: [NNLIB] DNS Record there for db-aag.domain.local, proceeding
0000243c.00000db0::2021/10/23-09:31:37.191 INFO  [RES] Network Name: [NNLIB] Registered A records on DNS for fqdn db-aag.domain.local (ipv4Count 1, ipv6Count 0)
0000243c.00000db0::2021/10/23-09:31:37.191 INFO  [RES] Network Name: [NNLIB] Second Phase for DNS Network: Cluster Network 1 (2 DNS Servers)
0000243c.00000db0::2021/10/23-09:31:37.274 INFO  [RES] Network Name: [NNLIB] Modified DNS registration for record type A, owner db-aag.domain.local (registered sets: 1, ipv4Count 1, ipv6Count 0, ptrCount 1)
0000243c.00000db0::2021/10/23-09:31:37.274 INFO  [RES] Network Name:  [NN] IdentityLocal End Impersonating
0000243c.00000db0::2021/10/23-09:31:37.274 INFO  [RES] Network Name <Cluster Name>: Dns: Completed DNS Registration for Name: db-aag (Type: Singleton)
0000243c.00000db0::2021/10/23-09:31:37.274 INFO  [RES] Network Name <Cluster Name>: Dns: Updating status after a DNS registration
0000243c.00000db0::2021/10/23-09:31:37.274 INFO  [RES] Network Name <Cluster Name>: Configuration: Last Dns Update time changed
000010a8.000025d0::2021/10/23-09:31:37.275 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:590 from node 1. Action: causal, Target: CAUS
000010a8.000025d0::2021/10/23-09:31:37.275 INFO  [GUM] Node 1: Processing RequestLock 1:347
000010a8.000011f0::2021/10/23-09:31:37.317 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:188 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-09:31:37.318 INFO  [GUM] Node 1: Processing GrantLock to 1 (sent by 2 gumid: 25804)
000010a8.000025d0::2021/10/23-09:31:37.318 INFO  [GUM] Node 1: executing request locally, gumId:25805, my action: /dm/update, # of updates: 1
000010a8.000025d0::2021/10/23-09:31:37.318 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:591 from node 1. Action: gum/do-update, Target: GUMA
0000243c.00000db0::2021/10/23-09:31:37.361 INFO  [RES] Network Name <Cluster Name>: Configuration: Setting Last Dns Update time in clusdb returned status 0
0000243c.00000db0::2021/10/23-09:31:37.361 INFO  [RES] Network Name <Cluster Name>: Client: Synching with slow operation
0000243c.000009d0::2021/10/23-09:31:37.366 INFO  [ClNet] Adapter Ethernet RFC2863 operational status = 1.
0000243c.000009d0::2021/10/23-09:31:37.366 DBG   [ClNet] Created adapter: DeviceGuid:     3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1
0000243c.000009d0::2021/10/23-09:31:37.366 DBG   [ClNet]                  DeviceName:     vmxnet3 Ethernet Adapter
0000243c.000009d0::2021/10/23-09:31:37.366 DBG   [ClNet]                  ConnectoidName: Ethernet
0000243c.000009d0::2021/10/23-09:31:37.366 DBG   [ClNet]                  Netbios/TCP:    0
0000243c.000009d0::2021/10/23-09:31:37.366 DBG   [ClNet]                  DNS Suffix:
0000243c.000009d0::2021/10/23-09:31:37.366 DBG   [ClNet]                  DnsServer:      10.16.1.70
0000243c.000009d0::2021/10/23-09:31:37.366 DBG   [ClNet]                  DnsServer:      10.30.0.3
0000243c.000009d0::2021/10/23-09:31:37.367 INFO  [ClNet] Adapter Local Area Connection* 10 RFC2863 operational status = 1.
0000243c.000009d0::2021/10/23-09:31:37.367 DBG   [ClNet] Created adapter: DeviceGuid:     C00E030E-8CEB-443B-9001-895A0A7B3C8C
0000243c.000009d0::2021/10/23-09:31:37.367 DBG   [ClNet]                  DeviceName:     Microsoft Failover Cluster Virtual Adapter
0000243c.000009d0::2021/10/23-09:31:37.367 DBG   [ClNet]                  ConnectoidName: Local Area Connection* 10
0000243c.000009d0::2021/10/23-09:31:37.367 DBG   [ClNet]                  Netbios/TCP:    1
0000243c.000009d0::2021/10/23-09:31:37.367 DBG   [ClNet]                  DNS Suffix:
0000243c.000009d0::2021/10/23-09:31:37.367 INFO  [ClNet] Successfully enumerated all adapters and interfaces
0000243c.000009d0::2021/10/23-09:31:37.368 INFO  [RES] Network Name: [NNLIB] Added Network 'Cluster Network 1'
0000243c.000009d0::2021/10/23-09:31:37.368 INFO  [RES] Network Name: [NNLIB] Added adapter 'db-node-primary - Ethernet (3DEC0A8E-60FC-4AF3-9C0B-72C4C67FCAC1)' on network 'Cluster Network 1' (0)
0000243c.000009d0::2021/10/23-09:31:37.368 INFO  [RES] Network Name: [NNLIB] DNS Dynamic Registration Enabled on Adapter: Ethernet, added 2 of 2 DNS Servers (Network: Cluster Network 1 [0])
0000243c.000009d0::2021/10/23-09:31:37.368 INFO  [RES] Network Name: [NNLIB] Exact match found for Matching Addr: 10.16.1.162 Prefix: 10.16.1.162/24 (Actual address: 10.16.1.162), on  adapter: Ethernet, network: 0, adapter suffix: ''
0000243c.000009d0::2021/10/23-09:31:37.368 INFO  [RES] Network Name: [NNLIB] Added general domain name: domain.local to Network Cluster Network 1 [0]
0000243c.000009d0::2021/10/23-09:31:37.368 INFO  [RES] Network Name <Cluster Name>: Client: Final alias is 10.16.1.162
0000243c.000009d0::2021/10/23-09:31:37.368 INFO  [RES] Network Name <Cluster Name>: Client: RegisterFqdnWithLsa - Found FQDN db-aag.domain.local that is already registered with LSA
0000243c.000009d0::2021/10/23-09:31:37.368 INFO  [RES] Network Name <Cluster Name>: Configuration: InternalReplyHandler: 0
0000023c.000017b8::2021/10/23-09:31:43.924 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000017b8::2021/10/23-09:32:43.959 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000006ec::2021/10/23-09:33:43.961 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000025d0::2021/10/23-09:34:30.804 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.000025d0::2021/10/23-09:34:30.804 INFO  [GEM] Node 1:     Target: MISC, Action: Other Messages, Count: 2
000010a8.000025d0::2021/10/23-09:34:30.804 INFO  [GEM] Node 1: ---- 2 Total Messages
000010a8.000025d0::2021/10/23-09:34:31.247 WARN  Unhandled exception on the thread 9680, exception The requested operation is not supported.
0000023c.000006ec::2021/10/23-09:34:43.974 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000025d0::2021/10/23-09:35:13.280 INFO  [Cert] Current cert of type ClusterSChannel from DB is installed, expiration: 2022/10/10-19:22:23.000
000010a8.000025d0::2021/10/23-09:35:13.280 WARN  [Cert] Cert of type ClusterSetSChannel is missing in DB.
000010a8.000025d0::2021/10/23-09:35:13.280 INFO  [Cert] Current cert of type ClusterPKU2U from DB is installed, expiration: 2022/10/10-19:22:24.000
000010a8.000025d0::2021/10/23-09:35:13.280 WARN  [Cert] Cert of type ClusterSetPKU2U is missing in DB.
000010a8.000025d0::2021/10/23-09:35:13.280 INFO  [Cert] Scaleout Master resource is not present on this cluster, not refreshing cluster set certificates
0000023c.00002810::2021/10/23-09:35:43.983 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002810::2021/10/23-09:36:43.996 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ab0::2021/10/23-09:37:44.005 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ab0::2021/10/23-09:38:44.038 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001670::2021/10/23-09:39:31.267 WARN  Unhandled exception on the thread 5744, exception The requested operation is not supported.
0000023c.00001ab0::2021/10/23-09:39:44.039 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001b7c::2021/10/23-09:40:44.061 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001b7c::2021/10/23-09:41:44.075 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ed0::2021/10/23-09:42:44.101 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ed0::2021/10/23-09:43:44.114 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000069c::2021/10/23-09:44:31.297 WARN  Unhandled exception on the thread 1692, exception The requested operation is not supported.
0000023c.00000460::2021/10/23-09:44:44.143 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000460::2021/10/23-09:45:44.142 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002368::2021/10/23-09:46:44.154 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002368::2021/10/23-09:47:44.161 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002368::2021/10/23-09:48:44.171 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001718::2021/10/23-09:49:31.316 WARN  Unhandled exception on the thread 5912, exception The requested operation is not supported.
0000023c.000004e4::2021/10/23-09:49:44.183 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000004e4::2021/10/23-09:50:44.207 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001cd0::2021/10/23-09:51:44.216 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001cd0::2021/10/23-09:52:44.242 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002328::2021/10/23-09:53:44.245 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002bd4::2021/10/23-09:54:31.354 WARN  Unhandled exception on the thread 11220, exception The requested operation is not supported.
0000023c.00002328::2021/10/23-09:54:44.267 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000648::2021/10/23-09:55:44.284 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002bd4::2021/10/23-09:56:01.208 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002bd4::2021/10/23-09:56:01.209 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002bd4::2021/10/23-09:56:01.269 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002bd4::2021/10/23-09:56:01.270 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002bd4::2021/10/23-09:56:01.271 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002bd4::2021/10/23-09:56:01.271 INFO  [API] s_ApiGetQuorumResource final status 0.
00000054.0000235c::2021/10/23-09:56:02.049 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 04:56:02.037
00000054.0000235c::2021/10/23-09:56:12.056 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 04:56:12.053
0000023c.00000648::2021/10/23-09:56:44.311 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000648::2021/10/23-09:57:44.317 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002988::2021/10/23-09:58:44.347 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001718::2021/10/23-09:59:31.374 WARN  Unhandled exception on the thread 5912, exception The requested operation is not supported.
0000023c.00002988::2021/10/23-09:59:44.349 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000970::2021/10/23-10:00:44.362 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000970::2021/10/23-10:01:44.366 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028f4::2021/10/23-10:02:44.390 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028f4::2021/10/23-10:03:44.393 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000d50::2021/10/23-10:04:31.402 WARN  Unhandled exception on the thread 3408, exception The requested operation is not supported.
0000023c.000021e0::2021/10/23-10:04:44.424 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000021e0::2021/10/23-10:05:44.424 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ab0::2021/10/23-10:06:44.438 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ab0::2021/10/23-10:07:44.449 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001ab0::2021/10/23-10:08:44.478 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000724::2021/10/23-10:09:31.652 WARN  Unhandled exception on the thread 1828, exception The requested operation is not supported.
0000023c.00000928::2021/10/23-10:09:44.480 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000928::2021/10/23-10:10:44.514 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000022c8::2021/10/23-10:11:44.504 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000022c8::2021/10/23-10:12:44.520 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000026d0::2021/10/23-10:13:44.525 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002abc::2021/10/23-10:14:31.438 WARN  Unhandled exception on the thread 10940, exception The requested operation is not supported.
0000023c.000026d0::2021/10/23-10:14:44.550 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000005e0::2021/10/23-10:15:44.561 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000005e0::2021/10/23-10:16:44.583 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000005e0::2021/10/23-10:17:44.589 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.00000db0::2021/10/23-10:17:45.194 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000023c.000012e4::2021/10/23-10:18:44.599 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001718::2021/10/23-10:19:31.475 WARN  Unhandled exception on the thread 5912, exception The requested operation is not supported.
0000023c.000012e4::2021/10/23-10:19:44.603 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001a10::2021/10/23-10:20:44.623 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001a10::2021/10/23-10:21:44.618 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000131c::2021/10/23-10:22:44.627 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000131c::2021/10/23-10:23:44.637 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002abc::2021/10/23-10:24:31.487 WARN  Unhandled exception on the thread 10940, exception The requested operation is not supported.
0000023c.0000081c::2021/10/23-10:24:44.657 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000081c::2021/10/23-10:25:44.656 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000081c::2021/10/23-10:26:44.670 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000081c::2021/10/23-10:27:44.667 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000081c::2021/10/23-10:28:44.673 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000070::2021/10/23-10:29:31.523 WARN  Unhandled exception on the thread 112, exception The requested operation is not supported.
0000023c.0000298c::2021/10/23-10:29:44.687 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000298c::2021/10/23-10:30:44.719 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001fcc::2021/10/23-10:31:44.718 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001fcc::2021/10/23-10:32:44.745 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002588::2021/10/23-10:33:44.745 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002578::2021/10/23-10:34:31.100 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.00002578::2021/10/23-10:34:31.100 INFO  [GEM] Node 1: ---- 0 Total Messages
000010a8.00001788::2021/10/23-10:34:31.542 WARN  Unhandled exception on the thread 6024, exception The requested operation is not supported.
0000023c.00002588::2021/10/23-10:34:44.775 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000021f8::2021/10/23-10:35:44.771 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000021f8::2021/10/23-10:36:44.786 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000021f8::2021/10/23-10:37:44.792 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000021f8::2021/10/23-10:38:44.802 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000724::2021/10/23-10:39:31.570 WARN  Unhandled exception on the thread 1828, exception The requested operation is not supported.
0000023c.000021f8::2021/10/23-10:39:44.812 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002a9c::2021/10/23-10:40:44.849 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002a9c::2021/10/23-10:41:44.842 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000019d4::2021/10/23-10:42:44.867 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000019d4::2021/10/23-10:43:44.875 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00001aac::2021/10/23-10:44:31.606 WARN  Unhandled exception on the thread 6828, exception The requested operation is not supported.
0000023c.00002b84::2021/10/23-10:44:44.894 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b84::2021/10/23-10:45:44.895 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b84::2021/10/23-10:46:44.916 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000948::2021/10/23-10:47:44.908 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000948::2021/10/23-10:48:44.918 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002634::2021/10/23-10:49:31.835 WARN  Unhandled exception on the thread 9780, exception The requested operation is not supported.
0000023c.00000b34::2021/10/23-10:49:44.922 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000b34::2021/10/23-10:50:44.950 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002834::2021/10/23-10:51:44.954 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002834::2021/10/23-10:52:44.974 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000005f8::2021/10/23-10:53:44.969 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002b48::2021/10/23-10:54:31.650 WARN  Unhandled exception on the thread 11080, exception The requested operation is not supported.
0000023c.000005f8::2021/10/23-10:54:45.002 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000005f8::2021/10/23-10:55:44.997 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000145c::2021/10/23-10:56:45.022 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000145c::2021/10/23-10:57:45.032 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002940::2021/10/23-10:58:45.047 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000724::2021/10/23-10:59:31.678 WARN  Unhandled exception on the thread 1828, exception The requested operation is not supported.
0000023c.00002940::2021/10/23-10:59:45.058 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002940::2021/10/23-11:00:45.091 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002940::2021/10/23-11:01:45.095 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001cec::2021/10/23-11:02:45.120 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001cec::2021/10/23-11:03:45.124 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002b80::2021/10/23-11:04:31.708 WARN  Unhandled exception on the thread 11136, exception The requested operation is not supported.
0000023c.00001cec::2021/10/23-11:04:45.151 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001cec::2021/10/23-11:05:45.146 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001cec::2021/10/23-11:06:45.171 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008fc::2021/10/23-11:07:45.182 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008fc::2021/10/23-11:08:45.222 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002b48::2021/10/23-11:09:31.718 WARN  Unhandled exception on the thread 11080, exception The requested operation is not supported.
0000023c.0000113c::2021/10/23-11:09:45.222 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000113c::2021/10/23-11:10:45.257 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002844::2021/10/23-11:11:45.260 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002844::2021/10/23-11:12:45.284 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001f80::2021/10/23-11:13:45.292 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002b80::2021/10/23-11:14:31.753 WARN  Unhandled exception on the thread 11136, exception The requested operation is not supported.
0000023c.00001f80::2021/10/23-11:14:45.319 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001f80::2021/10/23-11:15:45.328 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008c8::2021/10/23-11:16:45.355 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008c8::2021/10/23-11:17:45.357 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.00000a98::2021/10/23-11:17:45.493 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000023c.00002a80::2021/10/23-11:18:45.383 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002934::2021/10/23-11:19:31.787 WARN  Unhandled exception on the thread 10548, exception The requested operation is not supported.
0000023c.00002a80::2021/10/23-11:19:45.385 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a0c::2021/10/23-11:20:45.396 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a0c::2021/10/23-11:21:45.405 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a84::2021/10/23-11:22:45.429 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000a84::2021/10/23-11:23:45.439 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002b80::2021/10/23-11:24:31.813 WARN  Unhandled exception on the thread 11136, exception The requested operation is not supported.
0000023c.00000a84::2021/10/23-11:24:45.452 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001210::2021/10/23-11:25:45.460 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001210::2021/10/23-11:26:45.485 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.0000235c::2021/10/23-11:27:37.279 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 06:27:37.263
0000023c.000006d4::2021/10/23-11:27:45.496 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
00000054.0000235c::2021/10/23-11:27:47.295 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 06:27:47.290
00000054.0000235c::2021/10/23-11:27:57.304 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'clean' to 'warning' at 2021-10-23 06:27:57.300
00000054.0000235c::2021/10/23-11:28:07.316 INFO  [RES] SQL Server Availability Group: [hadrag] SQL Server component 'query_processing' health state has been changed from 'warning' to 'clean' at 2021-10-23 06:28:07.310
0000023c.000006d4::2021/10/23-11:28:45.521 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002934::2021/10/23-11:29:31.828 WARN  Unhandled exception on the thread 10548, exception The requested operation is not supported.
0000023c.000006d4::2021/10/23-11:29:45.528 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000006d4::2021/10/23-11:30:45.548 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002134::2021/10/23-11:31:45.549 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002134::2021/10/23-11:32:45.585 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002134::2021/10/23-11:33:45.576 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000266c::2021/10/23-11:34:31.420 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.0000266c::2021/10/23-11:34:31.420 INFO  [GEM] Node 1: ---- 0 Total Messages
000010a8.0000266c::2021/10/23-11:34:31.848 WARN  Unhandled exception on the thread 9836, exception The requested operation is not supported.
0000023c.00002740::2021/10/23-11:34:45.616 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002740::2021/10/23-11:35:45.615 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000026a4::2021/10/23-11:36:45.636 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000026a4::2021/10/23-11:37:45.653 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000026a4::2021/10/23-11:38:45.682 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000018f4::2021/10/23-11:39:31.877 WARN  Unhandled exception on the thread 6388, exception The requested operation is not supported.
0000023c.000026a4::2021/10/23-11:39:45.692 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000026a4::2021/10/23-11:40:45.721 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000026a4::2021/10/23-11:41:45.719 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000013b0::2021/10/23-11:42:45.753 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000013b0::2021/10/23-11:43:45.757 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002808::2021/10/23-11:44:31.905 WARN  Unhandled exception on the thread 10248, exception The requested operation is not supported.
0000023c.000013b0::2021/10/23-11:44:45.781 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b7c::2021/10/23-11:45:45.795 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000025a4::2021/10/23-11:46:22.291 INFO  [CSVREMPRV] ClusterGetAllSnapshotsFromDatabase, EXIT, status:0
000010a8.000025a4::2021/10/23-11:46:22.292 INFO  [CSVPRV] ClusterGetAllSnapshotsFromDatabase: status 0
0000023c.00002b7c::2021/10/23-11:46:45.808 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000005b4::2021/10/23-11:47:45.816 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000005b4::2021/10/23-11:48:45.825 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00000954::2021/10/23-11:49:22.366 INFO  [CSVPRV] ClusterPurgeSnapshots, EXIT
000010a8.00002808::2021/10/23-11:49:32.158 WARN  Unhandled exception on the thread 10248, exception The requested operation is not supported.
0000023c.0000069c::2021/10/23-11:49:45.841 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000069c::2021/10/23-11:50:45.864 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001958::2021/10/23-11:51:45.865 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001958::2021/10/23-11:52:45.891 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001958::2021/10/23-11:53:45.894 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.0000113c::2021/10/23-11:54:31.959 WARN  Unhandled exception on the thread 4412, exception The requested operation is not supported.
0000023c.00002bb4::2021/10/23-11:54:45.926 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002bb4::2021/10/23-11:55:45.924 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001c30::2021/10/23-11:56:45.959 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001c30::2021/10/23-11:57:45.964 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002a74::2021/10/23-11:58:45.984 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002ba8::2021/10/23-11:59:31.986 WARN  Unhandled exception on the thread 11176, exception The requested operation is not supported.
0000023c.00002a74::2021/10/23-11:59:45.981 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002950::2021/10/23-12:00:45.998 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002950::2021/10/23-12:01:46.000 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002950::2021/10/23-12:02:46.028 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002810::2021/10/23-12:03:46.034 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002ba8::2021/10/23-12:04:32.020 WARN  Unhandled exception on the thread 11176, exception The requested operation is not supported.
0000023c.00002810::2021/10/23-12:04:46.046 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008e8::2021/10/23-12:05:46.055 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008e8::2021/10/23-12:06:46.081 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000da4::2021/10/23-12:07:46.089 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000da4::2021/10/23-12:08:46.101 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000025a4::2021/10/23-12:09:32.045 WARN  Unhandled exception on the thread 9636, exception The requested operation is not supported.
0000023c.00001810::2021/10/23-12:09:46.107 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001810::2021/10/23-12:10:46.118 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001810::2021/10/23-12:11:46.127 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001810::2021/10/23-12:12:46.160 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001810::2021/10/23-12:13:46.162 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000025a4::2021/10/23-12:14:32.083 WARN  Unhandled exception on the thread 9636, exception The requested operation is not supported.
0000023c.00001a90::2021/10/23-12:14:46.181 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001a90::2021/10/23-12:15:46.179 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001210::2021/10/23-12:16:46.207 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.000009d0::2021/10/23-12:17:45.806 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000023c.00001210::2021/10/23-12:17:46.205 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002050::2021/10/23-12:18:46.236 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002aa4::2021/10/23-12:19:32.108 WARN  Unhandled exception on the thread 10916, exception The requested operation is not supported.
0000023c.00002050::2021/10/23-12:19:46.229 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000b30::2021/10/23-12:20:46.255 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000b30::2021/10/23-12:21:46.260 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000b30::2021/10/23-12:22:46.283 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000008e8::2021/10/23-12:23:46.286 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002aa4::2021/10/23-12:24:32.119 WARN  Unhandled exception on the thread 10916, exception The requested operation is not supported.
0000023c.000008e8::2021/10/23-12:24:46.306 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000b34::2021/10/23-12:25:46.318 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000b34::2021/10/23-12:26:46.344 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000670::2021/10/23-12:27:46.352 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000670::2021/10/23-12:28:46.382 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002814::2021/10/23-12:29:32.148 WARN  Unhandled exception on the thread 10260, exception The requested operation is not supported.
0000023c.000026f8::2021/10/23-12:29:46.379 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000026f8::2021/10/23-12:30:46.400 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000026f8::2021/10/23-12:31:46.392 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000026f8::2021/10/23-12:32:46.425 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000026f8::2021/10/23-12:33:46.419 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002ba8::2021/10/23-12:34:31.723 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.00002ba8::2021/10/23-12:34:31.723 INFO  [GEM] Node 1: ---- 0 Total Messages
000010a8.00002850::2021/10/23-12:34:32.168 WARN  Unhandled exception on the thread 10320, exception The requested operation is not supported.
0000023c.00000e04::2021/10/23-12:34:46.429 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00000e04::2021/10/23-12:35:46.446 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000124c::2021/10/23-12:36:46.482 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000124c::2021/10/23-12:37:46.484 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002a0c::2021/10/23-12:38:46.504 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002aa4::2021/10/23-12:39:32.199 WARN  Unhandled exception on the thread 10916, exception The requested operation is not supported.
0000023c.00002a0c::2021/10/23-12:39:46.519 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002a0c::2021/10/23-12:39:46.526 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002a0c::2021/10/23-12:40:46.549 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002514::2021/10/23-12:41:46.560 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002514::2021/10/23-12:42:46.580 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000294c::2021/10/23-12:43:46.588 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002aa4::2021/10/23-12:44:32.216 WARN  Unhandled exception on the thread 10916, exception The requested operation is not supported.
0000023c.0000294c::2021/10/23-12:44:46.620 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000081c::2021/10/23-12:45:46.620 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000081c::2021/10/23-12:46:46.647 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001bf0::2021/10/23-12:47:46.646 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001bf0::2021/10/23-12:48:46.653 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002814::2021/10/23-12:49:32.246 WARN  Unhandled exception on the thread 10260, exception The requested operation is not supported.
0000023c.000020b0::2021/10/23-12:49:46.664 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000020b0::2021/10/23-12:50:46.686 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000020b0::2021/10/23-12:51:46.704 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000027ec::2021/10/23-12:52:46.715 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000027ec::2021/10/23-12:53:46.729 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002814::2021/10/23-12:54:32.267 WARN  Unhandled exception on the thread 10260, exception The requested operation is not supported.
0000023c.000027f8::2021/10/23-12:54:46.761 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000027f8::2021/10/23-12:55:46.753 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000027f8::2021/10/23-12:56:46.776 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002bd4::2021/10/23-12:57:46.790 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002bd4::2021/10/23-12:58:46.810 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002814::2021/10/23-12:59:32.299 WARN  Unhandled exception on the thread 10260, exception The requested operation is not supported.
0000023c.00002bd4::2021/10/23-12:59:46.813 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002bd4::2021/10/23-13:00:46.821 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001764::2021/10/23-13:01:46.836 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00001764::2021/10/23-13:02:46.870 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000006d4::2021/10/23-13:03:46.870 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002814::2021/10/23-13:04:32.316 WARN  Unhandled exception on the thread 10260, exception The requested operation is not supported.
0000023c.000006d4::2021/10/23-13:04:46.891 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002880::2021/10/23-13:05:46.891 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000298c::2021/10/23-13:06:46.909 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000298c::2021/10/23-13:07:46.917 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000029d0::2021/10/23-13:08:46.950 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002814::2021/10/23-13:09:32.350 WARN  Unhandled exception on the thread 10260, exception The requested operation is not supported.
0000023c.000029d0::2021/10/23-13:09:47.069 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000029d0::2021/10/23-13:10:47.091 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b18::2021/10/23-13:11:47.092 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002878::2021/10/23-13:12:47.122 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002878::2021/10/23-13:13:47.132 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002814::2021/10/23-13:14:32.653 WARN  Unhandled exception on the thread 10260, exception The requested operation is not supported.
0000023c.0000299c::2021/10/23-13:14:47.164 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000299c::2021/10/23-13:15:47.162 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000299c::2021/10/23-13:16:47.191 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000243c.00000db0::2021/10/23-13:17:46.113 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: CheckIfPasswordIsInSync for mydb1 returned 0
0000023c.0000299c::2021/10/23-13:17:47.200 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000299c::2021/10/23-13:18:47.219 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002814::2021/10/23-13:19:32.404 WARN  Unhandled exception on the thread 10260, exception The requested operation is not supported.
0000023c.0000299c::2021/10/23-13:19:47.216 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000299c::2021/10/23-13:20:47.243 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000012f4::2021/10/23-13:21:47.245 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000012f4::2021/10/23-13:22:47.257 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b24::2021/10/23-13:23:47.270 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002aa4::2021/10/23-13:24:32.422 WARN  Unhandled exception on the thread 10916, exception The requested operation is not supported.
0000023c.00002b24::2021/10/23-13:24:47.288 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b70::2021/10/23-13:25:47.300 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002b70::2021/10/23-13:26:47.322 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002a40::2021/10/23-13:27:47.329 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002a40::2021/10/23-13:28:47.341 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002814::2021/10/23-13:29:32.444 WARN  Unhandled exception on the thread 10260, exception The requested operation is not supported.
0000023c.00002a40::2021/10/23-13:29:47.349 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000017d0::2021/10/23-13:30:47.373 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000017d0::2021/10/23-13:31:47.379 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000040c::2021/10/23-13:32:47.406 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.0000040c::2021/10/23-13:33:47.413 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.000027f4::2021/10/23-13:34:32.036 INFO  [GEM] Node 1: Sent Message Statistics for the past 60 minutes
000010a8.000027f4::2021/10/23-13:34:32.036 INFO  [GEM] Node 1: ---- 0 Total Messages
000010a8.00002da8::2021/10/23-13:34:32.712 WARN  Unhandled exception on the thread 11688, exception The requested operation is not supported.
0000023c.000028ec::2021/10/23-13:34:47.588 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.000028ec::2021/10/23-13:35:47.450 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
0000023c.00002cd8::2021/10/23-13:36:47.477 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002814::2021/10/23-13:37:09.810 WARN  [API] s_ApiOpenResourceEx: Resource Scaleout Master not found, status = 5007
000010a8.00002da8::2021/10/23-13:37:11.623 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002da8::2021/10/23-13:37:11.767 INFO  [API] s_ApiGetQuorumResource final status 0.
00000054.00002c68::2021/10/23-13:37:12.004 WARN  [RHS] Error 2 from resource type control for restype Storage Replica.
00000054.00003338::2021/10/23-13:37:12.046 WARN  [RHS] Error 2 from resource type control for restype Storage Replica.
0000243c.000009d0::2021/10/23-13:37:12.270 INFO  [RES] Network Name:  [NN] NNResTypeCommon::GetPrivateProperties - ResUtilGetProperties status is 0
0000243c.000009d0::2021/10/23-13:37:12.270 INFO  [RES] Network Name:  [NN] NNResTypeCommon::GetPrivateProperties - status is 0
000010a8.00002814::2021/10/23-13:37:12.306 WARN  [RCM] ResourceTypeChaseTheOwnerLoop::DoCall: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
000010a8.00003188::2021/10/23-13:37:12.306 WARN  [RCM] ResourceTypeChaseTheOwnerLoop::DoCall: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
000010a8.00002814::2021/10/23-13:37:12.306 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:592 from node 1. Action: /rcm/mrr/SetResTypePossibleNodes, Target: RCMA
000010a8.00003188::2021/10/23-13:37:12.306 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:593 from node 1. Action: /rcm/mrr/SetResTypePossibleNodes, Target: RCMA
000010a8.00002814::2021/10/23-13:37:12.409 WARN  [RCM] ResourceTypeChaseTheOwnerLoop::DoCall: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
000010a8.00003188::2021/10/23-13:37:12.409 WARN  [RCM] ResourceTypeChaseTheOwnerLoop::DoCall: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
000010a8.00003188::2021/10/23-13:37:12.409 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:594 from node 1. Action: /rcm/mrr/SetResTypePossibleNodes, Target: RCMA
000010a8.00002814::2021/10/23-13:37:12.409 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:595 from node 1. Action: /rcm/mrr/SetResTypePossibleNodes, Target: RCMA
0000023c.00002cd8::2021/10/23-13:37:47.484 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00003188::2021/10/23-13:38:44.119 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00003188::2021/10/23-13:38:44.163 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00003188::2021/10/23-13:38:44.186 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00003188::2021/10/23-13:38:45.270 INFO  [API] s_ApiGetQuorumResource final status 0.
0000023c.00002cd8::2021/10/23-13:38:47.499 INFO  [RES] File Share Witness <File Share Witness>: Querying share protocol info on test file \\clusterwitness\AAGShare\3a2b1162-b1a6-4110-8849-522a1401547c\VerifyShareWriteAccess.txt.
000010a8.00002ad0::2021/10/23-13:38:49.022 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002ad0::2021/10/23-13:38:49.050 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00003188::2021/10/23-13:38:55.109 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00003188::2021/10/23-13:38:55.134 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002ad0::2021/10/23-13:39:01.202 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002ad0::2021/10/23-13:39:01.230 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002ad0::2021/10/23-13:39:01.435 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002ad0::2021/10/23-13:39:02.842 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00003188::2021/10/23-13:39:03.359 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00003188::2021/10/23-13:39:04.881 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00003188::2021/10/23-13:39:06.437 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002ad0::2021/10/23-13:39:06.437 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002ad0::2021/10/23-13:39:06.460 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002ad0::2021/10/23-13:39:06.949 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002ad0::2021/10/23-13:39:12.519 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00002ad0::2021/10/23-13:39:12.545 INFO  [API] s_ApiGetQuorumResource final status 0.
000010a8.00001268::2021/10/23-13:39:19.397 INFO  [CS] PreShutdown notification.
000010a8.00001268::2021/10/23-13:39:19.398 INFO  [CS] Service Stopping...
000010a8.00001268::2021/10/23-13:39:19.398 INFO  [CORE] Node quorum state is 'Successfully formed or joined a cluster'. Form/join status with other nodes is as follows:
000010a8.00001268::2021/10/23-13:39:19.398 INFO  [NODE] Node 1: Farthest reported progress joining with node db-node-secondary (id 2) is: Join Succeeded at time 2021/10/15-09:33:51.359: status 0
000010a8.00001294::2021/10/23-13:39:19.398 INFO  [CORE] Graceful shutdown reported by node db-node-primary, reason ServiceStopReason::SystemPreShutdown (payload 4)
000010a8.00001268::2021/10/23-13:39:19.576 INFO  [DCM] UnregisterSwProvider(exit): HrError(0x00000000)
000010a8.00001268::2021/10/23-13:39:19.576 INFO  [GUM] Node 1: executing request locally, gumId:25806, my action: qm/set-node-weight, # of updates: 1
000010a8.00001268::2021/10/23-13:39:19.576 WARN  [QUORUM] Node 1: weight adjustment not performed. Cannot go below weight count 3 in a hybrid configuration with 2+ nodes
000010a8.00001268::2021/10/23-13:39:19.577 INFO  [DM] An empty single transaction is cancelled 85:85:32601+1::0
000010a8.00001268::2021/10/23-13:39:19.577 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:596 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00001268::2021/10/23-13:39:19.616 INFO  [GUM] Node 1: executing request locally, gumId:25807, my action: /dm/update, # of updates: 1
000010a8.00001268::2021/10/23-13:39:19.616 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:597 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002ad0::2021/10/23-13:39:19.658 INFO  [RCM] rcm::RcmAgent::Unload: [RCM] Shutdown lock acquired, proceeding, initPhase:false StopReason:ServiceStopReason::SystemPreShutdown
000010a8.00002ad0::2021/10/23-13:39:19.658 INFO  [RCM] rcm::RcmAgent::Unload: [RCM] Director node is shutting down, choose new director
000010a8.00002ad0::2021/10/23-13:39:19.659 INFO  [RCM] Sending causal to set new director node 2
000010a8.00002ad0::2021/10/23-13:39:19.659 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:598 from node 1. Action: causal, Target: CAUS
000010a8.00002ad0::2021/10/23-13:39:19.659 INFO  [RCM] Director is set to node 2
000010a8.00002ad0::2021/10/23-13:39:19.659 INFO  [RCM-ClusterInit] Not queuing work item to initialize cluster core as it has already been initialized.
000010a8.00002ad0::2021/10/23-13:39:19.661 INFO  [RCM] rcm::DrainMgr::DrainNode: [DrainMgr] Initiating DrainNode
000010a8.00002ad0::2021/10/23-13:39:19.661 INFO  [RCM] rcm::DrainMgr::ValidateDrainNode: [DrainMgr] Node state:Up. DrainStatus:0. bServiceShutdown:1
000010a8.00002ad0::2021/10/23-13:39:19.661 INFO  [RCM] rcm::DrainMgr::StartDrain: [DrainMgr] Starting Drain.
000010a8.00002ad0::2021/10/23-13:39:19.661 INFO  [RCM] rcm::DrainMgr::UpdateDrainStatus: [DrainMgr] Changing DrainStatus for node "1" to 1
000010a8.00002ad0::2021/10/23-13:39:19.661 INFO  [GUM] Node 1: executing request locally, gumId:25808, my action: /dm/update, # of updates: 1
000010a8.00002ad0::2021/10/23-13:39:19.662 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:599 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002128::2021/10/23-13:39:19.674 INFO  [RCM] Waiting controls thread detected RCM shutting down, exiting
000010a8.00002128::2021/10/23-13:39:19.674 INFO  [RCM] Waiting controls processing thread is shutting down and draining any remaining controls it was monitoring.
000010a8.00002ad0::2021/10/23-13:39:19.703 INFO  [RCM] rcm::DrainMgr::UpdateDrainTarget: [DrainMgr] Changing DrainTarget for node to "-1"
000010a8.00002ad0::2021/10/23-13:39:19.704 INFO  [RCM] rcm::DrainMgr::StartDrain: [DrainMgr] Doing Drain without setting to paused state
000010a8.00002ad0::2021/10/23-13:39:19.704 INFO  [RCM] rcm::RcmGroup::GetGroupMoveContext: (Available Storage)
000010a8.00002ad0::2021/10/23-13:39:19.704 INFO  [RCM] rcm::RcmGroup::GetGroupMoveContext: (Available Storage)
000010a8.00002ad0::2021/10/23-13:39:19.704 INFO  [RCM] rcm::DrainMgr::MoveGroupForDrain: [DrainMgr] Initiating MoveGroupForDrain for group:Available Storage with Flags:0, move count:0
000010a8.00002ad0::2021/10/23-13:39:19.704 INFO  [RCM-plcmt] This node is not director, node 2 is.  Asking others for placement...
000010a8.00002ad0::2021/10/23-13:39:19.704 INFO  [RCM-plcmt] asking node 2 placement decision, attempt 1
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  [RCM-plcmt] done waiting...
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  [RCM-plcmt] Node 2 replied to placement request g=Available Storage tgt=2 wait=false
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  MTimer(GetPlacementFromDirector): [Start to Multitimer_destroyed : 47 ms]
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  MTimer(GetPlacementFromDirector): [Total: 47 ms ( 0 s )]
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  [DrainMgr] placement manager picked node 2 for drain move of group Available Storage
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  [RCM] rcm::DrainMgr::MoveGroupForDrain: [DrainMgr] calling groupMove:Available Storage with flags:0 operationType:1 bBounceBack:0
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  [RCM] rcm::RcmGroup::Move: (Available Storage, 2, MoveType::Drain)
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  [RCM] No need to bring group 'Available Storage' offline before move; state Offline, owner 1.
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  [RCM] rcm::DrainMgr::MoveGroupForDrain: [DrainMgr] returning from MoveGroupForDrain for group:Available Storage with status:0
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  [RCM] rcm::RcmGroup::GetGroupMoveContext: (Cluster Group)
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  [RCM] rcm::RcmGroup::GetGroupMoveContext: (Cluster Group)
000010a8.00002128::2021/10/23-13:39:19.745 INFO  [RCM] rcm::QueuedMovesHolder::RemoveGroup: (Available Storage) GroupBeingMoved: true AllowMoveCancel: false NotifyMoveFailure: false
000010a8.00002ad0::2021/10/23-13:39:19.745 INFO  [RCM] rcm::DrainMgr::MoveGroupForDrain: [DrainMgr] Initiating MoveGroupForDrain for group:Cluster Group with Flags:0, move count:0
000010a8.00002ad0::2021/10/23-13:39:19.746 INFO  [RCM-plcmt] This node is not director, node 2 is.  Asking others for placement...
000010a8.00002ad0::2021/10/23-13:39:19.746 INFO  [RCM-plcmt] asking node 2 placement decision, attempt 1
000010a8.00002128::2021/10/23-13:39:19.746 INFO  [GUM] Node 1: executing request locally, gumId:25809, my action: /rcm/gum/GroupMoveOperation, # of updates: 1
000010a8.00002128::2021/10/23-13:39:19.746 INFO  [RCM] rcm::RcmGum::GroupMoveOperation(1)
000010a8.00002128::2021/10/23-13:39:19.746 INFO  [RCM] move of group Available Storage from db-node-primary(1) to db-node-secondary(2) of type MoveType::Drain is about to succeed, failoverCount=0, lastFailoverTime=1601/01/01-00:00:00.000 targeted=false
000010a8.00002128::2021/10/23-13:39:19.746 INFO  [RCM] rcm::DrainMgr::QueueMoveEvent: [DrainMgr] Queued GroupMoveEvent for Group Available Storage
000010a8.00002128::2021/10/23-13:39:19.746 INFO  MTimer(OneGroupMovetimer): [Total: 0 ms ( 0 s )]
000010a8.00002128::2021/10/23-13:39:19.746 INFO  [RCM] processed 1 group moves, 0 failures
000010a8.00002128::2021/10/23-13:39:19.746 INFO  [DM] An empty single transaction is cancelled 85:85:32603+1::0
000010a8.00002128::2021/10/23-13:39:19.746 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:600 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00002ad0::2021/10/23-13:39:19.784 INFO  [RCM-plcmt] done waiting...
000010a8.00002ad0::2021/10/23-13:39:19.784 INFO  [RCM-plcmt] Node 2 replied to placement request g=Cluster Group tgt=2 wait=false
000010a8.000011f0::2021/10/23-13:39:19.784 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:189 from node 2. Action: causal, Target: CAUS
000010a8.00002ad0::2021/10/23-13:39:19.784 INFO  MTimer(GetPlacementFromDirector): [Start to Multitimer_destroyed : 31 ms]
000010a8.00002ad0::2021/10/23-13:39:19.784 INFO  MTimer(GetPlacementFromDirector): [Total: 31 ms ( 0 s )]
000010a8.00002ad0::2021/10/23-13:39:19.784 INFO  [DrainMgr] placement manager picked node 2 for drain move of group Cluster Group
000010a8.00002ad0::2021/10/23-13:39:19.784 INFO  [RCM] rcm::DrainMgr::MoveGroupForDrain: [DrainMgr] calling queueGroup:Cluster Group with flags:4 operationType:1 bBounceBack:0
000010a8.00002ad0::2021/10/23-13:39:19.784 INFO  [RCM] rcm::RcmGroup::QueueGroup: (Cluster Group, 2, 4)
000010a8.00002ad0::2021/10/23-13:39:19.784 INFO  [RCM] Cluster Group: Added Flags 4 to StatusInformation. New StatusInformation 4
000010a8.000011f0::2021/10/23-13:39:19.784 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:190 from node 2. Action: causal, Target: CAUS
000010a8.00002ad0::2021/10/23-13:39:19.784 INFO  [RCM] rcm::QueuedMovesHolder::AddGroup: Adding group Cluster Group)
000010a8.00002128::2021/10/23-13:39:19.784 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:601 from node 1. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:19.784 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:191 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:19.784 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:192 from node 2. Action: causal, Target: CAUS
000010a8.00002ad0::2021/10/23-13:39:19.785 INFO  [RCM] rcm::DrainMgr::MoveGroupForDrain: [DrainMgr] returning from MoveGroupForDrain for group:Cluster Group with status:0
000010a8.00002ad0::2021/10/23-13:39:19.785 INFO  [RCM] rcm::RcmGroup::GetGroupMoveContext: (mydb1)
000010a8.00002ad0::2021/10/23-13:39:19.785 INFO  [RCM] rcm::RcmGroup::GetGroupMoveContext: (mydb1)
000010a8.00002ad0::2021/10/23-13:39:19.785 INFO  [RCM] rcm::DrainMgr::MoveGroupForDrain: [DrainMgr] Initiating MoveGroupForDrain for group:mydb1 with Flags:0, move count:0
000010a8.00002ad0::2021/10/23-13:39:19.785 INFO  [RCM-plcmt] This node is not director, node 2 is.  Asking others for placement...
000010a8.00002ad0::2021/10/23-13:39:19.785 INFO  [RCM-plcmt] asking node 2 placement decision, attempt 1
000010a8.000015b4::2021/10/23-13:39:19.786 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 0.
000010a8.00002b94::2021/10/23-13:39:19.787 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 0.
000010a8.00002b94::2021/10/23-13:39:19.787 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 0.
000010a8.000015b4::2021/10/23-13:39:19.787 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 0.
000010a8.00000f40::2021/10/23-13:39:19.789 ERR   [API] s_ApiGetNotifyAsync: (5073)' because of 'Shutting down.'
000010a8.00002ad0::2021/10/23-13:39:19.823 INFO  [RCM-plcmt] done waiting...
000010a8.00002ad0::2021/10/23-13:39:19.823 INFO  [RCM-plcmt] Node 2 replied to placement request g=mydb1 tgt=2 wait=false
000010a8.00002ad0::2021/10/23-13:39:19.823 INFO  MTimer(GetPlacementFromDirector): [Start to Multitimer_destroyed : 31 ms]
000010a8.00002ad0::2021/10/23-13:39:19.823 INFO  MTimer(GetPlacementFromDirector): [Total: 31 ms ( 0 s )]
000010a8.00002ad0::2021/10/23-13:39:19.823 INFO  [DrainMgr] placement manager picked node 2 for drain move of group mydb1
000010a8.00002ad0::2021/10/23-13:39:19.823 INFO  [RCM] rcm::DrainMgr::MoveGroupForDrain: [DrainMgr] calling queueGroup:mydb1 with flags:4 operationType:1 bBounceBack:0
000010a8.00002ad0::2021/10/23-13:39:19.823 INFO  [RCM] rcm::RcmGroup::QueueGroup: (mydb1, 2, 4)
000010a8.00002ad0::2021/10/23-13:39:19.823 INFO  [RCM] mydb1: Added Flags 4 to StatusInformation. New StatusInformation 4
000010a8.00002ad0::2021/10/23-13:39:19.824 INFO  [RCM] rcm::QueuedMovesHolder::AddGroup: Adding group mydb1)
000010a8.00000bb4::2021/10/23-13:39:19.824 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:602 from node 1. Action: causal, Target: CAUS
000010a8.00000bb4::2021/10/23-13:39:19.824 ERR   [API] s_ApiGetNotifyAsync: (5073)' because of 'Shutting down.'
0000243c.00001dd8::2021/10/23-13:39:19.825 ERR   [RES] Network Name <mydb1_mydb1>: Error: 0x800706BA in FileServerDefaultShareImpl::ResyncDisks@352.
0000243c.00001dd8::2021/10/23-13:39:19.825 ERR   [RES] Network Name <mydb1_mydb1>: Error: 0x800706BA in FileServerDefaultShareImpl::NotificationThread@528.
000010a8.00001640::2021/10/23-13:39:19.894 INFO  [NETFT] Disabling heartbeats
000010a8.00001268::2021/10/23-13:39:20.660 INFO  [CS] Waiting for resources and groups to stop.
000010a8.00001268::2021/10/23-13:39:21.676 INFO  [CS] Waiting for resources and groups to stop.
000010a8.00001268::2021/10/23-13:39:22.691 INFO  [CS] Waiting for resources and groups to stop.
000010a8.00001268::2021/10/23-13:39:23.692 INFO  [CS] Waiting for resources and groups to stop.
000010a8.00001268::2021/10/23-13:39:24.700 INFO  [CS] Waiting for resources and groups to stop.
000010a8.00002ad0::2021/10/23-13:39:24.794 INFO  [RCM] rcm::DrainMgr::MoveGroupForDrain: [DrainMgr] returning from MoveGroupForDrain for group:mydb1 with status:0
000010a8.00002128::2021/10/23-13:39:24.794 INFO  [RCM-plcmt] This node is not director, node 2 is.  Asking others for placement...
000010a8.00002ad0::2021/10/23-13:39:24.794 INFO  [RCM] rcm::DrainMgr::StartDrain: [DrainMgr] StartDrain returned with Status:0
000010a8.00002ad0::2021/10/23-13:39:24.794 INFO  [RCM] rcm::DrainMgr::DrainNode: [DrainMgr] DrainNode returned with Status:0
000010a8.00002128::2021/10/23-13:39:24.794 INFO  [RCM-plcmt] asking node 2 placement decision, attempt 1
000010a8.00002ad0::2021/10/23-13:39:24.794 INFO  [RCM] rcm::RcmAgent::DrainOnShutdown: [Shutdown] Returned from DrainNode. TimeElapsed:5125
000010a8.00003188::2021/10/23-13:39:24.794 INFO  [RCM] rcm::DrainMgr::ProcessGroupMoveEvent: [DrainMgr] Processing GroupMoveEvent for Group Available Storage
000010a8.00003188::2021/10/23-13:39:24.794 INFO  [RCM] rcm::DrainMgr::GroupOwnershipChangedWorker: [DrainMgr] Handling Group owner changed Group Available Storage src:1 dest:2 MoveType:MoveType::Drain.
000010a8.00003188::2021/10/23-13:39:24.794 INFO  [RCM] rcm::DrainMgr::GroupOwnershipChangedWorker: [DrainMgr] Move of group Available Storage completed from src to 2.
000010a8.00003188::2021/10/23-13:39:24.794 INFO  [RCM] rcm::DrainMgr::GroupMoveSucceeded: [DrainMgr] Group move succeeded for Available Storage
000010a8.00002128::2021/10/23-13:39:24.832 INFO  [RCM-plcmt] done waiting...
000010a8.00002128::2021/10/23-13:39:24.832 INFO  [RCM-plcmt] Node 2 replied to placement request g=Cluster Group tgt=2 wait=false
000010a8.00002128::2021/10/23-13:39:24.832 INFO  MTimer(GetPlacementFromDirector): [Start to Multitimer_destroyed : 31 ms]
000010a8.00002128::2021/10/23-13:39:24.832 INFO  MTimer(GetPlacementFromDirector): [Total: 31 ms ( 0 s )]
000010a8.00002128::2021/10/23-13:39:24.832 INFO  [RCM] placement manager picked node 2 for MoveType::Drain move of group Cluster Group
000010a8.00002128::2021/10/23-13:39:24.833 INFO  [RCM-plcmt] This node is not director, node 2 is.  Asking others for placement...
000010a8.00002128::2021/10/23-13:39:24.833 INFO  [RCM-plcmt] asking node 2 placement decision, attempt 1
000010a8.00002128::2021/10/23-13:39:24.871 INFO  [RCM-plcmt] done waiting...
000010a8.00002128::2021/10/23-13:39:24.871 INFO  [RCM-plcmt] Node 2 replied to placement request g=Cluster Group tgt=2 wait=false
000010a8.00002128::2021/10/23-13:39:24.871 INFO  MTimer(GetPlacementFromDirector): [Start to Multitimer_destroyed : 31 ms]
000010a8.00002128::2021/10/23-13:39:24.871 INFO  MTimer(GetPlacementFromDirector): [Total: 31 ms ( 0 s )]
000010a8.00002128::2021/10/23-13:39:24.871 INFO  [RCM] placement manager picked node 2 for MoveType::Drain move of group Cluster Group
000010a8.00002128::2021/10/23-13:39:24.871 INFO  [RCM-plcmt] This node is not director, node 2 is.  Asking others for placement...
000010a8.00002128::2021/10/23-13:39:24.871 INFO  [RCM-plcmt] asking node 2 placement decision, attempt 1
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] rcm::RcmGroup::DoQueuedMove: (Cluster Group)
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] rcm::RcmGroup::Move: (Cluster Group, 2, MoveType::Drain)
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] rcm::RcmGroup::Move: Bringing group 'Cluster Group' offline first...
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] Res Cluster IP Address: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] TransitionToState(Cluster IP Address) Online-->WaitingToGoOffline.
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (Cluster Group, Online --> Pending)
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] Bringing dependent resource 'Cluster Name' offline before provider resource 'Cluster IP Address'.
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] Res Cluster Name: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] TransitionToState(Cluster Name) Online-->WaitingToGoOffline.
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] Res Cluster Name: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] TransitionToState(Cluster Name) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] 'Cluster IP Address' cannot go offline yet; Dependent Resource 'Cluster Name' is in state OfflineCallIssued.
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] Res Cluster IP Address: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.000030e4::2021/10/23-13:39:24.871 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:603 from node 1. Action: causal, Target: CAUS
000010a8.00003188::2021/10/23-13:39:24.871 INFO  [RCM] rcm::RcmGroup::Offline: deferring offline of quorum resource 'File Share Witness' until all other resources are offline.
000010a8.000030e4::2021/10/23-13:39:24.871 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:604 from node 1. Action: causal, Target: CAUS
0000243c.00000db0::2021/10/23-13:39:24.872 INFO  [RES] Network Name <Cluster Name>: Offline called for resource Cluster Name
000010a8.00000bb4::2021/10/23-13:39:24.872 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'Cluster Name', gen(0) result 997/0.
000010a8.00000bb4::2021/10/23-13:39:24.872 INFO  [RCM] Res Cluster Name: OfflineCallIssued -> OfflinePending( StateUnknown )
000010a8.00000bb4::2021/10/23-13:39:24.872 INFO  [RCM] TransitionToState(Cluster Name) OfflineCallIssued-->OfflinePending.
0000243c.000003e0::2021/10/23-13:39:24.872 INFO  [RES] Network Name <Cluster Name>: Entering Offline thread
0000243c.000003e0::2021/10/23-13:39:24.872 INFO  [RES] Network Name <Cluster Name>: Performing actual offline of resource.
0000243c.000003e0::2021/10/23-13:39:24.872 INFO  [RES] Network Name: Agent: Closing (ed158bf7-8c56-4e3e-9187-15f9c63678a5,AdminShare)
0000243c.00000db0::2021/10/23-13:39:24.872 INFO  [RES] Network Name: Agent: OnClose (ed158bf7-8c56-4e3e-9187-15f9c63678a5,AdminShare)
0000243c.00000db0::2021/10/23-13:39:24.872 INFO  [RES] Network Name <Cluster Name>: AdminShare: Canceling work, state: Closing/Idle
0000243c.00000db0::2021/10/23-13:39:24.872 INFO  [RES] Network Name <Cluster Name>: AdminShare: OnCloseBase, previous state: Initialized/Idle
0000243c.00000db0::2021/10/23-13:39:24.887 INFO  [RES] Network Name: Agent: OnCloseReply (ed158bf7-8c56-4e3e-9187-15f9c63678a5,AdminShare) result: 0
0000243c.00000db0::2021/10/23-13:39:24.887 INFO  [RES] Network Name <Cluster Name>: SyncReplyHandler Configuration, result: 0
0000243c.000003e0::2021/10/23-13:39:24.887 INFO  [RES] Network Name: Agent: Closing (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Configuration)
0000243c.00000db0::2021/10/23-13:39:24.887 INFO  [RES] Network Name: Agent: OnClose (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Configuration)
0000243c.00000db0::2021/10/23-13:39:24.887 INFO  [RES] Network Name <Cluster Name>: Configuration: Canceling work, state: Closing/Idle
0000243c.00000db0::2021/10/23-13:39:24.887 INFO  [RES] Network Name <Cluster Name>: Configuration: OnCloseBase, previous state: Initialized/Idle
0000243c.00000db0::2021/10/23-13:39:24.887 INFO  [RES] Network Name <Cluster Name>: Configuration: Closing... (PreviousState: Initialized, Created: true, Type: Singleton)
0000243c.00000db0::2021/10/23-13:39:24.887 INFO  [RES] Network Name: Agent: Closing (ed158bf7-8c56-4e3e-9187-15f9c63678a5,AccountAD)
0000243c.00000db0::2021/10/23-13:39:24.888 INFO  [RES] Network Name: Agent: Closing (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Dns)
0000243c.000009d0::2021/10/23-13:39:24.888 INFO  [RES] Network Name: Agent: OnClose (ed158bf7-8c56-4e3e-9187-15f9c63678a5,AccountAD)
0000243c.00000db0::2021/10/23-13:39:24.888 INFO  [RES] Network Name: Agent: Closing (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Client)
0000243c.000009d0::2021/10/23-13:39:24.888 INFO  [RES] Network Name: Agent: OnClose (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Dns)
0000243c.00000a98::2021/10/23-13:39:24.888 INFO  [RES] Network Name <Cluster Name>: AccountAD: Canceling work, state: Closing/Idle
0000243c.00000a98::2021/10/23-13:39:24.888 INFO  [RES] Network Name <Cluster Name>: AccountAD: OnCloseBase, previous state: Initialized/Idle
0000243c.00000a98::2021/10/23-13:39:24.888 INFO  [RES] Network Name <Cluster Name>: Dns: Canceling work, state: Closing/Idle
0000243c.00000a98::2021/10/23-13:39:24.888 INFO  [RES] Network Name <Cluster Name>: Dns: OnCloseBase, previous state: Initialized/Idle
0000243c.000009d0::2021/10/23-13:39:24.888 INFO  [RES] Network Name: Agent: OnClose (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Client)
0000243c.000009d0::2021/10/23-13:39:24.888 INFO  [RES] Network Name: Agent: OnCloseReply (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Dns) result: 0
0000243c.000009d0::2021/10/23-13:39:24.888 INFO  [RES] Network Name <Cluster Name>: Client: Canceling work, state: Closing/Idle
0000243c.000009d0::2021/10/23-13:39:24.888 INFO  [RES] Network Name <Cluster Name>: Client: OnCloseBase, previous state: Initialized/Idle
0000243c.000009d0::2021/10/23-13:39:24.888 INFO  [RES] Network Name <Cluster Name>: Configuration: Finish Closing NetName (type Singleton) Module Dns, result 0, remaining... 3 (0)
0000243c.000009d0::2021/10/23-13:39:24.888 INFO  [RES] Network Name: [NNLIB] Removing alias 10.16.1.162 for target db-aag
0000243c.000009d0::2021/10/23-13:39:24.890 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 114, result size 0 (status: 0, subStatus: 0)
0000243c.000009d0::2021/10/23-13:39:24.890 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 114, result size 0 (status: 0, subStatus: 0)
0000243c.000009d0::2021/10/23-13:39:24.890 INFO  [RES] Network Name: [NNLIB] Success on credential operation remove on Account db-aag$, status: 0 (subStatus: 0)
0000243c.000009d0::2021/10/23-13:39:24.890 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 62, result size 0 (status: 0, subStatus: 0)
0000243c.000009d0::2021/10/23-13:39:24.890 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of db-aag.domain.local, status: 0, subStatus: 0
0000243c.000009d0::2021/10/23-13:39:24.891 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 36, result size 0 (status: 0, subStatus: 0)
0000243c.000009d0::2021/10/23-13:39:24.891 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of db-aag, status: 0, subStatus: 0
0000243c.000009d0::2021/10/23-13:39:24.891 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 36, result size 0 (status: 0, subStatus: 0)
0000243c.000009d0::2021/10/23-13:39:24.891 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of db-aag, status: 0, subStatus: 0
0000243c.000009d0::2021/10/23-13:39:24.891 INFO  [RES] Network Name <Cluster Name>: Client: Unregistering netname for multichannel support returned 0
0000243c.000009d0::2021/10/23-13:39:24.892 INFO  [RES] Network Name: Agent: OnCloseReply (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Client) result: 0
0000243c.000009d0::2021/10/23-13:39:24.892 INFO  [RES] Network Name <Cluster Name>: Configuration: Finish Closing NetName (type Singleton) Module Client, result 0, remaining... 2 (0)
0000243c.000009d0::2021/10/23-13:39:24.892 INFO  [RES] Network Name: Agent: Closing (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Netbios)
0000243c.000009d0::2021/10/23-13:39:24.892 INFO  [RES] Network Name: Agent: OnClose (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Netbios)
0000243c.000009d0::2021/10/23-13:39:24.892 INFO  [RES] Network Name <Cluster Name>: Netbios: Canceling work, state: Closing/Idle
0000243c.000009d0::2021/10/23-13:39:24.892 INFO  [RES] Network Name <Cluster Name>: Netbios: OnCloseBase, previous state: Initialized/Idle
0000243c.000009d0::2021/10/23-13:39:24.893 INFO  [RES] Network Name: [NNLIB] Deregistered server name db-aag on transport \Device\NetbiosSmb
0000243c.000009d0::2021/10/23-13:39:24.894 INFO  [RES] Network Name: [NNLIB] Deleted server name: db-aag from all transports
0000243c.000009d0::2021/10/23-13:39:24.894 INFO  [RES] Network Name: [NNLIB] Deleting Server Name for server name: db-aag, ret: 0
0000243c.00002c2c::2021/10/23-13:39:24.894 INFO  [RES] Network Name <Cluster Name>: Netbios: Cleaning up transports
0000243c.000009d0::2021/10/23-13:39:24.894 INFO  [RES] Network Name: Agent: OnCloseReply (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Netbios) result: 0
0000243c.000009d0::2021/10/23-13:39:24.894 INFO  [RES] Network Name <Cluster Name>: Configuration: Finish Closing NetName (type Singleton) Module Netbios, result 0, remaining... 1 (0)
0000243c.00000a98::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: OnCloseReply (ed158bf7-8c56-4e3e-9187-15f9c63678a5,AccountAD) result: 0
0000243c.00000a98::2021/10/23-13:39:24.897 INFO  [RES] Network Name <Cluster Name>: Configuration: Finish Closing NetName (type Singleton) Module AccountAD, result 0, remaining... 0 (0)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: -- listing 5 instances ---------------------------------------------
0000243c.00000db0::2021/10/23-13:39:24.897 INFO  [RES] Network Name <Cluster Name>: Configuration: Closed
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 1763b060-dff9-4961-8280-b1b5c0f92039:
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initialized/Idle (Alive)
0000243c.00000db0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: OnCloseReply (ed158bf7-8c56-4e3e-9187-15f9c63678a5,Configuration) result: 0
0000243c.00000db0::2021/10/23-13:39:24.897 INFO  [RES] Network Name <Cluster Name>: SyncReplyHandler Configuration, result: 0
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
0000243c.000003e0::2021/10/23-13:39:24.897 INFO  [RHS] Resource Cluster Name has come offline. RHS is about to report resource status to RCM.
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: --- 7 modules for instance: df59581d-6cb0-41d3-a597-dbce46545dcd:
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: --- 7 modules for instance: eb44dd7f-7717-4f70-b74f-a2d373c3217a:
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
000010a8.00003188::2021/10/23-13:39:24.897 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'Cluster Name', gen(0) result 0/0.
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
000010a8.00003188::2021/10/23-13:39:24.897 INFO  [RCM] Res Cluster Name: OfflinePending -> OfflineSavingCheckpoints( StateUnknown )
000010a8.00003188::2021/10/23-13:39:24.897 INFO  [RCM] TransitionToState(Cluster Name) OfflinePending-->OfflineSavingCheckpoints.
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
000010a8.00003188::2021/10/23-13:39:24.897 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00003188::2021/10/23-13:39:24.897 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00003188::2021/10/23-13:39:24.897 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: --- 7 modules for instance: ed158bf7-8c56-4e3e-9187-15f9c63678a5:
000010a8.00003188::2021/10/23-13:39:24.897 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id ed158bf7-8c56-4e3e-9187-15f9c63678a5 and name Cluster Name
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id ed158bf7-8c56-4e3e-9187-15f9c63678a5
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource ed158bf7-8c56-4e3e-9187-15f9c63678a5 in RcmResource
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource ed158bf7-8c56-4e3e-9187-15f9c63678a5
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource ed158bf7-8c56-4e3e-9187-15f9c63678a5.
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource ed158bf7-8c56-4e3e-9187-15f9c63678a5.
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource ed158bf7-8c56-4e3e-9187-15f9c63678a5 finished, about to signal Checkpoint completion
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [RCM] Res Cluster Name: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [RCM] TransitionToState(Cluster Name) OfflineSavingCheckpoints-->Offline.
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: --- 7 modules for instance: f70cf510-b293-448c-89c9-9313e8be742c:
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
000010a8.00003188::2021/10/23-13:39:24.897 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:605 from node 1. Action: causal, Target: CAUS
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource ed158bf7-8c56-4e3e-9187-15f9c63678a5
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id ed158bf7-8c56-4e3e-9187-15f9c63678a5 and name Cluster Name
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:24.897 INFO  [RES] Network Name: Agent: -- 0 Orphan modules
000010a8.000015b4::2021/10/23-13:39:24.897 INFO  [RCM] Res Cluster IP Address: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:24.897 INFO  [RCM] TransitionToState(Cluster IP Address) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00000bb4::2021/10/23-13:39:24.897 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:606 from node 1. Action: causal, Target: CAUS
0000023c.00002cd8::2021/10/23-13:39:24.897 INFO  [RES] IP Address <Cluster IP Address>: Taking resource offline...
0000023c.00002cd8::2021/10/23-13:39:24.897 INFO  [RES] IP Address <Cluster IP Address>: Deleting IP address 10.16.1.162.
0000023c.00002cd8::2021/10/23-13:39:24.897 INFO  [RES] IP Address <Cluster IP Address>: Address 10.16.1.162 on adapter vmxnet3 Ethernet Adapter offline.
000010a8.00000bb4::2021/10/23-13:39:24.898 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'Cluster IP Address', gen(0) result 0/0.
000010a8.00000bb4::2021/10/23-13:39:24.898 INFO  [RCM] Res Cluster IP Address: OfflineCallIssued -> OfflineSavingCheckpoints( StateUnknown )
000010a8.00000bb4::2021/10/23-13:39:24.898 INFO  [RCM] TransitionToState(Cluster IP Address) OfflineCallIssued-->OfflineSavingCheckpoints.
000010a8.00000bb4::2021/10/23-13:39:24.898 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00000bb4::2021/10/23-13:39:24.898 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00000bb4::2021/10/23-13:39:24.898 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
000010a8.00000bb4::2021/10/23-13:39:24.898 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id 097424d3-350b-49e4-b07b-c40acd3b4781 and name Cluster IP Address
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id 097424d3-350b-49e4-b07b-c40acd3b4781
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource 097424d3-350b-49e4-b07b-c40acd3b4781 in RcmResource
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource 097424d3-350b-49e4-b07b-c40acd3b4781
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 097424d3-350b-49e4-b07b-c40acd3b4781.
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 097424d3-350b-49e4-b07b-c40acd3b4781.
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource 097424d3-350b-49e4-b07b-c40acd3b4781 finished, about to signal Checkpoint completion
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [RCM] Res Cluster IP Address: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [RCM] TransitionToState(Cluster IP Address) OfflineSavingCheckpoints-->Offline.
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (Cluster Group, Pending --> PartialOnline)
000010a8.00000bb4::2021/10/23-13:39:24.898 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:607 from node 1. Action: causal, Target: CAUS
000010a8.00003188::2021/10/23-13:39:24.898 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:608 from node 1. Action: causal, Target: CAUS
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource 097424d3-350b-49e4-b07b-c40acd3b4781
000010a8.000030e4::2021/10/23-13:39:24.898 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id 097424d3-350b-49e4-b07b-c40acd3b4781 and name Cluster IP Address
000010a8.00003188::2021/10/23-13:39:24.899 DBG   [NETFTAPI] received NsiDeleteInstance for 10.16.1.162
000010a8.00003188::2021/10/23-13:39:24.902 WARN  [NETFTAPI] Failed to query parameters for 10.16.1.162 (status 0x80070490)
000010a8.00003188::2021/10/23-13:39:24.902 DBG   [NETFTAPI] Signaled NetftLocalRemove event for 10.16.1.162
000010a8.00002128::2021/10/23-13:39:24.909 INFO  [RCM-plcmt] done waiting...
000010a8.00002128::2021/10/23-13:39:24.909 INFO  [RCM-plcmt] Node 2 replied to placement request g=mydb1 tgt=2 wait=false
000010a8.00002128::2021/10/23-13:39:24.909 INFO  MTimer(GetPlacementFromDirector): [Start to Multitimer_destroyed : 47 ms]
000010a8.00002128::2021/10/23-13:39:24.909 INFO  MTimer(GetPlacementFromDirector): [Total: 47 ms ( 0 s )]
000010a8.00002128::2021/10/23-13:39:24.909 INFO  [RCM] placement manager picked node 2 for MoveType::Drain move of group mydb1
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] rcm::RcmGroup::DoQueuedMove: (mydb1)
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] rcm::RcmGroup::Move: (mydb1, 2, MoveType::Drain)
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] rcm::RcmGroup::Move: Bringing group 'mydb1' offline first...
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] Res mydb1_mydb1: Online -> WaitingToGoOffline( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] TransitionToState(mydb1_mydb1) Online-->WaitingToGoOffline.
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (mydb1, Online --> Pending)
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] Bringing dependent resource 'mydb1' offline before provider resource 'mydb1_mydb1'.
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] Res mydb1: Online -> WaitingToGoOffline( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] TransitionToState(mydb1) Online-->WaitingToGoOffline.
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] Res mydb1: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] TransitionToState(mydb1) WaitingToGoOffline-->OfflineCallIssued.
000010a8.000030e4::2021/10/23-13:39:24.909 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:609 from node 1. Action: causal, Target: CAUS
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] 'mydb1_mydb1' cannot go offline yet; Dependent Resource 'mydb1' is in state OfflineCallIssued.
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] Res mydb1_mydb1: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] Res mydb1_10.16.1.163: Online -> WaitingToGoOffline( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] TransitionToState(mydb1_10.16.1.163) Online-->WaitingToGoOffline.
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] Bringing dependent resource 'mydb1_mydb1' offline before provider resource 'mydb1_10.16.1.163'.
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] 'mydb1_mydb1' cannot go offline yet; Dependent Resource 'mydb1' is in state OfflineCallIssued.
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] Res mydb1_mydb1: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] 'mydb1_10.16.1.163' cannot go offline yet; Dependent Resource 'mydb1_mydb1' is in state WaitingToGoOffline.
000010a8.000015b4::2021/10/23-13:39:24.909 INFO  [RCM] Res mydb1_10.16.1.163: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.00003188::2021/10/23-13:39:24.910 INFO  [RCM] 'mydb1_mydb1' cannot go offline yet; Dependent Resource 'mydb1' is in state OfflineCallIssued.
000010a8.00003188::2021/10/23-13:39:24.910 INFO  [RCM] Res mydb1_mydb1: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.00003188::2021/10/23-13:39:24.910 INFO  [RCM] 'mydb1_10.16.1.163' cannot go offline yet; Dependent Resource 'mydb1_mydb1' is in state WaitingToGoOffline.
000010a8.00003188::2021/10/23-13:39:24.910 INFO  [RCM] Res mydb1_10.16.1.163: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:24.910 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:610 from node 1. Action: causal, Target: CAUS
00000054.0000074c::2021/10/23-13:39:24.910 ERR   [RES] SQL Server Availability Group <mydb1>: [hadrag] Lease Thread terminated
000010a8.00002b94::2021/10/23-13:39:24.910 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb1', gen(3) result 997/0.
000010a8.00002b94::2021/10/23-13:39:24.910 INFO  [RCM] Res mydb1: OfflineCallIssued -> OfflinePending( StateUnknown )
000010a8.00002b94::2021/10/23-13:39:24.910 INFO  [RCM] TransitionToState(mydb1) OfflineCallIssued-->OfflinePending.
00000054.00002df0::2021/10/23-13:39:24.910 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Connect to SQL Server ...
000010a8.000015b4::2021/10/23-13:39:24.916 ERR   [API] s_ApiGetNotifyAsync: (5073)' because of 'Shutting down.'
000010a8.00000f40::2021/10/23-13:39:24.934 INFO  [RCM] rcm::RcmGroup::DeferredQuorumOffline: Quorum resource can now be offlined.  Rest of group other than pool resources is offline.
000010a8.00000f40::2021/10/23-13:39:24.934 INFO  [RCM] Res File Share Witness: Online -> WaitingToGoOffline( StateUnknown )
000010a8.00000f40::2021/10/23-13:39:24.934 INFO  [RCM] TransitionToState(File Share Witness) Online-->WaitingToGoOffline.
000010a8.00000f40::2021/10/23-13:39:24.934 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (Cluster Group, PartialOnline --> Pending)
000010a8.00000f40::2021/10/23-13:39:24.934 INFO  [RCM] Res File Share Witness: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.00000f40::2021/10/23-13:39:24.934 INFO  [RCM] TransitionToState(File Share Witness) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00002b94::2021/10/23-13:39:24.934 INFO  [QUORUM] Node 1: PreOffline for 3a2b1162-b1a6-4110-8849-522a1401547c
000010a8.000015b4::2021/10/23-13:39:24.934 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:611 from node 1. Action: causal, Target: CAUS
000010a8.00002b94::2021/10/23-13:39:24.934 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:612 from node 1. Action: causal, Target: CAUS
000010a8.00002b94::2021/10/23-13:39:24.934 INFO  [QUORUM] Node 1: quorum is not owned by anyone
0000023c.000030b4::2021/10/23-13:39:24.935 INFO  [RES] File Share Witness <File Share Witness>: Bringing resource offline ...
0000023c.000030b4::2021/10/23-13:39:24.935 INFO  [RES] File Share Witness <File Share Witness>: Resource is offline.
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'File Share Witness', gen(0) result 0/0.
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [RCM] Res File Share Witness: OfflineCallIssued -> OfflineSavingCheckpoints( StateUnknown )
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [RCM] TransitionToState(File Share Witness) OfflineCallIssued-->OfflineSavingCheckpoints.
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [QUORUM] Node 1: PostRelease for 3a2b1162-b1a6-4110-8849-522a1401547c
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:613 from node 1. Action: causal, Target: CAUS
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id 3a2b1162-b1a6-4110-8849-522a1401547c and name File Share Witness
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [QUORUM] Node 1: quorum is not owned by anyone
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id 3a2b1162-b1a6-4110-8849-522a1401547c
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource 3a2b1162-b1a6-4110-8849-522a1401547c in RcmResource
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource 3a2b1162-b1a6-4110-8849-522a1401547c
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource 3a2b1162-b1a6-4110-8849-522a1401547c.
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource 3a2b1162-b1a6-4110-8849-522a1401547c.
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource 3a2b1162-b1a6-4110-8849-522a1401547c finished, about to signal Checkpoint completion
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [RCM] Res File Share Witness: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [RCM] TransitionToState(File Share Witness) OfflineSavingCheckpoints-->Offline.
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [GUM] Node 1: executing request locally, gumId:25810, my action: qm/set-node-weight, # of updates: 1
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (Cluster Group, Pending --> Offline)
000010a8.000015b4::2021/10/23-13:39:24.935 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:614 from node 1. Action: causal, Target: CAUS
000010a8.00000f40::2021/10/23-13:39:24.935 WARN  [QUORUM] Node 1: weight adjustment not performed. Cannot go below weight count 3 in a hybrid configuration with 2+ nodes
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource 3a2b1162-b1a6-4110-8849-522a1401547c
000010a8.000015b4::2021/10/23-13:39:24.935 INFO  [RCM] rcm::QueuedMovesHolder::RemoveGroup: (Cluster Group) GroupBeingMoved: true AllowMoveCancel: false NotifyMoveFailure: false
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id 3a2b1162-b1a6-4110-8849-522a1401547c and name File Share Witness
000010a8.000015b4::2021/10/23-13:39:24.935 INFO  [RCM] Cluster Group: Removed Flags 4 from StatusInformation. New StatusInformation 0
000010a8.00003188::2021/10/23-13:39:24.935 INFO  [RCM] 'mydb1_mydb1' cannot go offline yet; Dependent Resource 'mydb1' is in state OfflinePending.
000010a8.00003188::2021/10/23-13:39:24.935 INFO  [RCM] Res mydb1_mydb1: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.00003188::2021/10/23-13:39:24.935 INFO  [RCM] 'mydb1_10.16.1.163' cannot go offline yet; Dependent Resource 'mydb1_mydb1' is in state WaitingToGoOffline.
000010a8.00003188::2021/10/23-13:39:24.935 INFO  [RCM] Res mydb1_10.16.1.163: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [DM] An empty single transaction is cancelled 85:85:32603+1::0
000010a8.00002b94::2021/10/23-13:39:24.935 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:615 from node 1. Action: causal, Target: CAUS
000010a8.00000f40::2021/10/23-13:39:24.935 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:616 from node 1. Action: gum/do-update, Target: GUMA
00000054.00002df0::2021/10/23-13:39:24.943 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] The connection was established successfully
00000054.00002df0::2021/10/23-13:39:24.945 INFO  [RES] SQL Server Availability Group <mydb1>: [hadrag] Disconnect from SQL Server
00000054.00002df0::2021/10/23-13:39:24.945 INFO  [RES] SQL Server Availability Group: [hadrag] Stopping Health Worker Thread
00000054.00001d04::2021/10/23-13:39:24.945 INFO  [RES] SQL Server Availability Group: [hadrag] Health worker was asked to terminate
000010a8.000030e4::2021/10/23-13:39:24.958 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 234.
000010a8.000015b4::2021/10/23-13:39:24.973 INFO  [GUM] Node 1: executing request locally, gumId:25811, my action: /rcm/gum/GroupMoveOperation, # of updates: 2
000010a8.000015b4::2021/10/23-13:39:24.973 INFO  [RCM] rcm::RcmGum::GroupMoveOperation(1)
000010a8.000015b4::2021/10/23-13:39:24.973 INFO  [RCM] move of group Cluster Group from db-node-primary(1) to db-node-secondary(2) of type MoveType::Drain is about to succeed, failoverCount=1, lastFailoverTime=2021/10/13-10:06:03.966 targeted=true
000010a8.000015b4::2021/10/23-13:39:24.974 INFO  [RCM] rcm::DrainMgr::QueueMoveEvent: [DrainMgr] Queued GroupMoveEvent for Group Cluster Group
000010a8.000015b4::2021/10/23-13:39:24.974 INFO  MTimer(OneGroupMovetimer): [Total: 0 ms ( 0 s )]
000010a8.000015b4::2021/10/23-13:39:24.974 INFO  [RCM] processed 1 group moves, 0 failures
000010a8.000015b4::2021/10/23-13:39:24.974 INFO  [DM] An empty single transaction is cancelled 85:85:32603+1::0
000010a8.000030e4::2021/10/23-13:39:24.974 INFO  [RCM] rcm::DrainMgr::ProcessGroupMoveEvent: [DrainMgr] Processing GroupMoveEvent for Group Cluster Group
000010a8.000030e4::2021/10/23-13:39:24.974 INFO  [RCM] rcm::DrainMgr::GroupOwnershipChangedWorker: [DrainMgr] Handling Group owner changed Group Cluster Group src:1 dest:2 MoveType:MoveType::Drain.
000010a8.000030e4::2021/10/23-13:39:24.974 INFO  [RCM] rcm::DrainMgr::GroupOwnershipChangedWorker: [DrainMgr] Move of group Cluster Group completed from src to 2.
000010a8.000030e4::2021/10/23-13:39:24.974 INFO  [RCM] rcm::DrainMgr::GroupMoveSucceeded: [DrainMgr] Group move succeeded for Cluster Group
000010a8.000015b4::2021/10/23-13:39:24.974 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:617 from node 1. Action: gum/do-update, Target: GUMA
000010a8.00000f40::2021/10/23-13:39:24.998 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 0.
000010a8.000011f0::2021/10/23-13:39:25.012 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:193 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:25.012 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:194 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:25.013 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:195 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:25.013 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:196 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:25.013 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:197 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:25.013 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:198 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:25.013 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:199 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:25.013 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:200 from node 2. Action: causal, Target: CAUS
000010a8.000015b4::2021/10/23-13:39:25.020 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 0.
000010a8.000011f0::2021/10/23-13:39:25.020 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:201 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:25.020 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:202 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:25.021 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:203 from node 2. Action: causal, Target: CAUS
000010a8.000011f0::2021/10/23-13:39:25.021 INFO  [GEM] Node 1: Processing message as part of GemRepair message 2:204 from node 2. Action: causal, Target: CAUS
000010a8.000015b4::2021/10/23-13:39:25.040 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 234.
000010a8.000015b4::2021/10/23-13:39:25.080 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 0.
000010a8.000015b4::2021/10/23-13:39:25.162 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 234.
00000054.0000235c::2021/10/23-13:39:25.169 INFO  [RES] SQL Server Availability Group: [hadrag] SQLMoreResults() returns -1 with following information
00000054.00001d04::2021/10/23-13:39:25.169 INFO  [RES] SQL Server Availability Group: [hadrag] Change diagnostics interval worker is stopped
00000054.0000235c::2021/10/23-13:39:25.170 ERR   [RES] SQL Server Availability Group: [hadrag] ODBC Error: [HY008] [Microsoft][SQL Server Native Client 11.0]Operation canceled (0)
00000054.0000235c::2021/10/23-13:39:25.170 ERR   [RES] SQL Server Availability Group: [hadrag] ODBC Error: [01000] [Microsoft][SQL Server Native Client 11.0][SQL Server]  (0)
00000054.0000235c::2021/10/23-13:39:25.170 INFO  [RES] SQL Server Availability Group: [hadrag] No more diagnostics results
00000054.0000235c::2021/10/23-13:39:25.170 INFO  [RES] SQL Server Availability Group: [hadrag] Diagnostics is stopped
00000054.0000235c::2021/10/23-13:39:25.170 INFO  [RES] SQL Server Availability Group: [hadrag] Disconnect from SQL Server
00000054.0000235c::2021/10/23-13:39:25.178 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event logging is stopped
00000054.0000235c::2021/10/23-13:39:25.182 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event target state:
00000054.0000235c::2021/10/23-13:39:25.182 INFO  [RES] SQL Server Availability Group: [hadrag] Extended Event session summary: dropped buffers = 0, dropped events = 0
00000054.00002df0::2021/10/23-13:39:25.184 INFO  [RES] SQL Server Availability Group: [hadrag] Stopping Change Diagnostics interval Worker Thread
00000054.00002df0::2021/10/23-13:39:25.185 INFO  [RHS] Resource mydb1 has come offline. RHS is about to report resource status to RCM.
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb1', gen(3) result 0/0.
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [RCM] Res mydb1: OfflinePending -> OfflineSavingCheckpoints( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [RCM] TransitionToState(mydb1) OfflinePending-->OfflineSavingCheckpoints.
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Process state change for ClusterResourceOfflineSavingCheckpoints
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 Before syncing post online
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 pushing to the offline resource worker in rcm
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [RCM] rcm::RcmResource::ProcessStateChange: 17993076 finished processing state change for ClusterResourceOfflineSavingCheckpoints
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting core postoffline for resource with id ec9ef420-492a-4291-8edb-8b5330386b8d and name mydb1
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [CORE] mscs::ClusterCore::EmitPostOffline: 17993076 Emmiting checkpointManager postoffline for resource with id ec9ef420-492a-4291-8edb-8b5330386b8d
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Finding resource ec9ef420-492a-4291-8edb-8b5330386b8d in RcmResource
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Calling offline handler for resource ec9ef420-492a-4291-8edb-8b5330386b8d
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 0 registry checkpoints for resource ec9ef420-492a-4291-8edb-8b5330386b8d.
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Finished processing 0 registry checkpoints for resource ec9ef420-492a-4291-8edb-8b5330386b8d.
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Offline handler for resource ec9ef420-492a-4291-8edb-8b5330386b8d finished, about to signal Checkpoint completion
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Acquiring group lock
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [RCM] rcm::RcmResource::NotifySavingCheckpointCompletion: 17993076 Lock acquired, issueing state transition to Offline
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [RCM] Res mydb1: OfflineSavingCheckpoints -> Offline( StateUnknown )
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [RCM] TransitionToState(mydb1) OfflineSavingCheckpoints-->Offline.
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:618 from node 1. Action: causal, Target: CAUS
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [CM] mscs::CheckpointManager::PostOffline: 17993076 Exiting PostOffline for resource ec9ef420-492a-4291-8edb-8b5330386b8d
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [RCM] rcm::RcmResource::EmitPostOffline: 17993076 Emmiting gim postoffline for resource with id ec9ef420-492a-4291-8edb-8b5330386b8d and name mydb1
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [RCM] Res mydb1_mydb1: WaitingToGoOffline -> OfflineCallIssued( StateUnknown )
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [RCM] TransitionToState(mydb1_mydb1) WaitingToGoOffline-->OfflineCallIssued.
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [RCM] 'mydb1_10.16.1.163' cannot go offline yet; Dependent Resource 'mydb1_mydb1' is in state OfflineCallIssued.
000010a8.00002824::2021/10/23-13:39:25.185 INFO  [RCM] Res mydb1_10.16.1.163: WaitingToGoOffline -> WaitingToGoOffline( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [GEM] Node 1: Processing message as part of GemRepair message 1:619 from node 1. Action: causal, Target: CAUS
0000243c.000009d0::2021/10/23-13:39:25.185 INFO  [RES] Network Name <mydb1_mydb1>: Offline called for resource mydb1_mydb1
000010a8.00000f40::2021/10/23-13:39:25.185 ERR   [API] s_ApiGetNotifyAsync: (5073)' because of 'Shutting down.'
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [RCM] HandleMonitorReply: OFFLINERESOURCE for 'mydb1_mydb1', gen(0) result 997/0.
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [RCM] Res mydb1_mydb1: OfflineCallIssued -> OfflinePending( StateUnknown )
000010a8.000015b4::2021/10/23-13:39:25.185 INFO  [RCM] TransitionToState(mydb1_mydb1) OfflineCallIssued-->OfflinePending.
0000243c.000031e4::2021/10/23-13:39:25.185 INFO  [RES] Network Name <mydb1_mydb1>: Entering Offline thread
0000243c.000031e4::2021/10/23-13:39:25.186 INFO  [RES] Network Name <mydb1_mydb1>: Performing actual offline of resource.
0000243c.000031e4::2021/10/23-13:39:25.186 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,AdminShare)
0000243c.000009d0::2021/10/23-13:39:25.186 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,AdminShare)
0000243c.000009d0::2021/10/23-13:39:25.186 INFO  [RES] Network Name <mydb1_mydb1>: AdminShare: Canceling work, state: Closing/Idle
0000243c.000009d0::2021/10/23-13:39:25.186 INFO  [RES] Network Name <mydb1_mydb1>: AdminShare: OnCloseBase, previous state: Initialized/Idle
0000243c.000009d0::2021/10/23-13:39:25.200 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,AdminShare) result: 0
0000243c.000009d0::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: SyncReplyHandler Configuration, result: 0
0000243c.000031e4::2021/10/23-13:39:25.200 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,Configuration)
0000243c.000009d0::2021/10/23-13:39:25.200 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,Configuration)
0000243c.000009d0::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Canceling work, state: Closing/Idle
0000243c.000009d0::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: OnCloseBase, previous state: Initialized/Idle
0000243c.000009d0::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Closing... (PreviousState: Initialized, Created: true, Type: Singleton)
0000243c.000009d0::2021/10/23-13:39:25.200 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,AccountAD)
0000243c.000009d0::2021/10/23-13:39:25.200 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,Dns)
0000243c.000009d0::2021/10/23-13:39:25.200 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,Client)
0000243c.00000a98::2021/10/23-13:39:25.200 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,AccountAD)
0000243c.00000a98::2021/10/23-13:39:25.200 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,Dns)
0000243c.00000a98::2021/10/23-13:39:25.200 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,Client)
0000243c.00002c2c::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: Dns: Canceling work, state: Closing/Idle
0000243c.00002c2c::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: Dns: OnCloseBase, previous state: Initialized/Idle
0000243c.00002c2c::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: Client: Canceling work, state: Closing/Idle
0000243c.00002c2c::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: Client: OnCloseBase, previous state: Initialized/Idle
0000243c.00000a98::2021/10/23-13:39:25.200 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,Dns) result: 0
0000243c.00002c2c::2021/10/23-13:39:25.200 INFO  [RES] Network Name: [NNLIB] Removing alias 10.16.1.163 for target mydb1
0000243c.00000a98::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Closing NetName (type Singleton) Module Dns, result 0, remaining... 3 (0)
0000243c.00000db0::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: Canceling work, state: Closing/Idle
0000243c.00000db0::2021/10/23-13:39:25.200 INFO  [RES] Network Name <mydb1_mydb1>: AccountAD: OnCloseBase, previous state: Initialized/Idle
0000243c.00000a98::2021/10/23-13:39:25.201 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,AccountAD) result: 0
0000243c.00000a98::2021/10/23-13:39:25.201 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Closing NetName (type Singleton) Module AccountAD, result 0, remaining... 2 (0)
0000243c.00002c2c::2021/10/23-13:39:25.202 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 122, result size 0 (status: 0, subStatus: 0)
0000243c.00002c2c::2021/10/23-13:39:25.202 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 122, result size 0 (status: 0, subStatus: 0)
0000243c.00002c2c::2021/10/23-13:39:25.202 INFO  [RES] Network Name: [NNLIB] Success on credential operation remove on Account mydb1$, status: 0 (subStatus: 0)
0000243c.00002c2c::2021/10/23-13:39:25.203 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 70, result size 0 (status: 0, subStatus: 0)
0000243c.00002c2c::2021/10/23-13:39:25.203 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb1.domain.local, status: 0, subStatus: 0
000010a8.00000f40::2021/10/23-13:39:25.203 WARN  [RCM] rcm::ChaseTheOwnerLoop::NoLockIsCallComplete: RCM is shutting down. Not chasing the owner on error 0.
0000243c.00002c2c::2021/10/23-13:39:25.203 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 44, result size 0 (status: 0, subStatus: 0)
0000243c.00002c2c::2021/10/23-13:39:25.203 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb1, status: 0, subStatus: 0
0000243c.00002c2c::2021/10/23-13:39:25.204 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 44, result size 0 (status: 0, subStatus: 0)
0000243c.00002c2c::2021/10/23-13:39:25.204 INFO  [RES] Network Name: [NNLIB] RegisterMachineAlias of mydb1, status: 0, subStatus: 0
0000243c.00002c2c::2021/10/23-13:39:25.204 INFO  [RES] Network Name <mydb1_mydb1>: Client: Unregistering netname for multichannel support returned 0
0000243c.00002c2c::2021/10/23-13:39:25.204 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,Client) result: 0
0000243c.00002c2c::2021/10/23-13:39:25.204 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Closing NetName (type Singleton) Module Client, result 0, remaining... 1 (0)
0000243c.00002c2c::2021/10/23-13:39:25.204 INFO  [RES] Network Name: Agent: Closing (1763b060-dff9-4961-8280-b1b5c0f92039,Netbios)
0000243c.00002c2c::2021/10/23-13:39:25.204 INFO  [RES] Network Name: Agent: OnClose (1763b060-dff9-4961-8280-b1b5c0f92039,Netbios)
0000243c.00002c2c::2021/10/23-13:39:25.204 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: Canceling work, state: Closing/Idle
0000243c.00002c2c::2021/10/23-13:39:25.204 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: OnCloseBase, previous state: Initialized/Idle
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: [NNLIB] Deregistered server name mydb1 on transport \Device\NetbiosSmb
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: [NNLIB] Deleted server name: mydb1 from all transports
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: [NNLIB] Deleting Server Name for server name: mydb1, ret: 0
0000243c.00000a98::2021/10/23-13:39:25.206 INFO  [RES] Network Name <mydb1_mydb1>: Netbios: Cleaning up transports
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,Netbios) result: 0
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Finish Closing NetName (type Singleton) Module Netbios, result 0, remaining... 0 (0)
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: -- listing 5 instances ---------------------------------------------
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 1763b060-dff9-4961-8280-b1b5c0f92039:
0000243c.000009d0::2021/10/23-13:39:25.206 INFO  [RES] Network Name <mydb1_mydb1>: Configuration: Closed
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (Alive)
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (Alive)
0000243c.000009d0::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: OnCloseReply (1763b060-dff9-4961-8280-b1b5c0f92039,Configuration) result: 0
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Initialized/Idle (Alive)
0000243c.000009d0::2021/10/23-13:39:25.206 INFO  [RES] Network Name <mydb1_mydb1>: SyncReplyHandler Configuration, result: 0
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Closing/Ending (Alive)
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Closing/Ending (Alive)
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Closing/Ending (Alive)
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: --- 7 modules for instance: df59581d-6cb0-41d3-a597-dbce46545dcd:
0000243c.00002c2c::2021/10/23-13:39:25.206 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (A