santhoshct/KAFKA-18416.md Secret

## KAFKA-18416.md

      
    Raw
  

              KAFKA-18416.md
            
          
    Flaky Test Report for 2025-01-08

This report was run on 2025-01-08 08:29:17 UTC
Most Problematic Tests

Found 2 tests that have been quarantined for 7 days and are still failing frequently.

Class Test Case Failure Rate Build Scans Link
org.apache.kafka.clients.consumer.internals.AbstractCoordinatorTest ↗️
testWakeupAfterSyncGroupReceivedExternalCompletion() 39.47% 76 ↗️
testWakeupAfterSyncGroupReceived() 6.58% 76 ↗️
testWakeupAfterSyncGroupSentExternalCompletion() 2.63% 76 ↗️
kafka.api.SaslPlainPlaintextConsumerTest ↗️
testCoordinatorFailover(String, String)[2] 11.11% 18 ↗️


Detailed Execution History
org.apache.kafka.clients.consumer.internals.AbstractCoordinatorTest


Days Quarantined: 7
Recent Failure Rate: 44.74%
Total Runs: 76
Build Outcomes: Passed: 42 | Failed: 0 | Flaky: 34

testCoordinatorFailover(String, String)[2]

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-08 02:19  passed     b2q4jiy2p6ezw
2025-01-08 02:19  passed     zxsq4ge5rrl7u
2025-01-07 22:05  passed     yslaztayeyruy
2025-01-07 22:05  passed     2uu563sm3i364
2025-01-07 19:47  flaky      woyojutdzsjv4

testCoordinatorFailover(String, String)[2]

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-08 02:19  passed     b2q4jiy2p6ezw
2025-01-08 02:19  passed     zxsq4ge5rrl7u
2025-01-07 22:05  passed     yslaztayeyruy
2025-01-07 22:05  passed     2uu563sm3i364
2025-01-07 19:47  flaky      woyojutdzsjv4

testCoordinatorFailover(String, String)[2]

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-08 02:19  passed     b2q4jiy2p6ezw
2025-01-08 02:19  passed     zxsq4ge5rrl7u
2025-01-07 22:05  passed     yslaztayeyruy
2025-01-07 22:05  passed     2uu563sm3i364
2025-01-07 19:47  passed     woyojutdzsjv4

kafka.api.SaslPlainPlaintextConsumerTest


Days Quarantined: 7
Recent Failure Rate: 11.11%
Total Runs: 18
Build Outcomes: Passed: 16 | Failed: 0 | Flaky: 2

testCoordinatorFailover(String, String)[2]

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-05 01:11  passed     nkt3wjtrgwsjm
2025-01-05 01:11  passed     mwu4pupemqgfo
2025-01-04 21:36  passed     e3sbefg6bhgdo
2025-01-04 21:36  passed     xh6bwccibkmrg
2025-01-04 01:05  passed     gukau5edyxs4c


Flaky Test Regressions

No flaky test regressions found.
Persistently Failing/Flaky Tests

Found 2 tests that have been consistently failing or flaky.

Test Class Test Case Failure Rate Total Runs Failed/Flaky Link
kafka.api.PlaintextAdminIntegrationTest ↗️
testConsumerGroups(String, String)[2] 30.30% 66 20 ↗️
testConsumerGroupsDeprecatedConsumerGroupState(String, String)[2] 27.27% 66 18 ↗️
org.apache.kafka.clients.consumer.internals.ApplicationEventHandlerTest ↗️
testRecordApplicationEventQueueSize() 24.24% 66 16 ↗️


Detailed Execution History
kafka.api.PlaintextAdminIntegrationTest


Overall Failure Rate: 50.00%
Total Executions: 66
Failed/Flaky Executions: 33

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-08 02:27  passed     azochyp4jnkdk
2025-01-08 02:26  passed     jjhpyxbr4sjsu
2025-01-07 22:13  passed     xn4schqtcwvta
2025-01-07 22:12  passed     37dtf3fsao2ka
2025-01-07 19:55  passed     v66x5aicrqo2w

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-08 02:27  passed     azochyp4jnkdk
2025-01-08 02:26  passed     jjhpyxbr4sjsu
2025-01-07 22:13  passed     xn4schqtcwvta
2025-01-07 22:12  passed     37dtf3fsao2ka
2025-01-07 19:55  passed     v66x5aicrqo2w

org.apache.kafka.clients.consumer.internals.ApplicationEventHandlerTest


Overall Failure Rate: 24.24%
Total Executions: 66
Failed/Flaky Executions: 16

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-08 02:27  passed     azochyp4jnkdk
2025-01-08 02:26  flaky      jjhpyxbr4sjsu
2025-01-07 22:13  passed     xn4schqtcwvta
2025-01-07 22:12  passed     37dtf3fsao2ka
2025-01-07 19:55  passed     v66x5aicrqo2w


Cleared Tests (Ready for Unquarantine)

Found 5 test classes with 5 test methods that have been consistently passing. These tests could be candidates for removing quarantine annotations at either class or method level.

Test Class Test Method Success Rate Total Runs Recent Status Link
org.apache.kafka.connect.integration.OffsetsApiIntegrationTest ↗️
Class Overall 98.68% 76 75 passed 
testGetSinkConnectorOffsetsDifferentKafkaClusterTargeted() 98.68% 76 passed ↗️
 
kafka.test.api.ShareConsumerTest ↗️
Class Overall 98.68% 76 75 passed 
testAcknowledgementCommitCallbackInvalidRecordStateException(String)[1] 98.68% 76 passed ↗️
 
kafka.network.DynamicConnectionQuotaTest ↗️
Class Overall 96.05% 76 73 passed 
testDynamicConnectionQuota(String)[1] 96.05% 76 passed ↗️
 
org.apache.kafka.tiered.storage.integration.TransactionsWithTieredStoreTest ↗️
Class Overall 94.44% 18 17 passed 
testReadCommittedConsumerShouldNotSeeUndecidedData(String, String)[2] 94.44% 18 passed ↗️
 
kafka.api.SaslPlainPlaintextConsumerTest ↗️
Class Overall 88.89% 18 16 passed 
testCoordinatorFailover(String, String)[2] 88.89% 18 passed ↗️
 

Detailed Test Method History
org.apache.kafka.connect.integration.OffsetsApiIntegrationTest


Overall Success Rate: 98.68%
Total Executions: 76
Consecutive Successful Runs: 75

testGetSinkConnectorOffsetsDifferentKafkaClusterTargeted()


Success Rate: 98.68%
Total Runs: 76

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-08 02:19  passed     b2q4jiy2p6ezw
2025-01-08 02:19  passed     zxsq4ge5rrl7u
2025-01-07 22:05  passed     yslaztayeyruy
2025-01-07 22:05  passed     2uu563sm3i364
2025-01-07 19:47  passed     woyojutdzsjv4

kafka.test.api.ShareConsumerTest


Overall Success Rate: 98.68%
Total Executions: 76
Consecutive Successful Runs: 75

testAcknowledgementCommitCallbackInvalidRecordStateException(String)[1]


Success Rate: 98.68%
Total Runs: 76

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-08 02:19  passed     b2q4jiy2p6ezw
2025-01-08 02:19  passed     zxsq4ge5rrl7u
2025-01-07 22:05  passed     yslaztayeyruy
2025-01-07 22:05  passed     2uu563sm3i364
2025-01-07 19:47  passed     woyojutdzsjv4

kafka.network.DynamicConnectionQuotaTest


Overall Success Rate: 96.05%
Total Executions: 76
Consecutive Successful Runs: 73

testDynamicConnectionQuota(String)[1]


Success Rate: 96.05%
Total Runs: 76

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-08 02:19  passed     b2q4jiy2p6ezw
2025-01-08 02:19  passed     zxsq4ge5rrl7u
2025-01-07 22:05  passed     yslaztayeyruy
2025-01-07 22:05  passed     2uu563sm3i364
2025-01-07 19:47  passed     woyojutdzsjv4

org.apache.kafka.tiered.storage.integration.TransactionsWithTieredStoreTest


Overall Success Rate: 94.44%
Total Executions: 18
Consecutive Successful Runs: 17

testReadCommittedConsumerShouldNotSeeUndecidedData(String, String)[2]


Success Rate: 94.44%
Total Runs: 18

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-05 01:11  passed     nkt3wjtrgwsjm
2025-01-05 01:11  passed     mwu4pupemqgfo
2025-01-04 21:36  passed     e3sbefg6bhgdo
2025-01-04 21:36  passed     xh6bwccibkmrg
2025-01-04 01:05  passed     gukau5edyxs4c

kafka.api.SaslPlainPlaintextConsumerTest


Overall Success Rate: 88.89%
Total Executions: 18
Consecutive Successful Runs: 16

testCoordinatorFailover(String, String)[2]


Success Rate: 88.89%
Total Runs: 18

Recent Executions:
Date/Time (UTC)      Outcome    Build ID
--------------------------------------------
2025-01-05 01:11  passed     nkt3wjtrgwsjm
2025-01-05 01:11  passed     mwu4pupemqgfo
2025-01-04 21:36  passed     e3sbefg6bhgdo
2025-01-04 21:36  passed     xh6bwccibkmrg
2025-01-04 01:05  passed     gukau5edyxs4c
Class	Test Case	Failure Rate	Build Scans	Link
org.apache.kafka.clients.consumer.internals.AbstractCoordinatorTest				↗️
	testWakeupAfterSyncGroupReceivedExternalCompletion()	39.47%	76	↗️
	testWakeupAfterSyncGroupReceived()	6.58%	76	↗️
	testWakeupAfterSyncGroupSentExternalCompletion()	2.63%	76	↗️
kafka.api.SaslPlainPlaintextConsumerTest				↗️
	testCoordinatorFailover(String, String)[2]	11.11%	18	↗️
Test Class	Test Case	Failure Rate	Total Runs	Failed/Flaky	Link
kafka.api.PlaintextAdminIntegrationTest					↗️
	testConsumerGroups(String, String)[2]	30.30%	66	20	↗️
	testConsumerGroupsDeprecatedConsumerGroupState(String, String)[2]	27.27%	66	18	↗️
org.apache.kafka.clients.consumer.internals.ApplicationEventHandlerTest					↗️
	testRecordApplicationEventQueueSize()	24.24%	66	16	↗️
Test Class	Test Method	Success Rate	Total Runs	Recent Status	Link
org.apache.kafka.connect.integration.OffsetsApiIntegrationTest					↗️
	Class Overall	98.68%	76	75 passed
	testGetSinkConnectorOffsetsDifferentKafkaClusterTargeted()	98.68%	76	passed	↗️

kafka.test.api.ShareConsumerTest					↗️
	Class Overall	98.68%	76	75 passed
	testAcknowledgementCommitCallbackInvalidRecordStateException(String)[1]	98.68%	76	passed	↗️

kafka.network.DynamicConnectionQuotaTest					↗️
	Class Overall	96.05%	76	73 passed
	testDynamicConnectionQuota(String)[1]	96.05%	76	passed	↗️

org.apache.kafka.tiered.storage.integration.TransactionsWithTieredStoreTest					↗️
	Class Overall	94.44%	18	17 passed
	testReadCommittedConsumerShouldNotSeeUndecidedData(String, String)[2]	94.44%	18	passed	↗️

kafka.api.SaslPlainPlaintextConsumerTest					↗️
	Class Overall	88.89%	18	16 passed
	testCoordinatorFailover(String, String)[2]	88.89%	18	passed	↗️