Skip to content

Merge pull request #3200 from YutingZhang-A/support-to-execlude-somes… #957

Merge pull request #3200 from YutingZhang-A/support-to-execlude-somes…

Merge pull request #3200 from YutingZhang-A/support-to-execlude-somes… #957

Triggered via push January 9, 2025 17:43
Status Failure
Total duration 15m 10s
Artifacts 3

test.yml

on: push
Matrix Preparation
2s
Matrix Preparation
Matrix: build
Fit to window
Zoom out
Zoom in

Annotations

12 errors and 10 warnings
22, oracle, ubuntu, UTC, fr_FR
Process completed with exit code 1.
11, microsoft, ubuntu, Pacific/Chatham, ru_RU: EfficientPriorityParallelizationTest2.java#L279
0,0sec test.priority.parallel.EfficientPriorityParallelizationTest2 > verifyThatSlowMethodStartedFirstAndEndedLast java.lang.AssertionError: All the test two methods should run between when test one starts and ends. Start Event: EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 478908450, Method name: slowMethod, Time of event: 2025-01-10 07:37:59.167, Thread ID: 7040}. In between events: [EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodA, Time of event: 2025-01-10 07:37:59.166, Thread ID: 7041}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodA, Time of event: 2025-01-10 07:37:59.666, Thread ID: 7041}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodA, Time of event: 2025-01-10 07:37:59.716, Thread ID: 7041}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodB, Time of event: 2025-01-10 07:38:00.217, Thread ID: 7041}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodB, Time of event: 2025-01-10 07:38:00.717, Thread ID: 7041}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodB, Time of event: 2025-01-10 07:38:00.767, Thread ID: 7041}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodC, Time of event: 2025-01-10 07:38:01.267, Thread ID: 7041}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodC, Time of event: 2025-01-10 07:38:01.768, Thread ID: 7041}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodC, Time of event: 2025-01-10 07:38:01.818, Thread ID: 7041}]. Final event: EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 478908450, Method name: slowMethod, Time of event: 2025-01-10 07:38:03.668, Thread ID: 7040} expected [true] but found [false] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1590) at org.testng.Assert.assertTrue(Assert.java:57) at test.thread.parallelization.BaseParallelizationTest.verifyEventsOccurBetween(BaseParallelizationTest.java:231) at test.priority.parallel.EfficientPriorityParallelizationTest2.verifyThatSlowMethodStartedFirstAndEndedLast(EfficientPriorityParallelizationTest2.java:279)
11, microsoft, ubuntu, Pacific/Chatham, ru_RU: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///home/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
11, microsoft, ubuntu, Pacific/Chatham, ru_RU
Unknown error
21, corretto, windows, UTC, fr_FR, stress JIT: HookableTest.java#L47
0,2sec test.hook.HookableTest > hookSuccess[2](class test.hook.samples.HookSuccessTimeoutSample, Regular test With Timeouts (GITHUB-599), true) java.lang.AssertionError: Expecting ArrayList: [] to contain: ["verify"] but could not find the following element(s): ["verify"] at test.hook.HookableTest.hookSuccess(HookableTest.java:47)
21, corretto, windows, UTC, fr_FR, stress JIT: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///D:/a/testng/testng/testng-core/build/reports/tests/test/index.html
21, corretto, windows, UTC, fr_FR, stress JIT
Unknown error
21, temurin, same hashcode, macos, UTC, ru_RU, stress JIT: DataProviderWithFactoryFailedReporterTest.java#L50
0,0sec test.failedreporter.issue2517.DataProviderWithFactoryFailedReporterTest > failedMethodWithDataProviderAndFactoryShouldHaveInvocationNumbers java.io.FileNotFoundException: /var/folders/ml/x_tvfgn50_s7p67dm1ypcqqm0000gn/T/testng-tmp-69216345981805165397818/testng-failed.xml (No such file or directory) at java.base/java.io.FileInputStream.open(FileInputStream.java:213) at java.base/java.io.FileInputStream.<init>(FileInputStream.java:152) at java.base/java.io.FileReader.<init>(FileReader.java:75) at test.SimpleBaseTest$Companion.grep(SimpleBaseTest.kt:345) at test.failedreporter.issue2517.DataProviderWithFactoryFailedReporterTest.runAssertions(DataProviderWithFactoryFailedReporterTest.java:50) at test.failedreporter.issue2517.DataProviderWithFactoryFailedReporterTest.testFailedReporter(DataProviderWithFactoryFailedReporterTest.java:36) at test.failedreporter.issue2517.DataProviderWithFactoryFailedReporterTest.failedMethodWithDataProviderAndFactoryShouldHaveInvocationNumbers(DataProviderWithFactoryFailedReporterTest.java:28)
21, temurin, same hashcode, macos, UTC, ru_RU, stress JIT: DataProviderWithFactoryMultiFailedReporterTest.java#L50
0,0sec test.failedreporter.issue2521.DataProviderWithFactoryMultiFailedReporterTest > multiFailedMethodWithDataProviderAndFactoryShouldHaveInvocationNumbers java.io.FileNotFoundException: /var/folders/ml/x_tvfgn50_s7p67dm1ypcqqm0000gn/T/testng-tmp-7018742451207591503698/testng-failed.xml (No such file or directory) at java.base/java.io.FileInputStream.open(FileInputStream.java:213) at java.base/java.io.FileInputStream.<init>(FileInputStream.java:152) at java.base/java.io.FileReader.<init>(FileReader.java:75) at test.SimpleBaseTest$Companion.grep(SimpleBaseTest.kt:345) at test.failedreporter.issue2521.DataProviderWithFactoryMultiFailedReporterTest.runAssertions(DataProviderWithFactoryMultiFailedReporterTest.java:50) at test.failedreporter.issue2521.DataProviderWithFactoryMultiFailedReporterTest.testFailedReporter(DataProviderWithFactoryMultiFailedReporterTest.java:36) at test.failedreporter.issue2521.DataProviderWithFactoryMultiFailedReporterTest.multiFailedMethodWithDataProviderAndFactoryShouldHaveInvocationNumbers(DataProviderWithFactoryMultiFailedReporterTest.java:28)
21, temurin, same hashcode, macos, UTC, ru_RU, stress JIT: IssueTest.java#L28
1,9sec test.factory.issue326.IssueTest > testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance java.lang.AssertionError: Expecting actual: 1075L to be less than or equal to: 1000L at test.factory.issue326.IssueTest.testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance(IssueTest.java:28)
21, temurin, same hashcode, macos, UTC, ru_RU, stress JIT: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
Matrix Preparation
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
17, zulu, ubuntu, Pacific/Chatham, de_DE, stress JIT
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
17, zulu, ubuntu, Pacific/Chatham, de_DE, stress JIT
Gradle Build Scan: https://gradle.com/s/63yn4wi5whv4c
11, microsoft, ubuntu, Pacific/Chatham, ru_RU
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
11, microsoft, ubuntu, Pacific/Chatham, ru_RU
Gradle Build Scan: https://gradle.com/s/isvlj6x3lu5j2
21, liberica, ubuntu, UTC, de_DE
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
21, liberica, ubuntu, UTC, de_DE
Gradle Build Scan: https://gradle.com/s/qqvogb2xys3fi
21, corretto, windows, UTC, fr_FR, stress JIT
Gradle Build Scan: https://gradle.com/s/fruzkghg6bujw
11, corretto, windows, UTC, de_DE, stress JIT
Gradle Build Scan: https://gradle.com/s/h7bwrdkj4tf5a
21, temurin, same hashcode, macos, UTC, ru_RU, stress JIT
Gradle Build Scan: https://gradle.com/s/qmib564hxrcpe

Artifacts

Produced during runtime
Name Size
build-reports---
574 KB
build-reports---1736444624
580 KB
build-reports---1736444629
569 KB