Merge pull request #3200 from YutingZhang-A/support-to-execlude-somes… #957
test.yml
on: push
Matrix Preparation
2s
Matrix: build
Annotations
12 errors and 10 warnings
22, oracle, ubuntu, UTC, fr_FR
Process completed with exit code 1.
|
11, microsoft, ubuntu, Pacific/Chatham, ru_RU:
EfficientPriorityParallelizationTest2.java#L279
0,0sec test.priority.parallel.EfficientPriorityParallelizationTest2 > verifyThatSlowMethodStartedFirstAndEndedLast
java.lang.AssertionError: All the test two methods should run between when test one starts and ends.
Start Event: EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 478908450, Method name: slowMethod, Time of event: 2025-01-10 07:37:59.167, Thread ID: 7040}.
In between events: [EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodA, Time of event: 2025-01-10 07:37:59.166, Thread ID: 7041}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodA, Time of event: 2025-01-10 07:37:59.666, Thread ID: 7041}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodA, Time of event: 2025-01-10 07:37:59.716, Thread ID: 7041}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodB, Time of event: 2025-01-10 07:38:00.217, Thread ID: 7041}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodB, Time of event: 2025-01-10 07:38:00.717, Thread ID: 7041}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodB, Time of event: 2025-01-10 07:38:00.767, Thread ID: 7041}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodC, Time of event: 2025-01-10 07:38:01.267, Thread ID: 7041}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodC, Time of event: 2025-01-10 07:38:01.768, Thread ID: 7041}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 675210724, Method name: testMethodC, Time of event: 2025-01-10 07:38:01.818, Thread ID: 7041}].
Final event: EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 478908450, Method name: slowMethod, Time of event: 2025-01-10 07:38:03.668, Thread ID: 7040} expected [true] but found [false]
at org.testng.Assert.fail(Assert.java:111)
at org.testng.Assert.failNotEquals(Assert.java:1590)
at org.testng.Assert.assertTrue(Assert.java:57)
at test.thread.parallelization.BaseParallelizationTest.verifyEventsOccurBetween(BaseParallelizationTest.java:231)
at test.priority.parallel.EfficientPriorityParallelizationTest2.verifyThatSlowMethodStartedFirstAndEndedLast(EfficientPriorityParallelizationTest2.java:279)
|
11, microsoft, ubuntu, Pacific/Chatham, ru_RU:
task ':testng-core:test'#L1
Execution failed for task ':testng-core:test':
org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///home/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
|
11, microsoft, ubuntu, Pacific/Chatham, ru_RU
Unknown error
|
21, corretto, windows, UTC, fr_FR, stress JIT:
HookableTest.java#L47
0,2sec test.hook.HookableTest > hookSuccess[2](class test.hook.samples.HookSuccessTimeoutSample, Regular test With Timeouts (GITHUB-599), true)
java.lang.AssertionError:
Expecting ArrayList:
[]
to contain:
["verify"]
but could not find the following element(s):
["verify"]
at test.hook.HookableTest.hookSuccess(HookableTest.java:47)
|
21, corretto, windows, UTC, fr_FR, stress JIT:
task ':testng-core:test'#L1
Execution failed for task ':testng-core:test':
org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///D:/a/testng/testng/testng-core/build/reports/tests/test/index.html
|
21, corretto, windows, UTC, fr_FR, stress JIT
Unknown error
|
21, temurin, same hashcode, macos, UTC, ru_RU, stress JIT:
DataProviderWithFactoryFailedReporterTest.java#L50
0,0sec test.failedreporter.issue2517.DataProviderWithFactoryFailedReporterTest > failedMethodWithDataProviderAndFactoryShouldHaveInvocationNumbers
java.io.FileNotFoundException: /var/folders/ml/x_tvfgn50_s7p67dm1ypcqqm0000gn/T/testng-tmp-69216345981805165397818/testng-failed.xml (No such file or directory)
at java.base/java.io.FileInputStream.open(FileInputStream.java:213)
at java.base/java.io.FileInputStream.<init>(FileInputStream.java:152)
at java.base/java.io.FileReader.<init>(FileReader.java:75)
at test.SimpleBaseTest$Companion.grep(SimpleBaseTest.kt:345)
at test.failedreporter.issue2517.DataProviderWithFactoryFailedReporterTest.runAssertions(DataProviderWithFactoryFailedReporterTest.java:50)
at test.failedreporter.issue2517.DataProviderWithFactoryFailedReporterTest.testFailedReporter(DataProviderWithFactoryFailedReporterTest.java:36)
at test.failedreporter.issue2517.DataProviderWithFactoryFailedReporterTest.failedMethodWithDataProviderAndFactoryShouldHaveInvocationNumbers(DataProviderWithFactoryFailedReporterTest.java:28)
|
21, temurin, same hashcode, macos, UTC, ru_RU, stress JIT:
DataProviderWithFactoryMultiFailedReporterTest.java#L50
0,0sec test.failedreporter.issue2521.DataProviderWithFactoryMultiFailedReporterTest > multiFailedMethodWithDataProviderAndFactoryShouldHaveInvocationNumbers
java.io.FileNotFoundException: /var/folders/ml/x_tvfgn50_s7p67dm1ypcqqm0000gn/T/testng-tmp-7018742451207591503698/testng-failed.xml (No such file or directory)
at java.base/java.io.FileInputStream.open(FileInputStream.java:213)
at java.base/java.io.FileInputStream.<init>(FileInputStream.java:152)
at java.base/java.io.FileReader.<init>(FileReader.java:75)
at test.SimpleBaseTest$Companion.grep(SimpleBaseTest.kt:345)
at test.failedreporter.issue2521.DataProviderWithFactoryMultiFailedReporterTest.runAssertions(DataProviderWithFactoryMultiFailedReporterTest.java:50)
at test.failedreporter.issue2521.DataProviderWithFactoryMultiFailedReporterTest.testFailedReporter(DataProviderWithFactoryMultiFailedReporterTest.java:36)
at test.failedreporter.issue2521.DataProviderWithFactoryMultiFailedReporterTest.multiFailedMethodWithDataProviderAndFactoryShouldHaveInvocationNumbers(DataProviderWithFactoryMultiFailedReporterTest.java:28)
|
21, temurin, same hashcode, macos, UTC, ru_RU, stress JIT:
IssueTest.java#L28
1,9sec test.factory.issue326.IssueTest > testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance
java.lang.AssertionError:
Expecting actual:
1075L
to be less than or equal to:
1000L
at test.factory.issue326.IssueTest.testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance(IssueTest.java:28)
|
21, temurin, same hashcode, macos, UTC, ru_RU, stress JIT:
task ':testng-core:test'#L1
Execution failed for task ':testng-core:test':
org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
|
|
Matrix Preparation
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
17, zulu, ubuntu, Pacific/Chatham, de_DE, stress JIT
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
17, zulu, ubuntu, Pacific/Chatham, de_DE, stress JIT
Gradle Build Scan: https://gradle.com/s/63yn4wi5whv4c
|
11, microsoft, ubuntu, Pacific/Chatham, ru_RU
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
11, microsoft, ubuntu, Pacific/Chatham, ru_RU
Gradle Build Scan: https://gradle.com/s/isvlj6x3lu5j2
|
21, liberica, ubuntu, UTC, de_DE
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
21, liberica, ubuntu, UTC, de_DE
Gradle Build Scan: https://gradle.com/s/qqvogb2xys3fi
|
21, corretto, windows, UTC, fr_FR, stress JIT
Gradle Build Scan: https://gradle.com/s/fruzkghg6bujw
|
11, corretto, windows, UTC, de_DE, stress JIT
Gradle Build Scan: https://gradle.com/s/h7bwrdkj4tf5a
|
21, temurin, same hashcode, macos, UTC, ru_RU, stress JIT
Gradle Build Scan: https://gradle.com/s/qmib564hxrcpe
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
build-reports---
|
574 KB |
|
build-reports---1736444624
|
580 KB |
|
build-reports---1736444629
|
569 KB |
|