Skip to content
Test

Tweaks around accessing SuiteResult #858

Sign in to view logs

Tweaks around accessing SuiteResult

Tweaks around accessing SuiteResult #858

Triggered via pull request March 21, 2024 16:23
@krmahadevankrmahadevan
opened #3099
krmahadevan:fix_issue_3078
Status Failure
Total duration 11m 48s
Artifacts 3

test.yml

on: pull_request
Matrix Preparation
5s
Matrix Preparation
Matrix: build
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 14 warnings
22, oracle, macos, America/New_York, de_DE, stress JIT: ListenersTest.java#L90
0,0sec test.listeners.ListenersTest > ensureOrderingForTestListenersViaApi java.lang.AssertionError: Expecting actual: ["MasterOogway.onStart_ITestContext", "MasterShifu.onStart_ITestContext", "DragonWarrior.onStart_ITestContext", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailure", "MasterShifu.onTestFailure", "MasterOogway.onTestFailure", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSkipped", "MasterShifu.onTestSkipped", "MasterOogway.onTestSkipped", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailure", "MasterShifu.onTestFailure", "MasterOogway.onTestFailure", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "DragonWarrior.onFinish_ITestContext", "MasterShifu.onFinish_ITestContext", "MasterOogway.onFinish_ITestContext"] to contain exactly (and in same order): ["MasterOogway.onStart_ITestContext", "MasterShifu.onStart_ITestContext", "DragonWarrior.onStart_ITestContext", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailure", "MasterShifu.onTestFailure", "MasterOogway.onTestFailure", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSkipped", "MasterShifu.onTestSkipped", "MasterOogway.onTestSkipped", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "
22, oracle, macos, America/New_York, de_DE, stress JIT: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
22, oracle, macos, America/New_York, de_DE, stress JIT
Unknown error
17, liberica, macos, UTC, tr_TR: ListenersTest.java#L180
0,1sec test.listeners.ListenersTest > ensureOrderingForTestListenersViaXmlTag java.lang.AssertionError: Expecting actual: ["MasterOogway.onStart_ITestContext", "MasterShifu.onStart_ITestContext", "DragonWarrior.onStart_ITestContext", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailure", "MasterShifu.onTestFailure", "MasterOogway.onTestFailure", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSkipped", "MasterShifu.onTestSkipped", "MasterOogway.onTestSkipped", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailure", "MasterShifu.onTestFailure", "MasterOogway.onTestFailure", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "DragonWarrior.onFinish_ITestContext", "MasterShifu.onFinish_ITestContext", "MasterOogway.onFinish_ITestContext"] to contain exactly (and in same order): ["MasterOogway.onStart_ITestContext", "MasterShifu.onStart_ITestContext", "DragonWarrior.onStart_ITestContext", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailure", "MasterShifu.onTestFailure", "MasterOogway.onTestFailure", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSkipped", "MasterShifu.onTestSkipped", "MasterOogway.onTestSkipped", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage",
17, liberica, macos, UTC, tr_TR: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
17, liberica, macos, UTC, tr_TR
Unknown error
21, microsoft, macos, America/New_York, de_DE: IssueTest.java#L53
8,8sec test.thread.issue188.IssueTest > testSuiteLevelParallelMode java.lang.AssertionError: Test methods should have started within a lag of max 40 ms but it was 93 ms [1711038459447,1711038459540,1711038459546,1711038459574,1711038459576] at test.thread.issue188.IssueTest.testSuiteLevelParallelMode(IssueTest.java:53)
21, microsoft, macos, America/New_York, de_DE: ListenersTest.java#L272
0,0sec test.listeners.ListenersTest > ensureOrderingForTestListenersViaCli java.lang.AssertionError: Expecting actual: ["MasterOogway.onStart_ITestContext", "MasterShifu.onStart_ITestContext", "DragonWarrior.onStart_ITestContext", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailure", "MasterShifu.onTestFailure", "MasterOogway.onTestFailure", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSkipped", "MasterShifu.onTestSkipped", "MasterOogway.onTestSkipped", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailure", "MasterShifu.onTestFailure", "MasterOogway.onTestFailure", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "DragonWarrior.onFinish_ITestContext", "MasterShifu.onFinish_ITestContext", "MasterOogway.onFinish_ITestContext"] to contain exactly (and in same order): ["MasterOogway.onStart_ITestContext", "MasterShifu.onStart_ITestContext", "DragonWarrior.onStart_ITestContext", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSuccess", "MasterShifu.onTestSuccess", "MasterOogway.onTestSuccess", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailure", "MasterShifu.onTestFailure", "MasterOogway.onTestFailure", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestSkipped", "MasterShifu.onTestSkipped", "MasterOogway.onTestSkipped", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestFailedButWithinSuccessPercentage", "MasterOogway.onTestStart", "MasterShifu.onTestStart", "DragonWarrior.onTestStart", "DragonWarrior.onTestFailedButWithinSuccessPercentage", "MasterShifu.onTestFailedButWithinSuccessPercentage", "
21, microsoft, macos, America/New_York, de_DE: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
21, microsoft, macos, America/New_York, de_DE
Unknown error
21, oracle, same hashcode, ubuntu, Pacific/Chatham, ru_RU
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
21, oracle, same hashcode, ubuntu, Pacific/Chatham, ru_RU
Gradle Build Scan: https://gradle.com/s/2a4cs5kykn5ai
11, zulu, ubuntu, UTC, ru_RU
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
11, zulu, ubuntu, UTC, ru_RU
Gradle Build Scan: https://gradle.com/s/q2wuwtegfakcu
11, corretto, windows, America/New_York, tr_TR, stress JIT
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
11, corretto, windows, America/New_York, tr_TR, stress JIT
Gradle Build Scan: https://gradle.com/s/swjlxth53x3vu
21, zulu, windows, Pacific/Chatham, ru_RU
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
21, zulu, windows, Pacific/Chatham, ru_RU
Gradle Build Scan: https://gradle.com/s/kcoupzgm4naas
22, oracle, macos, America/New_York, de_DE, stress JIT
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
22, oracle, macos, America/New_York, de_DE, stress JIT
Gradle Build Scan: https://gradle.com/s/pr3nvl5gsg25k
17, liberica, macos, UTC, tr_TR
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
17, liberica, macos, UTC, tr_TR
Gradle Build Scan: https://gradle.com/s/4cromjmj2qbmm
21, microsoft, macos, America/New_York, de_DE
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
21, microsoft, macos, America/New_York, de_DE
Gradle Build Scan: https://gradle.com/s/yk4vbieem4coi

Artifacts

Produced during runtime
Name Size
build-reports---1711038248 Expired
556 KB
build-reports---1711038249 Expired
568 KB
build-reports---1711038255 Expired
566 KB