Skip to content

Streamline random generation #870

Streamline random generation

Streamline random generation #870

Triggered via pull request March 30, 2024 06:14
Status Failure
Total duration 12m 8s
Artifacts 3

test.yml

on: pull_request
Matrix Preparation
6s
Matrix Preparation
Matrix: build
Fit to window
Zoom out
Zoom in

Annotations

19 errors and 14 warnings
11, microsoft, windows, UTC, tr_TR, stress JIT: HookableTest.java#L47
0,2sec test.hook.HookableTest > hookSuccess[1](class test.hook.samples.HookSuccessTimeoutWithDataProviderSample, DataProvider Test With Timeouts (GITHUB-599), true) java.lang.AssertionError: Expecting ArrayList: [] to contain: ["verify"] but could not find the following element(s): ["verify"] at test.hook.HookableTest.hookSuccess(HookableTest.java:47)
11, microsoft, windows, UTC, tr_TR, stress JIT: EfficientPriorityParallelizationTest2.java#L279
0,0sec test.priority.parallel.EfficientPriorityParallelizationTest2 > verifyThatSlowMethodStartedFirstAndEndedLast java.lang.AssertionError: All the test two methods should run between when test one starts and ends. Start Event: EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 284337197, Method name: slowMethod, Time of event: 2024-03-30 06:23:43.023, Thread ID: 7037}. In between events: [EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodA, Time of event: 2024-03-30 06:23:42.966, Thread ID: 7038}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodA, Time of event: 2024-03-30 06:23:43.478, Thread ID: 7038}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodA, Time of event: 2024-03-30 06:23:43.529, Thread ID: 7038}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodB, Time of event: 2024-03-30 06:23:44.029, Thread ID: 7038}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodB, Time of event: 2024-03-30 06:23:44.530, Thread ID: 7038}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodB, Time of event: 2024-03-30 06:23:44.580, Thread ID: 7038}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodC, Time of event: 2024-03-30 06:23:45.081, Thread ID: 7038}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodC, Time of event: 2024-03-30 06:23:45.581, Thread ID: 7038}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodC, Time of event: 2024-03-30 06:23:45.632, Thread ID: 7038}]. Final event: EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 284337197, Method name: slowMethod, Time of event: 2024-03-30 06:23:47.524, Thread ID: 7037} expected [true] but found [false] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1578) at org.testng.Assert.assertTrue(Assert.java:57) at test.thread.parallelization.BaseParallelizationTest.verifyEventsOccurBetween(BaseParallelizationTest.java:231) at test.priority.parallel.EfficientPriorityParallelizationTest2.verifyThatSlowMethodStartedFirstAndEndedLast(EfficientPriorityParallelizationTest2.java:279)
11, microsoft, windows, UTC, tr_TR, stress JIT: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///D:/a/testng/testng/testng-core/build/reports/tests/test/index.html
11, microsoft, windows, UTC, tr_TR, stress JIT
Unknown error
17, zulu, windows, UTC, ru_RU: IssueTest.java#L56
5,3sec test.thread.issue188.IssueTest > testSuiteLevelParallelMode java.lang.AssertionError: Test methods should have started within a lag of max 40 ms but it was 72 ms [1711779538740,1711779538745,1711779538817,1711779538833] at test.thread.issue188.IssueTest.testSuiteLevelParallelMode(IssueTest.java:56)
17, zulu, windows, UTC, ru_RU
Unknown error
17, zulu, windows, UTC, ru_RU
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
22, oracle, windows, Pacific/Chatham, de_DE
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
22, oracle, windows, Pacific/Chatham, de_DE: HookableTest.java#L47
0,1sec test.hook.HookableTest > hookSuccess[1](class test.hook.samples.HookSuccessTimeoutWithDataProviderSample, DataProvider Test With Timeouts (GITHUB-599), true) java.lang.AssertionError: Expecting ArrayList: [] to contain: ["verify"] but could not find the following element(s): ["verify"] at test.hook.HookableTest.hookSuccess(HookableTest.java:47)
22, oracle, windows, Pacific/Chatham, de_DE: HookableTest.java#L47
0,3sec test.hook.HookableTest > hookSuccess[2](class test.hook.samples.HookSuccessTimeoutSample, Regular test With Timeouts (GITHUB-599), true) java.lang.AssertionError: Expecting ArrayList: [] to contain: ["verify"] but could not find the following element(s): ["verify"] at test.hook.HookableTest.hookSuccess(HookableTest.java:47)
22, oracle, windows, Pacific/Chatham, de_DE: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///D:/a/testng/testng/testng-core/build/reports/tests/test/index.html
22, oracle, windows, Pacific/Chatham, de_DE
Unknown error
11, temurin, macos, America/New_York, ru_RU: IssueTest.java#L28
2,0sec test.factory.issue326.IssueTest > testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance java.lang.AssertionError: Expecting actual: 1137L to be less than or equal to: 1000L at test.factory.issue326.IssueTest.testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance(IssueTest.java:28)
11, temurin, macos, America/New_York, ru_RU: IssueTest.java#L28
1,5sec test.factory.issue326.IssueTest > testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance java.lang.AssertionError: Expecting actual: 1055L to be less than or equal to: 1000L at test.factory.issue326.IssueTest.testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance(IssueTest.java:28)
11, temurin, macos, America/New_York, ru_RU: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
11, temurin, macos, America/New_York, ru_RU
Unknown error
21, microsoft, macos, America/New_York, ru_RU, stress JIT: IssueTest.java#L56
9,2sec test.thread.issue188.IssueTest > testSuiteLevelParallelMode java.lang.AssertionError: Test methods should have started within a lag of max 40 ms but it was 69 ms [1711779566177,1711779566246] at test.thread.issue188.IssueTest.testSuiteLevelParallelMode(IssueTest.java:56)
21, microsoft, macos, America/New_York, ru_RU, stress JIT: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
21, temurin, same hashcode, ubuntu, America/New_York, ru_RU, stress JIT
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
21, temurin, same hashcode, ubuntu, America/New_York, ru_RU, stress JIT
Gradle Build Scan: https://gradle.com/s/yechkj423dolw
11, microsoft, windows, UTC, tr_TR, stress JIT
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
11, microsoft, windows, UTC, tr_TR, stress JIT
Gradle Build Scan: https://gradle.com/s/iuxtadtdhhdmg
17, zulu, windows, UTC, ru_RU
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
17, zulu, windows, UTC, ru_RU
Gradle Build Scan: https://gradle.com/s/ybtudgiahv3xa
22, oracle, windows, Pacific/Chatham, de_DE
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
22, oracle, windows, Pacific/Chatham, de_DE
Gradle Build Scan: https://gradle.com/s/hmjkonwfwng42
11, temurin, windows, UTC, fr_FR
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
11, temurin, windows, UTC, fr_FR
Gradle Build Scan: https://gradle.com/s/7yhqzq5dnnsd2
11, temurin, macos, America/New_York, ru_RU
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
11, temurin, macos, America/New_York, ru_RU
Gradle Build Scan: https://gradle.com/s/es6nvohoamo4e
21, microsoft, macos, America/New_York, ru_RU, stress JIT
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
21, microsoft, macos, America/New_York, ru_RU, stress JIT
Gradle Build Scan: https://gradle.com/s/m6i5grl5vt354

Artifacts

Produced during runtime
Name Size
build-reports--- Expired
570 KB
build-reports---1711779297 Expired
574 KB
build-reports---1711779325 Expired
575 KB