Streamline random generation #870
test.yml
on: pull_request
Matrix Preparation
6s
Matrix: build
Annotations
19 errors and 14 warnings
11, microsoft, windows, UTC, tr_TR, stress JIT:
HookableTest.java#L47
0,2sec test.hook.HookableTest > hookSuccess[1](class test.hook.samples.HookSuccessTimeoutWithDataProviderSample, DataProvider Test With Timeouts (GITHUB-599), true)
java.lang.AssertionError:
Expecting ArrayList:
[]
to contain:
["verify"]
but could not find the following element(s):
["verify"]
at test.hook.HookableTest.hookSuccess(HookableTest.java:47)
|
11, microsoft, windows, UTC, tr_TR, stress JIT:
EfficientPriorityParallelizationTest2.java#L279
0,0sec test.priority.parallel.EfficientPriorityParallelizationTest2 > verifyThatSlowMethodStartedFirstAndEndedLast
java.lang.AssertionError: All the test two methods should run between when test one starts and ends.
Start Event: EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 284337197, Method name: slowMethod, Time of event: 2024-03-30 06:23:43.023, Thread ID: 7037}.
In between events: [EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodA, Time of event: 2024-03-30 06:23:42.966, Thread ID: 7038}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodA, Time of event: 2024-03-30 06:23:43.478, Thread ID: 7038}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodA, Time of event: 2024-03-30 06:23:43.529, Thread ID: 7038}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodB, Time of event: 2024-03-30 06:23:44.029, Thread ID: 7038}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodB, Time of event: 2024-03-30 06:23:44.530, Thread ID: 7038}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodB, Time of event: 2024-03-30 06:23:44.580, Thread ID: 7038}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodC, Time of event: 2024-03-30 06:23:45.081, Thread ID: 7038}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodC, Time of event: 2024-03-30 06:23:45.581, Thread ID: 7038}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 175649810, Method name: testMethodC, Time of event: 2024-03-30 06:23:45.632, Thread ID: 7038}].
Final event: EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 284337197, Method name: slowMethod, Time of event: 2024-03-30 06:23:47.524, Thread ID: 7037} expected [true] but found [false]
at org.testng.Assert.fail(Assert.java:111)
at org.testng.Assert.failNotEquals(Assert.java:1578)
at org.testng.Assert.assertTrue(Assert.java:57)
at test.thread.parallelization.BaseParallelizationTest.verifyEventsOccurBetween(BaseParallelizationTest.java:231)
at test.priority.parallel.EfficientPriorityParallelizationTest2.verifyThatSlowMethodStartedFirstAndEndedLast(EfficientPriorityParallelizationTest2.java:279)
|
11, microsoft, windows, UTC, tr_TR, stress JIT:
task ':testng-core:test'#L1
Execution failed for task ':testng-core:test':
org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///D:/a/testng/testng/testng-core/build/reports/tests/test/index.html
|
11, microsoft, windows, UTC, tr_TR, stress JIT
Unknown error
|
17, zulu, windows, UTC, ru_RU:
IssueTest.java#L56
5,3sec test.thread.issue188.IssueTest > testSuiteLevelParallelMode
java.lang.AssertionError: Test methods should have started within a lag of max 40 ms but it was 72 ms [1711779538740,1711779538745,1711779538817,1711779538833]
at test.thread.issue188.IssueTest.testSuiteLevelParallelMode(IssueTest.java:56)
|
17, zulu, windows, UTC, ru_RU
Unknown error
|
17, zulu, windows, UTC, ru_RU
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
22, oracle, windows, Pacific/Chatham, de_DE
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
22, oracle, windows, Pacific/Chatham, de_DE:
HookableTest.java#L47
0,1sec test.hook.HookableTest > hookSuccess[1](class test.hook.samples.HookSuccessTimeoutWithDataProviderSample, DataProvider Test With Timeouts (GITHUB-599), true)
java.lang.AssertionError:
Expecting ArrayList:
[]
to contain:
["verify"]
but could not find the following element(s):
["verify"]
at test.hook.HookableTest.hookSuccess(HookableTest.java:47)
|
22, oracle, windows, Pacific/Chatham, de_DE:
HookableTest.java#L47
0,3sec test.hook.HookableTest > hookSuccess[2](class test.hook.samples.HookSuccessTimeoutSample, Regular test With Timeouts (GITHUB-599), true)
java.lang.AssertionError:
Expecting ArrayList:
[]
to contain:
["verify"]
but could not find the following element(s):
["verify"]
at test.hook.HookableTest.hookSuccess(HookableTest.java:47)
|
22, oracle, windows, Pacific/Chatham, de_DE:
task ':testng-core:test'#L1
Execution failed for task ':testng-core:test':
org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///D:/a/testng/testng/testng-core/build/reports/tests/test/index.html
|
22, oracle, windows, Pacific/Chatham, de_DE
Unknown error
|
11, temurin, macos, America/New_York, ru_RU:
IssueTest.java#L28
2,0sec test.factory.issue326.IssueTest > testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance
java.lang.AssertionError:
Expecting actual:
1137L
to be less than or equal to:
1000L
at test.factory.issue326.IssueTest.testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance(IssueTest.java:28)
|
11, temurin, macos, America/New_York, ru_RU:
IssueTest.java#L28
1,5sec test.factory.issue326.IssueTest > testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance
java.lang.AssertionError:
Expecting actual:
1055L
to be less than or equal to:
1000L
at test.factory.issue326.IssueTest.testToCheckParallelExecutionOfInstancesWithOneThreadPerInstance(IssueTest.java:28)
|
11, temurin, macos, America/New_York, ru_RU:
task ':testng-core:test'#L1
Execution failed for task ':testng-core:test':
org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
|
11, temurin, macos, America/New_York, ru_RU
Unknown error
|
21, microsoft, macos, America/New_York, ru_RU, stress JIT:
IssueTest.java#L56
9,2sec test.thread.issue188.IssueTest > testSuiteLevelParallelMode
java.lang.AssertionError: Test methods should have started within a lag of max 40 ms but it was 69 ms [1711779566177,1711779566246]
at test.thread.issue188.IssueTest.testSuiteLevelParallelMode(IssueTest.java:56)
|
21, microsoft, macos, America/New_York, ru_RU, stress JIT:
task ':testng-core:test'#L1
Execution failed for task ':testng-core:test':
org.gradle.api.internal.exceptions.MarkedVerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
|
|
21, temurin, same hashcode, ubuntu, America/New_York, ru_RU, stress JIT
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
21, temurin, same hashcode, ubuntu, America/New_York, ru_RU, stress JIT
Gradle Build Scan: https://gradle.com/s/yechkj423dolw
|
11, microsoft, windows, UTC, tr_TR, stress JIT
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
11, microsoft, windows, UTC, tr_TR, stress JIT
Gradle Build Scan: https://gradle.com/s/iuxtadtdhhdmg
|
17, zulu, windows, UTC, ru_RU
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
17, zulu, windows, UTC, ru_RU
Gradle Build Scan: https://gradle.com/s/ybtudgiahv3xa
|
22, oracle, windows, Pacific/Chatham, de_DE
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
22, oracle, windows, Pacific/Chatham, de_DE
Gradle Build Scan: https://gradle.com/s/hmjkonwfwng42
|
11, temurin, windows, UTC, fr_FR
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
11, temurin, windows, UTC, fr_FR
Gradle Build Scan: https://gradle.com/s/7yhqzq5dnnsd2
|
11, temurin, macos, America/New_York, ru_RU
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
11, temurin, macos, America/New_York, ru_RU
Gradle Build Scan: https://gradle.com/s/es6nvohoamo4e
|
21, microsoft, macos, America/New_York, ru_RU, stress JIT
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: burrunan/gradle-cache-action@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
21, microsoft, macos, America/New_York, ru_RU, stress JIT
Gradle Build Scan: https://gradle.com/s/m6i5grl5vt354
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
build-reports---
Expired
|
570 KB |
|
build-reports---1711779297
Expired
|
574 KB |
|
build-reports---1711779325
Expired
|
575 KB |
|