Flank v20.08.2

v20.08.2

Features

• #1020 Make release notes more organized (piotradamczyk5)
• #1013 Generating docs before release (piotradamczyk5)
• #1012 Add ip-blocks command to test-environment command (pawelpasterz)
• #999 Implement ip-blocks list command (pawelpasterz)
• #996 Auto generate release notes for next release (piotradamczyk5)
• #995 Implement command models describe for ios/android (adamfilipow92)
• #991 Validate orientation and fail fast (Sloox)
• #969 Add locales description command for ios and android (adamfilipow92)
• #992 Update google api (jan-gogo)
• #988 Add versions description command for ios and android (adamfilipow92)

Refactor

• #1018 Fetch artifacts async (pawelpasterz)

Bug Fixes

• #919 Rate limit exceeded (pawelpasterz, jan-gogo)
• #1005 Generation of release notes (piotradamczyk5)
• #1007 Failing tests (piotradamczyk5)
• #990 Exclusion of @Suppress test (piotradamczyk5)

CI Changes

• #1015 Update mergify configuration (piotradamczyk5)
• #1011 Generate release notes for Github release description (piotradamczyk5)
• #989 Check if valid title is used in PR (piotradamczyk5)

Documentation

• #987 Analytics addition to readme (Sloox)

Flank v20.08.1

v20.08.1

• #978 Firebaseopensource.com addition (sloox)
• #937 Improve error message on iOS when test or xctestrun-file not found (sloox)
• #952 Fix version printing on Flank release (sloox)
• #950 Fix crash when --legacy-junit-result set. (adamfilipow92)
• #948 Increment retry tries and change sync tag for jfrogSync. (piotradamczyk5)
• #946 Added tests for flank scripts. (piotradamczyk5)
• #935 Process junit xml even when full junit is not enabled. (kozaxinan)
• #962 Make table text left aligned. (pawelpasterz)
• #965 Fast fail when full-junit-result and legacy-junit-result. (adamfilipow92)
• #970 Fixing Flood of snapshot releases. (piotradamczyk5)
• #972 Fix printing release version. (piotradamczyk5)
• #964 Implement network-profiles describe feature. (pawelpasterz)

Flank v20.08.0

Stable release for commit 8566004

v20.08.0

• #890 Convert bitrise ubuntu workflow into GitHub actions. (piotradamczyk5)
• #876 Added option to print Android available devices to test against. (piotradamczyk5)
• #895 Added option to print iOS available devices to test against. (piotradamczyk5)
• #894 Added option to print Android available versions to test against. (piotradamczyk5)
• #897 Added option to print iOS available versions to test against. (piotradamczyk5)
• #901 Added option to print Android and iOS available test-environment. (piotradamczyk5)
• #904 Added option to print provided software. (piotradamczyk5)
• #906 Added option to print network profiles. (adamfilipow92)
• #908 Added option to print iOS available locales to test against. (piotradamczyk5)
• #906 Added option to print iOS and Android screen orientations. (adamfilipow92)
• #907 Added option to print Android available locales to test against. (piotradamczyk5)
• #913 Add Gradle Enterprise API example. (pawelpasterz)
• #916 Test artifacts monorepo. (jan-gogo)
• #910 Migrate Bitrise release workflow into GitHub actions. (piotradamczyk5)
• #915 Update virtual devices sharding limit. (adamfilipow92)
• #920 Improve .yml validation on doctor command. (piotradamczyk5)
• #934 Delete incorrect flank snapshot labels. (piotradamczyk5)
• #926 Flank should reflect gcloud exit codes. (adamfilipow92)
• #917 Fix an incorrect outcome. (pawelpasterz)
• #939 Run *list commands when flank.yml not found should display right output. (adamfilipow92)

Flank v20.07.0

Stable release for commit 02bca27

v20.07.0

• #857 Added multimodule setup for test app. (piotradamczyk5)
• #837 Added obfuscate option to dump shards. (piotradamczyk5)
• #868 Restored weblinks to all test results, not just failures. (rainnapper)
• #828 Store test results in gcloud bucket. (adamfilipow92)
• #865 Flank needs to respect the timeout value as that's a cap for billing purposes. (adamfilipow92, pawelpasterz)
• #866 Fix printing all matrix links. (piotradamczyk5)
• #862 Added printing outcome details. (piotradamczyk5, jan-gogo)
• #876 Added --directories-to-pull validation and avoid making request with empty toolStepResult. (piotradamczyk5)
• #875 Enhance permission denied exception logs. (adamfilipow92, pawelpasterz)

Flank v20.06.2

Stable release for commit 08de9c3

v20.06.2

• #853 Store @ignore tests in the JUnit XML without sending ignored tests to FTL. (piotradamczyk5, adamfilipow92)
• #853 Handle duplicated apk names. (jan-gogo)

Flank v20.06.1

Stable release for commit 6d25735

v20.06.1

• #840 Fix parametrized tests. (jan-gogo, adamfilipow92, pawelpasterz, piotradamczyk5)

Flank v20.06.0

Stable release for commit 77f18db

v20.06.0

• #831 Refactor config entities and arguments. (jan-gogo)
• #817 Add AndroidTestContext as base data for dump shards & test execution. (jan-gogo)
• #801 Omit missing app apk if additional-app-test-apks specified. (jan-gogo)
• #784 Add output-style option. (jan-gogo)
• #779 Print retries & display additional info. (jan-gogo)
• #793 Better error message on file not found. (adamfilipow92)
• #808 Fixed dry run crashes. (piotradamczyk5)
• #807 Fix Bugsnag being initialized during tests. (piotradamczyk5)
• #805 Fix overlapping results. (pawelpasterz)
• #812 Convert bitrise macOS workflow to github action. (piotradamczyk5)
• #799 Refactor Shared object by splitting it into smaller functions. (piotradamczyk5)
• #798 Remove failure nodes from tests that passed on retry so that Jenkins JUnit plugin marks them as successful. (adamfilipow92)
• #822 Allow runtime test discovery when sharding is disabled by not setting test-targets. This unblocks cucumber testing. (adamfilipow92)
• #819 Display matrix results in a table format. (piotradamczyk5)
• #825 Automatically convert -1 in maximum-test-shards to the maximum shard amount. (adamfilipow92)
• #833 More error messages improvements. (piotradamczyk5)
• #826 Omit environment-variables for robo test executions instead of throwing exception. (adamfilipow92)

Flank v20.05.2

Stable release for commit 7618ebd

v20.05.2

• #781 Remove local exists check on cloud results-dir. Fixes crash when results-dir is set by the user. (adamfilipow92)
• #656 Improve error message reporting. (adamfilipow92)
• #783 Use legacy results for iOS by default. (pawelpasterz)

Flank v20.05.1

Stable release for commit 88f336d

v20.05.1

• #775 Fix exception thrown for null start time. (pawelpasterz)

Flank v20.05.0

Stable release for commit ead2739

Release highlights

Flank 20 has been released! This includes 41 features and bug fixes from 9 authors (bootstraponline, RainNapper, Kurt-Bonatz, doodla, jan-gogo, pawelpasterz, fondesa, Writhe, adamfilipow92).

Highlights include:

• Date based version numbers! 20.05.0 is the first Flank release in May.
• Server side sharding. All the shards show up in one matrix if you're using a single APK. This is a huge stability and user experience win. num-flaky-test-attempts will retry entire shards.
• Video, auto login, and perf metrics default to off to optimize for performance. You can turn them back on if desired.
• Flank no longer hangs on exceptions!
• The API is used to fetch XML results on Android instead of parsing XML files. This improves performance and correctness.
• Web links to the matrices are printed at the start of each run.
• Many new features are now supported in Flank and are coming soon to Fladle. additional-apks, disableSharding, smartFlankDisableUpload, testRunnerClass, localResultsDir, testTargetsAlwaysRun, runTimeout, ignoreFailedTests, numUniformShards, clientDetails, otherFiles, networkProfile, roboScript, roboDirectives
• Improved memory usage for running on small virtual machines
• ASCII doc in the repo for every supported Flank command
• Flank is now on maven central! The group id has changed from flank to com.github.flank We're working to automatically sync each new release to maven.
• Timing values corrected in JUnit XML files on Android.
• Fixed test filtering logic when using notPackage and notClass

v20.05.0

• #764 Fix crash on parse some control chars. (adamfilipow92)
• #772 Fail fast when results-dir is incorrect. (jan-gogo)
• #757 Reduce memory usage by using Reader and Writer instead of ByteArrays. (jan-gogo)
• #763 Use "localhost" as default for hostname to fix backward compatibility. (jan-gogo)
• #757 Print version and revision before each command. (jan-gogo)
• #759 Add shard name for uploaded xctestrun files. (pawelpasterz)
• #755 Remove ascii doc generated section header. (jan-gogo)
• #731 Refactor jUnit HTML report. (Writhe)
• #754 Sync README.md flank.yml flank.ios.yml. (jan-gogo)
• #746 Ignore apk with filtered out tests instead of failing. (pawelpasterz)
• #741 Allow APKs with zero tests. (fondesa)
• #737 Generate ascii doc. (jan-gogo)
• #720 Update group id from flank to com.github.flank (bootstraponline)
• #714 Add support for num-uniform-shards option. (jan-gogo)
• #712 Add keep file path for ios. (pawelpasterz)
• #711 Remove hardcoded height. (pawelpasterz)
• #708 Add ignore failed tests option to Flank. (pawelpasterz)
• #704 Add robo for robo-directives & robo-script options. (jan-gogo)
• #704 Fix shards calculation when there are ignored tests and shardTime is -1. (jan-gogo)
• #692 Add support for other-files option. (jan-gogo)
• #695 Add support for additional-apks option. (jan-gogo)
• #683 Print web link. (pawelpasterz)
• #692 Add support for network-profiles list command & --network-profile option. (jan-gogo)
• #689 Add support for client-details option. (jan-gogo)
• #687 Debug message printed after every command. (pawelpasterz)
• #684 Add overhead time to junit test case report. (jan-gogo)
• #666 Use API instead of XML for result parsing for android. (jan-gogo)
• #678 Skip Bugsnag initialization if user disabled gcloud analytics. (pawelpasterz)
• #672 Flank timeout feature. (pawelpasterz)
• #657 Fix execution hangs. (pawelpasterz)
• #654 Fix test filters when using both notPackage and notClass. (jan-gogo)
• #648 Include @ignore JUnit tests in JUnit XML. (pawelpasterz)
• #646 Adopt kotlin-logging as a logging framework. (jan-gogo)
• #644 Use high performance options by default. Video, login, and perf metrics are now disabled by default. (pawelpasterz)
• #643 Add --dry option to android run & ios run. (jan-gogo)
• #642 Flank doctor should exit 1 on validation issues. (pawelpasterz)
• #641 Move all deps to Deps.kt (doodla)
• #640 Update gradle to 6.2.1 and JaCoCo to 0.8.5. (doodla)
• #639 Cache all uploads and downloads to GCS. (Kurt-Bonatz)
• #635 Default to 2m time estimate for unknown tests when sharding. (RainNapper)
• #621 Adopt server side sharding. Max shard count is 50. (bootstraponline)