Repository navigation
Fix iOS real device workflows and use test-runner retries in CI - #441
Merged
Merged
Conversation
- Pin iOS RDC sessions to iOS 18. The EU data center no longer has iOS 14 iPhones, and unpinned Safari sessions failed on iOS 14/15 devices. - Set appiumVersion for the native iOS RDC test (required for iOS 17+). - Replace nick-fields/retry with Surefire's rerunFailingTestsCount, so only failed tests are retried instead of the whole Maven run. TestNG modules get a RetryListener reading the same property. - Fix the Mobile Web step name missing the browser matrix value. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
4 of 8 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fix iOS real device workflows and use test-runner retries in CI
Description
The iOS Real Devices and Real Devices (RDC + Safari) workflows have been failing on
main.IOSNativeAppTest) has failed on every run since Oct 1. It requested an iOS 14 iPhone in the EU data center, which no longer has any (the lowest available is iOS 15). It is now pinned to iOS 18. iOS 17+ requiresappiumVersion, so it now usesappium3-2026-04, matchingmobile-web. The simulator configuration keeps iOS 14.iPhone.*with no version picks a random device. In the last run, all 11 failing jobs were on iOS 14.7–15.7 ("element not visible" on add-to-cart buttons), and no job on iOS 16+ failed. This is now pinned to iOS 18.This PR also replaces
nick-fields/retry(which reran the wholemvn testup to 3 times) with retries from the test runner, so only failed tests are retried:-Dsurefire.rerunFailingTestsCount=2. A test that passes on retry is reported as a flake.selenium-testng-examplesandselenium-cucumber-examplesget a smallRetryListener(anIAnnotationTransformerandIRetryAnalyzer) that reads the same property. It defaults to 0, so local runs don't change.timeout-minutes.$on the browser matrix value.Types of Changes
Tasks
IOSNativeAppTestwith-Dregion=eupasses against real devicesmobile-webwith-Dsauce.cloud=RDC -Dsauce.browser=safaripasses 15/15 against real devicesselenium-cucumber-examplescompiles with the listenerReview
Deployment Notes
None. Retries only run in CI, through
-Dsurefire.rerunFailingTestsCount=2in the workflows.🤖 Generated with Claude Code