Xcode 13 test repetition options to land on Bitrise

WWDC rolled up a few weeks ago and we’ve been hard at work ever since. Here’s what we’ve done so far — enjoy!

Xcode 13 is just around the corner! 🎉  The beta version is already out on Bitrise and we are working on supporting the new features and functionality. The first change we bring to you is a little face-lift to the Xcode Test for iOS Step.

We are expanding the test repetition configuration with three new options in an upcoming 3.0.0 update to the Xcode Test for iOS Step. Prior to Xcode 13, you had an option to automatically retry tests on failure, but this option reran all tests. The new test repetition options offer more customization and flexibility, allowing you to find issues faster.

New test repetition options in Xcode 13

With these new inputs, you will be able to run your tests repeatedly and set up additional options such as retry on failure and run until max repetitions.

Available options in Test Repetitions Mode (Available in Xcode 13+):

  • none: The tests won’t repeat.
  • until_failure: Repeats a test until the test fails or until the maximum repetition. The default number of test runs is 3.
  • retry_on_failure: Failed tests run until they succeed or until the repetition number you specify. The default number of test repetitions is 3.
  • up_until_maximum_repetitions: Reruns all tests until maximum test repetition is reached regardless of the test outcomes.

There are two other step inputs for you to try:

  • Maximum Test Repetitions: Use this to set the maximum number of times a test will repeat based on Test Repetition Mode.
  • Relaunch Tests for Each Repetition: If enabled, tests will launch in a new process for each repetition.

We’re deprecating the old retry option

Since we are expanding the functionality to offer more options, from Xcode 13 and above, the Should retry tests on failure? feature is not available anymore. Therefore, we recommend you use test repetitions instead.

The new version of the Xcode Test for iOS Step is already available for Xcode 13 beta in Bitrise — give it a spin!

No items found.
The Mobile DevOps Newsletter

Explore more topics

App Development

Learn how to optimize your mobile app deployment processes for iOS, Android, Flutter, ReactNative, and more

Bitrise & Community

Check out the latest from Bitrise and the community. Learn about the upcoming mobile events, employee spotlights, women in tech, and more

Bitrise Insights

Cache | Caching

Mobile App Releases

Learn how to release faster, better apps on the App Store, Google Play Store, Huawei AppGallery, and other app stores

Mobile DevOps

Learn Mobile DevOps best practices such as DevOps for iOS, Android, and industry-specific DevOps tips for mobile engineers

Mobile Testing & Security

Learn how to optimize mobile testing and security — from automated security checks to robust mobile testing and more.

Product Updates

Check out the latest product updates from Bitrise — Build Insights updates, product news, and more.

The Mobile DevOps Newsletter

Join 1000s of your peers. Sign up to receive Mobile DevOps tips, news, and best practice guides once every two weeks.