Appium – Testmo

Testmo works with any test automation tool, including the popular Appium test automation tool for mobile app testing. This quickstart guide provides an overview of how to report Appium test automation results to Testmo to implement Appium test management.

Run Appium & generate XML file

Appium is a mobile app test automation tool that can be used together with your favorite programming language and test automation framework to automate and test apps on the major mobile platforms. Appium itself does not come with a test automation framework, so you would use it with an automation frameworks for your platform to build your tests.

Testmo works with any automation framework and tool. You simply configure your automation framework or tool to generate JUnit-style XML files, which has become a standard format to exchange test results between tools. Here are just some examples for popular testing frameworks:

Submit results to Testmo

After you have successfully executed your test automation suite and generated the report XML file with the test results, you can submit the test results to Testmo. To do this, you simply use our cross-platform testmo CLI tool. The CLI tool is distributed as an NPM package and is easy to install on any system. Simply install our official @testmo/testmo-cli NPM package:

$ npm install -g @testmo/testmo-cli
$ testmo -h

Usage: testmo [options] [command]
[...]

The CLI tool supports various commands and the easiest way to submit a complete test automation run is to use the automation:run:submit command. This command creates a new automation run, submits all results and then marks the run as completed.

Full example

Single line

Windows

$ export TESTMO_TOKEN=********
$ testmo automation:run:submit \
  --instance https://<your-name>.testmo.net \
  --project-id 1 \
  --name "Appium test run" \
  --source "mobile" \
  --results results/*.xml

If you run this example on a single command line, make sure to remove the backspace

$ export TESTMO_TOKEN=********
$ testmo automation:run:submit --instance https://<your-name>.testmo.net --project-id 1 --name "Appium test run" --source "mobile" --results results/*.xml

On Windows, the command line uses a slightly different syntax to set a variable:

> set TESTMO_TOKEN=********
> testmo automation:run:submit --instance https://<your-name>.testmo.net --project-id 1 --name "Appium test run" --source "mobile" --results results/*.xml

See command output

Collecting log files ..
Found 1 result file with a total of 855 tests
Created new automation run (ID: 254)
Created new thread (ID: 608)
Sending tests to Testmo ..
Uploading: [|||||||||||||||||||||||||] 100% | ETA: 0s | 855/855 tests
Successfully sent tests and completed run
Marked the run as completed

You need an API key for your Testmo user (or for a separate API user) to authenticate and submit your test results. Learn more about generating API keys.

This is just a basic example of using Testmo with Appium. The testmo tool also supports various other features, such as launching your test automation tool directly to capture the console output, record exit codes and measure test times. You can also submit additional fields, artifacts and links with your test runs. See the full documentation for more details.

Bonus: CI integration, parallel execution & more

Testmo also supports advanced test automation workflows such as submitting test runs for multiple test suites and reporting parallel test execution. You can also report your test automation runs from your CI pipeline and build systems. See the following guides and examples on further topics:

We have additional guides on how to integrate and submit your automated test results to Testmo from various popular CI/CD services and build tools: