Skip to content
Open core software, built in Singapore Established 2018  /  Five utilities
Jering
Talk to us

Cross Platform Testing

DevOps.AzurePipelines Jering documentation Open source Pipeline templates
Documentation menu

A library that claims cross platform support should be tested on more than one platform. The templates run the test suite on Windows, macOS and Linux agents.

Why three platforms

File paths, line endings, environment variables and native dependencies differ between operating systems. A test that passes on Windows may fail on Linux because of a path separator or a case sensitive file system.

Control the cost

Run the full matrix for the main branch and a reduced matrix for pull requests if the queue is long. Keep the test commands identical across agents so a failure points to the platform rather than a different script.

Read the result

Publish the test results per agent. A green build that hides one failed agent is worse than a red build, because it creates false confidence in a release.

Reference shelf