Cross Platform Testing
Documentation menu
A library that claims cross platform support should be tested on more than one platform. The templates run the test suite on Windows, macOS and Linux agents.
Why three platforms
File paths, line endings, environment variables and native dependencies differ between operating systems. A test that passes on Windows may fail on Linux because of a path separator or a case sensitive file system.
Control the cost
Run the full matrix for the main branch and a reduced matrix for pull requests if the queue is long. Keep the test commands identical across agents so a failure points to the platform rather than a different script.
Read the result
Publish the test results per agent. A green build that hides one failed agent is worse than a red build, because it creates false confidence in a release.