JUnit Annotate Buildkite Plugin

A Buildkite plugin that parses junit.xml artifacts (generated across any number of parallel steps) and creates a build annotation listing the individual tests that failed.

Example

The following pipeline will run test.sh jobs in parallel, and then process all the resulting JUnit XML files to create a summary build annotation.

steps:
  - command: test.sh
    parallelism: 50
    artifact_paths: tmp/junit-*.xml
  - wait: ~
    continue_on_failure: true
  - plugins:
      - junit-annotate#v2.4.0:
          artifacts: tmp/junit-*.xml

Configuration

`artifacts` (required)

The artifact glob path to find the JUnit XML files.

Example: tmp/junit-*.xml

`always-annotate` (optional, boolean)

Forces the creation of the annotation even when no failures or errors are found

`context` (optional)

Default: junit

The buildkite annotation context to use. Useful to differentiate multiple runs of this plugin in a single pipeline.

`job-uuid-file-pattern` (optional)

Default: -(.*).xml

The regular expression (with capture group) that matches the job UUID in the junit file names. This is used to create the job links in the annotation.

To use this, configure your test reporter to embed the $BUILDKITE_JOB_ID environment variable into your junit file names. For example "junit-buildkite-job-$BUILDKITE_JOB_ID.xml".

`failure-format` (optional)

This setting controls the format of your failed test in the main annotation summary.

There are two options for this:

classname (the default)
- displays: MyClass::UnderTest text of the failed expectation in path.to.my_class.under_test
file
- displays: MyClass::UnderTest text of the failed expectation in path/to/my_class/under_test.file_ext

`fail-build-on-error` (optional)

Default: false

If this setting is true and any errors are found in the JUnit XML files during parsing, the annotation step will exit with a non-zero value, which should cause the build to fail.

`failed-download-exit-code` (optional, integer)

Default: 2

Exit code of the plugin if the call to buildkite-agent artifact download fails.

`min-tests` (optional, integer)

Minimum amount of run tests that need to be analyzed or a failure will be reported. It is useful to ensure that tests are actually run and report files to analyze do contain information.

`report-slowest` (optional)

Default: 0

Include the specified number of slowest tests in the annotation. The annotation will always be shown.

`ruby-image` (optional)

The docker image to use for running the analysis code. Must be a valid image reference that can run the corresponding ruby code and the agent running the step must be able to pull it if not already present.

Default: ruby:3.1-alpine@sha256:a39e26d0598837f08c75a42c8b0886d9ed5cc862c4b535662922ee1d05272fca

Developing

To test the plugin hooks (in Bash) and the junit parser (in Ruby):

docker-compose run --rm plugin &&
docker-compose run --rm ruby

To test the Ruby parser locally:

cd ruby
rake

To test your plugin in your builds prior to opening a pull request, you can refer to your fork and SHA from a branch in your pipeline.yml.

steps:
  - label: Annotate
    plugins:
      - YourGithubHandle/junit-annotate#v2.2.0:
          ...

License

MIT (see LICENSE)

ivanalvarado / junit-annotate-buildkite-plugin Goto Github PK