jessehouwing / azure-pipelines-ensure-tests-task

Azure Pipelines task to ensure tests have executed

🔗 Connect with me

---

💗 Sponsor me

---

📒 Recent blog posts

• The use or uselessness of signed commits
• Don't get lost in your plans
• Restrict GitHub branches to specific prefixes
• Recommendations for using Azure CLI in your workflow
• Allow people to find you on Mastadon from your Ghost Pro domain

---

👨‍💻 Get trained in things Scrum and DevOps

If you're interested in a class that isn't currenly scheduled for public delivery or the dates don't suit you, do leave me a note to schedule a class on-demand for you and your team.

• 🗓️ Professional Scrum with Kanban - 27-28 Jun 2024
• 🗓️ Professional Scrum Product Owner - Advanced - 4-5 Jul 2024
• 🗓️ Professional Scrum Product Owner - 23-24 Sep 2024
• 🗓️ Professional Scrum Facilitation Skills - 14 Oct 2024
• 🗓️ Professional Scrum Master - Advanced - 17-18 Oct 2024
• 🗓️ Professional Scrum Product Owner - 21-22 Oct 2024
• 🗓️ Applying Professional Scrum for Software Development - 13-15 Nov 2024
• 🗓️ Professional Scrum Product Owner - 18-19 Nov 2024
• 🗓️ Professional Scrum with Kanban - 25-26 Nov 2024

• GitHub Actions
• GitHub Enterprise Cloud Adminstration
• GitHub Developer

• Phoenix Project Game
• Phoenix Project Game Business Edition

• ⛅ AZ-900T00-A: Microsoft Azure Fundamentals
• ⛅ AZ-204T00: Developing Solutions for Microsoft Azure
• ⛅ AZ-400T00-A: Designing and Implementing Microsoft DevOps solutions

---

🤖 Tools

• PowerPoint Diff/Merge

---

▶️ GitHub Actions

• Actions SemVer Checker Action | 🛍️

---

🚀 Azure Pipelines Extensions

• Renovate for Azure DevOps Pipelines Marketplace
• Azure Pipelines TFVC Tasks | 🛍️
• Azure Pipelines Variable Tasks | 🛍️
• MsBuild Helper Tasks | 🛍️
• Pre- and Post Script Tasks | 🛍️
• Gate Condition Editor | 🛍️
• Azure DevOps Extension Tasks | 🛍️
• Ensure Tests | 🛍️
• Agent Screenshot | 🛍️
• Azure Pipelines Task Zips | 🛍️
• Nuget (Deprecated | 🛍️

---

📅 Azure Boards Extensions

• Team Tool CLI | 🛍️
• TFS Aggregator | 🛍️
• Aggregator CLI | 🛍️
• WitMorph

azure-pipelines-ensure-tests-task's Issues

Does it make sense to test for # test runs (instead of raw number of tests)

I have access to the value:

root.aggregatedResultsAnalysis.runSummaryByState.Completed.runsCount

Valuable?

minNumOfExpectedTests input missing in YAML conversion and YAML designer

When I use the "View yaml" link in the pipeline designer or use the yaml assistant in a pipline already set up with yaml the required minNumOfExpectedTests setting is missing in the generated snippet.

Can it be an agent phase task too?

Thanks so much for this task - its really useful.

The biggest issue I have is that because the task only runs in an agentless phase, it complicates all my builds.

For example, take a simple library build. The pipeline needs to upload the produced nuget package to a nuget feed. Due to the fact that this task must run in an agentless phase, I now need three phases to perform the actions correctly. This is because I don't want the nuget packages to be uploaded if the Ensure Tests task fails.

• Phase 1 - Agent
  • Perform Build
  • Upload pipeline artifacts
• Phase 2 - Agentless
  • Ensure Tests
• Phase 3 - Agent
  • Download pipeline artifacts
  • Upload to nuget feed

I realise this is probably due to the fact it's implemented using the API, but is there a redesign that would enable this scenario?

fail build when test fail

is it possible?

Not working with new azure pipelines (YAML) ?

pipeline.yaml

# ASP.NET Core
# Build and test ASP.NET Core projects targeting .NET Core.
# Add steps that run tests, create a NuGet package, deploy, and more:
# https://docs.microsoft.com/azure/devops/pipelines/languages/dotnet-core

<....>
build and run tests
<....>

- task: Ensure tests have executed.@0
  inputs:
    minNumOfExpectedTests: 3

When trying to run getting:

Cannot add the task to my build

Hi, I a not able to add this task to my pipeline.

I created an agentless phase, set up the dependency with my agent phase that performs build and test, but I can not add the taks, it is only listed on marketplace. Please look at following image:

Broken Readme Links

Just a heads up that the links in the readme page (Wiki and file an issue) are broken. Looks like they are using a repo name of vsts-ensure-tests-tasks vs vsts-ensure-tests

Readme / marketplace page reference non-existent wiki

The readme.md (and subsequently, the marketplace page) reference a non-existent wiki.