Custom Report Generator about testfx

[ray440]

I would be really interested to get some details about what you are trying to achieve.

We are forwarding all test results to a central db/viewer. Ultimately we want to support special "Asserts" (e.g. compare 2 log files). Their results (which are more than just pass/fail) need to be recorded within the context of a suite/method parent. It might be helpful if MSTest had a way to emit custom TestNodeStateProperty messages..?

This is experimental and may get complicated. If you'd like more info, it's probably best to do this outside this forum.

[Evangelink]

Hi @ray440,

Excited to here about the new MSTest runner

Glad to hear :)

I saw that it allows for custom report generators.

Out of curiosity, may I ask what kind of report you are trying to build? Just to see if it could be worth for us to provide it.

What is the best way to do this? Are there events for test discovery (suites, methods) and runtime checks (pass, fail, etc..)?

Let me craft a few simple examples as it can be useful! We will iterate over it until there is something good enough for you to build something custom.

[testplatform-bot]

✅ Successfully linked to Azure Boards work item(s):

• User Story 1950757

[Evangelink]

@ray440 please see #2246 and let me know if that's providing enough context and information.

[ray440]

That sounds great!

[Evangelink]

@ray440 if that's ok with you, I'll move the issue as fixed and close it.

[ray440]

@ray440 if that's ok with you, I'll move the issue as fixed and close it.

Sure.

I'm struggling to get access to VSTestProperty. They seem to be inaccessible or internal.

[Evangelink]

I'm struggling to get access to VSTestProperty. They seem to be inaccessible or internal.

They are internal for now (I don't recall what was the reasoning but I will look it up tomorrow).

[ray440]

They are internal for now (I don't recall what was the reasoning but I will look it up tomorrow).

I suspect there are good reasons. In the meantime, I think I can hack around it to get the info I need.

[Evangelink]

I would be really interested to get some details about what you are trying to achieve.

[Evangelink]

It might be helpful if MSTest had a way to emit custom TestNodeStateProperty messages..?

When you are talking about "emit custom TestNodeStateProperty messages, do you mean if MSTest was exposing an API (e.g. TestContext or something else) for users to send some states or do you talk only about the internal of MSTest? On the latter, that's already possible.

[Evangelink]

@ray440 I am moving this ticket as closed. Feel free to add more comments or open a new one if you have some other problem,