helendrug / test_report

Test report application made with React

Test_Report

Test report application made with React. Purpose of application is to show statistics of running tests. Application is able:

• to show info about test (duration, erros, path, arguments etc)
• to indicate which tests have been passed successfully
• to indicate which tests have been failed
• to indicate which tests are been ignored and inconclusive
• to filter tests (based on their status - passed, failed or ignored) Project was made using create-react-app, but due to clinet's request was trasferred to simple HTML page + styling with CSS file.

test_report's Issues

When deselect failed hide test suite

Indentation on test level is off

Image comparison tool

Do not display Build Url for local runs when it’s empty

Open artifacts on new tab

Can't expand sucesfull tests

Steps to repro:
Open test_report_index.html. There is now "+" on succesfull TestGroups

Show duration where it is avalaible

Including TestGroup, TestSession, etc.

Change callStack2 processing algorithms

if parsed is false, display rawFrameString
Example:

"stackTrace2": [
      {
        "parsed": false,
        "method": null,
        "line": 0,
        "file": null,
        "ref": null,
        "rawFrameString": "at OcclusioncullingTests.RemoveCacheFolder_ShouldDelete_OcclusionFolder () [0x00034] in /Users/yan/unity/lane1/Tests/EditModeAndPlayModeTests/Camera/Assets/Editor/OcclusionCullingTests.cs:27"
      }

Test name should be autoselectable

Fix message component selection

Missing space in call-stack view

right in front of the list

When deselect failed

Don't print "Success" in tree view for test plan message.

Select top node automatically

Make the top-level node selected automatically after page load so that the details panel is not empty (short term):

New StackTrace format

The new stack trace format will look like this:

"stackTrace2": [
{
"method": "MethodName",
"line": 12,
"file": "myfile.cs",
"ref": "https://github.com/HelenDrug/Test_Report/blob/master/index.html#L35",
"frameString": "at
}
]

you need to render it to a string: at MethodName in my file.cs:12

file.cs:12 should be a link with the target address https://github.com/HelenDrug/Test_Report/blob/master/index.html#L35
note, that there might be multiple entries like this

Feature request:

Render images for graphics tests
There are 3 images: actual, rendered, and expected.

we should be able to compare actual VS expected
maybe using this tool https://www.w3schools.com/howto/howto_js_image_comparison.asp

Highlight the currently selected node

Highlight the currently selected node so that it is clear for which node the details are displayed

Add build url to test session buildURL

[Back to CI]
can be taken from, should be displayed in details view
testsession.buildUrl
e.g.
"buildUrl": "https://yamato.cds.internal.unity3d.com/job/123",

Command line to run locally: add prefix

should be

should be perl utr.pl --suite=nunit--testfilter=Unity.UnifiedTestRunner.UnitTests.GlobalOptionsTests.ParseArguments_WhenOnlySuiteIsSpecified_ThenSetsValuesToDefault

The prefix can be found in JSON data

Multiple issues on editor tests

TestReportV2.html.zip

Issues:
Some nodes are not rendered. There should be default templates for nodes we don't know type
No need display artifacts icon if there are no artifacts

Copy minimal command line does not include ./utr

Message with type assert should be shown as errors

Copy for minimal command line adds "," into copied string

when we use the "Copy" button to copy the content to the clipboard, the value we get when do 'paste' contains commas after each argument:
--suite=nunit,--testfilter=Unity.UnifiedTestRunner.Plugin.LegacyTestReportBuilder.UnitTests.LegacyReportNinjectModuleTests.Load_LegacyReportBuilderIsBound

Remove the paper clip icon for the Build Url

Some nodes are not rendered