Comments (11)
Thanks for the detailed description and the sample.
I will have a look as soon as possible.
from reportgenerator.
We have been digging further, and now I'm not sure there's a problem with the library. Please put this on hold, I'll be back with a verdict shortly.
from reportgenerator.
They only thing that we would like to have is the ability to "see" these functions, i.e. be able to extract their metadata with
ReportGenerator.Core
library to show them on our dashboard, without affecting metrics.
I will see what I can do. Will come back to you as soon as possible.
from reportgenerator.
Thanks! I will test it in the following days and come back.
from reportgenerator.
After taking a quick glance at the code, I can see two things:
- Currently there's a special case for compiler-generated iterator methods:
- Lambdas (and consequently local functions) are excluded (which dates back to the initial import in 2015):
from reportgenerator.
I just found time to have a closer look. Sorry for the delay.
The main problem is that line and block coverages of these local functions is lost in the generated report. We have classes which mainly consist of local functions, and the coverage metrics are very off for them, compared to what Visual Studio shows.
Compiler generated classes are not listed on the summary page, that's correct. But the relevant lines are processed within the corresponding parent class.
In your example the summary report only shows the classes MyLogic
and MyScenario
.
But if you look into the MyScenario
report, you will see that all coverable lines are considered. Even the block with line 729-738, which belongs to a compiler generated class.
- Currently there's a special case for compiler-generated iterator methods:
Yes, but that's just a naming thing. The name MoveNext
is not very helpful, instead the "correct" method name is retrieved.
- Lambdas (and consequently local functions) are excluded
Yes, but only in the list of methods and their metrics. This does not affect the overall code coverage.
Does this help? I'm I missing something?
from reportgenerator.
The main issue we had is the 'Blocks covered' method metric which was incorrect (i.e. apparently not including compiler-generated local functions). It seems to me that the Lines metric is calculated correctly indeed.
Can you take a look at how it's calculated? Maybe the same 'aggregation' logic is missing for block coverage?
from reportgenerator.
And what about properties? They are excluded from the report too, do they count towards line metrics like compiler-generated methods do? In theory, property getters/setters can (and often do) have some logic in them, so they should count towards line/block coverage metrics.
from reportgenerator.
So our current understanding is that including lambda/local functions in total metrics (as suggested by me) is incorrect because they are already included by Visual Studio coverage. So the premise of this bug report is false, sorry for that.
They only thing that we would like to have is the ability to "see" these functions, i.e. be able to extract their metadata with ReportGenerator.Core
library to show them on our dashboard, without affecting metrics.
from reportgenerator.
I think I have found a solution. Will publish a new release in the next days.
from reportgenerator.
Release 5.1.26 is now available. Could you please test if this works for you?
from reportgenerator.
Related Issues (20)
- Report Generation takes too many resources HOT 9
- Report Generator fails on Linux build agent version 22.04 HOT 10
- Error during reading file when generate code coverage report HOT 4
- Increase percentage accuracy in reports HOT 2
- 10 day trial period HOT 3
- Reportgenerator generated html and xml file is mismatched with its input Cobertura xml file HOT 4
- To combine multi coverage report HOT 1
- Issue with running the report generator in docker with image "mcr.microsoft.com/dotnet/sdk:7.0" HOT 2
- LCov: branch hit count can overflow Int32. HOT 1
- Files with 0% coverage are omitted from the coverage report HOT 8
- Report generator is looking for dotnet even the artifact is Python code HOT 1
- Cobertura report generation emits NaN as complexity for async functions HOT 2
- SixLabors.ImageSharp.Drawing has potential vulnerability HOT 6
- Risk Hotspots thresholds - what are the default values - and how change them HOT 1
- Visual Studio Coverage: Support partial line coverage HOT 6
- Cobertura output async "class" merging can create duplicate method entries HOT 10
- 10 days trial HOT 1
- coverlet-coverage give much higher Cyclomatic Complexity score for given Method then Visual Studio 2022 Code Metrics Results HOT 3
- The generated (GeneratedRegex) codes are count as uncovered branches in v5.2.0 HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from reportgenerator.