Questions about CAP scores about sdmetrics

[npatki]

Hi @limhasic,

From the references that are listed for the CategoricalCAP metric: My understanding is that the metric was created using the original definition of CAP, from reference [1]. This looks for exact matches of the key fields. Meanwhile, in [2] it is generalized so that if no matches are found, approximate matches are deemed ok.

Whatever matches are found, the metric iterate through each row and reports the overall average of all rows. I have not read the full paper for TCAP -- but if it is doing the same thing, it would appear to be similar to CAP.

Also, are there any criteria for which column to select for cap score?

Selecting columns as key or sensitive fields would be dependent on your threat model. Any kind of CAP metric requires you to assume that an attacker may have access to certain types of columns. Perhaps these values are available in publicly available datasets, or perhaps there was a data leak in the past, etc. It seems project dependent to me.

Hope that helps.

[limhasic]

Thank you for your kind reply