Issue with Precision and Recall about rival

[abellogin]

Hi Vincenzo,

I will take a look at it as soon as possible. Can you tell us how you are calling the precision and recall metrics? If you are using your code, it will be useful to know how you are creating and printing the metrics. If you are using a script, it would also be helpful to know the commands you are using.

Thanks,
Alejandro

[vinceRicchiuti]

yes sure, This is my code:

....
SimpleParser sp = new SimpleParser();
DataModel dm = sp.parseData(new File("path_of_my_predictions_file"));
DataModel dmtest = sp.parseData(new File("path_of_my_test_file"));

Precision pr = new Precision(dm, dmtest);
pr.compute();
System.out.println(pr.getValue());
Recall rc = new Recall(dm, dmtest);
rc.compute();
System.out.println(rc.getValue());
....

[abellogin]

Hi Vincenzo, sorry it took so long, but I thought it was going to be something related with how you called the metrics, so I needed to prepare a test case. In the end, the problem seems to be with your definition of precision (and recall): instead of using the definition from the classification literature, you should look at the one used in information retrieval (here), where the total number of retrieved documents are considered in the denominator. In your case, this means: 12 (positive) / 22 (retrieved) = 0.54.

Let me know if you have any comments,
Alejandro