Coverage Stats about libafl

[domenukk]

What exactly do you want to track? How many bits are currently set in the coverage map?
For this, one easy way could be to wrap the MapFeedback with your own feedback that also keeps track of the current progress. Could this roughly be what you are looking for? In case it's unclear please don't hesitate to ask further questions. :)

[bitterbit]

one easy way could be to wrap the MapFeedback

I'll look into it sounds cool :)

I was actually thinking more about how to display the stats with all other stats in SimpleStats. I can wrap MapFeedback and make it emit a new event FeedbackEvent which the event manager will receive and update the Stats field. I guess displaying custom stats could be common case for fuzzers, maybe we could do a custom stats event that passes a KV to be printed?

Or I could just hack a loop with a sleep to ask MapFeedback how many edges it collected. What would you suggest be better?

[domenukk]

Ah sorry, I get the question a bit better, now. :)
The plan is to allow custom events, however we had to comment them out at some point during refactoring. I think it should be asy to bring them back, see

LibAFL/libafl/src/events/mod.rs

Line 127 in b519363

Custom {

With this, emitting your own events shoud be easy.

Thinking about it, it may also make sense to make the normal stats event take additional data, @andreafioraldi what do you think?

[andreafioraldi]

Yes is a thing that we planned, but not in our priority list ATM. If you want to implement it, don't use a CustomEvent, add a field to the Event enum as it is a common thing that users want to log.

[andreafioraldi]

Anyway, I plan a refactor of the Stats system as now we print cumulative stats of all the clients while it is interesting to have stats from each client (the coverage stats would fall in this case) and global stats

[bitterbit]

Cool i'll look into it and update if I come up with something useful
Thanks guys

[bitterbit]

Just made a PR #107, let me know what you think

[andreafioraldi]

Just made a PR #107, let me know what you think

Ty, probably I will use it as a base but I will not merge it, I want to change a bit Stats to allow arbitrary stats like this to be added easily.

[bitterbit]

Cool ✌️

[andreafioraldi]

Hey @bitterbit can you give a look to #114 and see it if cover your usecase?

Now there are custom stats events and can be sent in this way https://github.com/AFLplusplus/LibAFL/blob/new_stats/libafl/src/feedbacks/map.rs#L302

[andreafioraldi]

The interface is now this and prints each MapFeedback using the name

[bitterbit]

@andreafioraldi looks perfect! 💪