Real-time memory access visualization about llama

[bussmann]

Moreover, I see a great opportunity to connect this to bactria as a performance tool enhancement! @j-stephan , what do you think?

[j-stephan]

In general this seems like something that would be useful to bactria. If I understand the proposal correctly we would provide a LLAMA plugin for bactria so that users can visualize memory accesses (or collect other metrics) through bactria.

But I'm not certain that this would work for user code that doesn't use LLAMA already. And users who use LLAMA already wouldn't have an incentive to use the bactria API (because they can just call the LLAMA functionality). Am I missing something here?

On a side note, I see some collaboration potential regarding the real-time visualization aspect. This is something I'd like to see in bactria at some point. Maybe there is room for a project here that introduces a common data exchange format into the Caravan ecosystem which can be used by external tools to acquire this data and visualize it.