How to plot the figures in evaluation/assets?

farahhuifanyang

Hello, thank you for your important work! I was wondering if you could open-source the code for plotting the figures in the evaluation/assets directory? I look forward to your reply and support!

FFY0

Thank you for your interest. For ease of implementation, our plotting code uses intrusive modifications of current codebase to save intermediate states directly to disk during execution and relies on several offline analysis scripts to generate the visualizations. As a result, it is not compatible with the current evaluation codebase. Given the engineering effort required, we do not plan to support this feature in the short term. Instead, we will prioritize direct benchmark evaluations across different compression methods and models. ^_^