Comments (7)
We need to leave this one open since we have not yet implemented command line parameters for the user to define the analyses they want. But it is not part of a MVP.
from esmf-profiler.
The user also needs to point the tool to the directory containing the binary (CTF) trace. So the commands above would have an additional argument such as:
$ ./esmf-profiler --load-balance=depth:4 /path/to/trace/directory
from esmf-profiler.
Error checking will be needed:
$ ./esmf-profiler --memory=type:rss,pet:16 /path/to/my/tracedir
ERROR: A memory profile was requested for PET 16, but there is no memory information in the trace.
from esmf-profiler.
@rlongio any thoughts on this?
from esmf-profiler.
Sorry for the delay.
Yes, these can all be implemented in the user layer rapidly once the backend logic is finished. It has an API that will allow the user to specify the data they need (filters, etc.) and how many layers depth to go, so if there is a cookie cutter high chart you'd like to use we can get something visually together quicker.
On a side note, after working with a larger binary trace, I did some profiling as the execution time was near 30 minutes. I was able to get that down to less than 5, but it required some refactoring (ie time in bt2 library is expensive).
I expect to finish this by today, or at least have a working MVP.
Regardless, this week I'm going to start sticking static data in the front end to explore some visuals.
The requested features will be either in the first iteration or will be put in as tasks for the second.
from esmf-profiler.
Sounds good. Good work reducing the time. Some of the time in bt2 is just an artifact of file system access, so we may have limited options in optimizing that side, especially for large traces. However, that is not a showstopper as the user will have the expectation of waiting to post-process large traces.
For your first iteration, you are essentially delivering this, even if the CLI is not set up:
$ ./esmf-profiler --load-balance=depth:2 /path/to/trace
from esmf-profiler.
@rsdunlapiv Can we close this issue?
from esmf-profiler.
Related Issues (20)
- Babeltrace2 lib not found when using c-shell HOT 3
- Provide feedback to stdout when profile is pushed HOT 2
- Check for required Python version HOT 2
- Consider adding glib to dependencies
- Some files not copied when re-using the same output directory HOT 4
- Head of development broken on Hera HOT 1
- name argument error HOT 4
- Docker run fails with PackageNotFoundError HOT 2
- Web files not copied into output when profiler is run outside of the root installation directory HOT 2
- Add option to build/run with Singularity container
- Implement esmf-profiler --version
- Default push repo
- Give user link to profile after it is pushed
- Provide profile links to a specific drilled down location in the load balance plots
- Add min and max times to load balance plot
- Package name should be 'esmf-profiler' not 'profiler' HOT 2
- On Hera, must deactivate and re-activate the venv to find the esmf-profiler HOT 2
- Add 'IntelPython Not Supported' to Release Notes HOT 1
- Repeating profile push twice in a row results in a error HOT 4
- Update quick start guide with new section 'Generating and Viewing Profiles' HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from esmf-profiler.