Comments (2)
Thank you for the clarification!
from captum.
Hi @tsKenneth, the purpose of this _select_targets method is to select a single (scalar) value for each example in the output of your model to compute attributions based on the given target parameter. Each attribution method answers the question of how important each input value was towards a particular output value.
More concretely, in your case it seems your output is in the shape N x 2, with N being the number of examples and 2 being the number of classes. The purpose of targets is to select one of the 2 values for each example. You could then pass targets as just a single integer 0 or 1, which corresponds to attributing to the output for class 0 or class 1 respectively for all examples. If you are passing a batch of multiple examples (e.g. N = 4), you can also pass a different target for each example, by providing targets as a list or tensor, e.g. [0, 1, 0, 0], which would return attributions for class 0 for the first, third and fourth input examples (how important each input value was for the prediction of class 0), and class 1 for the second one (how important each input value was for the prediction of class 1).
Regarding your question about what model output to use, theoretically, any scalar output can be used to compute attributions. The best option might be to use the model output before applying softmax (logits), see section 3.6 of the DeepLift paper or #91 from one of the authors for some reasoning why.
from captum.
Related Issues (20)
- Explainability for embeddings
- Uninitialized target_tokens Variable in LLMGradientAttribution.attribute Method
- what is the meaning of contribution? HOT 1
- For sentence classification using BERT, PAD token is used in IG/Deeplift? HOT 1
- Integrated Gradients for Llama2
- BertForMultipleChoice works without captum, breaks with it?
- Possible to modify initial LRP score to compute CLRP(contrastive lrp)?
- Incorrect indexing for max pooling layers with DeepLIFT HOT 1
- Integrated gradient on a function of models
- NoiseTunnel on LayerIntegratedGradients Perturbs Input Instead of Attribution Target (RunetimeError)
- Integrated Gradients for Frame-Level Classification Tasks
- What is the proper shape of baselines for DeepLiftShap?
- Adding IDGI to Captum HOT 4
- TCAV score computation doesn't preserve experimental set order
- Getting target dimension is not valid even though the output shape is shape in GRAD CAM .
- Deconvoltion and KernelSHAP methods create uninformative attribution maps
- TypeError: 'Concept' object is not iterable HOT 1
- Integrated Gradient without edge attribute
- Integrated Gradients for Llama2 May Produce Unstable Explanations for Long Contexts
- Negative Scores in Feature Ablation and Choosing Baselines for Non-Image Data
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from captum.