Comments (4)
thx, after passing attribution=["grad_x_input"]
in the lm.generate()
, it works!
from ecco.
We changed the name, use output_3.primary_attributions()
instead. Check here for more options and information.
from ecco.
After change it to output_3.primary_attributions()
, I got following errors:
╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ in <module>:3 │
│ │
│ 1 text= "The countries of the European Union are:\n1. Austria\n2. Belgium\n3. Bulgaria\n4. │
│ 2 output = lm.generate(text, generate=20, do_sample=True) │
│ ❱ 3 output.primary_attributions() │
│ 4 │
│ │
│ /home/xxx/anaconda3/envs/py39/lib/python3.9/site-packages/ecco/output.py:252 in │
│ primary_attributions │
│ │
│ 249 │ │ importance_id = position - self.n_input_tokens │
│ 250 │ │ tokens = [] │
│ 251 │ │ │
│ ❱ 252 │ │ assert attr_method in self.attribution, \ │
│ 253 │ │ │ f"attr_method={attr_method} not found. Choose one of the following: {list(se │
│ 254 │ │ attribution = self.attribution[attr_method] │
│ 255 │ │ for idx, token in enumerate(self.tokens[0]): │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
AssertionError: attr_method=grad_x_input not found. Choose one of the following: []
Any ideas?
from ecco.
Right, you need to pass attribution="grad_x_input"
in the lm.generate
call
from ecco.
Related Issues (20)
- Install ecco on Apple M1 Max clip fails HOT 1
- Google Colab support only Python 3.10 HOT 7
- How to add my own model like chinese-bert-wwm-ext
- How to retrieve salience of some specific words? HOT 1
- Support for pre-generated output
- How to serialize the LMOutput object?
- installing ecco HOT 2
- Decoder hidden states not found HOT 3
- baseline for sentence classification task using IG/Deeplift?
- Installing Ecco, unable to install in Colab HOT 3
- Can ecco be applied to tabular pytorch models?
- import ecco ERRO HOT 9
- llama support HOT 4
- bug -object has no attribute 'lm_head'- HOT 2
- lm.generate and HuggingFace's generate give different results with do_sample=False
- Request for feature addition: Visualization of Neuron Activations and Clustered Neuron Firings HOT 1
- Adding GENRE model to ecco HOT 1
- I can't find jupyter notebook for Input_Saliency.
- Error encountered when comparing activation matrices in batch generation loop
- Support to LLM like LLAMA-2 and Vicuna? HOT 15
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ecco.