Comments (3)
Currently sumeval does not support that calculation. Could you show me any paper or implementation about the calculation of ROUGE-L that you mentioned? I want to consider it.
from sumeval.
Section 3.2 of the original ROUGE paper illustrates how to calculate ROUGE-L when there are multiple sentences in the reference and the summary. The original perl implementation also supports this when I used it (just need to provide each sentence of the reference/summary in different html tags).
from sumeval.
Thank you for the information! I confirmed the paper and the code.
The perl script seems to only support sentence level ROUGE-L.
- There is no option to calculate summary-level ROUGE-L.
- In the model path (each summary sentence) loop, matched part is not merged (only matched count is merged).
And the comment on the source code suggests the abolition of summary lebel ROUGE-L. It is deprecated at 1.4.1.
from sumeval.
Related Issues (18)
- `From commandline` command error HOT 1
- Move Japanese parser from Cabocha to GiNZA
- Implements CI
- how to load self jieba HOT 4
- Are the references single sentences or summaries with many sentences? HOT 1
- What exactly does rouge_be measure? HOT 1
- Ginza v2.0への対応 HOT 1
- How to calculate ROUGE-SU4
- ROUGE score is not matched with Pythonrouge when stemming=True HOT 1
- ROUGE-L for summary-level
- Please add CITATION.cff for making citation easier
- encounter an OSError HOT 1
- super() takes at least 1 argument(0 given) HOT 1
- Cannot use stemming in python3.6 HOT 2
- Input parameter types not clearly documented HOT 2
- Support for chinese? HOT 12
- broken with recent version of sacrebleu HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sumeval.