lhan87 / hope

Place holder for HOPE: a human-centric and task-oriented MT evaluation framework using professional post-editing

HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Professional Post-Editing Towards More Effective MT Evaluation

Place holder for data sharing for translation evaluation framework HOPE: a human-centric and task-oriented MT evaluation framework using professional post-editing

File instruction: "Test22-scoring-10-9-2021.xlsm": the 111 segments of English-to-Russian MT using GoogleMT and another System, including data of human offered reference translations, scoring sheeting using HOPE evaluation framework. Open-source for non-profit research. For comercial usage, please contact: @copyright Logrus Global <serge.gladkoff [at] logrusglobal.com> https://logrusglobal.com

**Demo Link to HOPE metric:

https://drive.google.com/drive/folders/1sajkcrnDgTOFiYVkFjYqh9EDYUhneYqA?usp=sharing

**Presentation video:

https://drive.google.com/drive/folders/1lOSiMe3cFmzSt6vtovJGU6MZ8t2bs_0Y?usp=sharing

**Official LREC2022 paper:

---

Reference:

HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Professional Post-Editing Towards More Effective MT Evaluation S Gladkoff, L Han - arXiv preprint arXiv:2112.13833, 2021

@article{DBLP:journals/corr/abs-2112-13833, author = {Serge Gladkoff and Lifeng Han}, title = {{HOPE:} {A} Task-Oriented and Human-Centric Evaluation Framework Using Professional Post-Editing Towards More Effective {MT} Evaluation}, journal = {CoRR}, volume = {abs/2112.13833}, year = {2021}, url = { https://arxiv.org/abs/2112.13833 }, eprinttype = {arXiv}, eprint = {2112.13833}, timestamp = {Tue, 04 Jan 2022 15:59:27 +0100}, biburl = {https://dblp.org/rec/journals/corr/abs-2112-13833.bib}, bibsource = {dblp computer science bibliography, https://dblp.org} }