GithubHelp home page GithubHelp logo

dyan-dy / baidu-lic2021-mrc Goto Github PK

View Code? Open in Web Editor NEW
1.0 1.0 0.0 25 KB

models and codes for baiduAI LIC 2021 MRC tasks, based on paddlenlp

Home Page: https://aistudio.baidu.com/aistudio/competition/detail/66/0/introduction

License: MIT License

Shell 4.97% Python 95.03%
natural-language-processing reading-comprehension

baidu-lic2021-mrc's Introduction

Baidu-LIC2021-MRC

models and codes for baiduAI LIC 2021 MRC tasks, based on paddlenlp

usage

Modified the baseline from paddlenlp.

Due to the poor push speed and the limitation of fold volume, dataset and model .pdparams are not pushed.

download.sh , downloading the dataset. train.sh, train the model. run_eval.sh, evaluation for the dev dataset. prediction.sh, generate the demanding result.

Final(Test2) Result

Rank F1 EM in-domain(F1) checklist(F1) vocab(F1) phrase(F1) semantic-role(F1) fault-tolerant(F1) reasoning(F1)
68 54.863 46.596 62.747 47.972 50.658 55.706 44.278 47.15 42.068

Test1 Result

Rank F1 EM in-domain(F1) checklist(F1) vocab(F1) phrase(F1) semantic-role(F1) fault-tolerant(F1) reasoning(F1)
85 58.89 48.774 66.659 52.6436 53.195 61.625 55.01 44.996 48.392

Pretrained model with different weights' performance(F1) based on "checklist" and baseline

image

baidu-lic2021-mrc's People

Contributors

dyan-dy avatar

Stargazers

avatar

Watchers

avatar

baidu-lic2021-mrc's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.