OyvindTafjord/lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
Repositories
OyvindTafjord/open-instruct
OyvindTafjord/lighteval
LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.
OyvindTafjord/catwalk
This project studies the performance and robustness of language models and task-adaptation methods.
OyvindTafjord/helm
Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).
OyvindTafjord/allennlp
An open-source NLP research library, built on PyTorch.
OyvindTafjord/datasets
🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools
OyvindTafjord/transformers
PyTorch version of Google AI's BERT model with script to load Google's pre-trained models
OyvindTafjord/mesh
Mesh TensorFlow: Model Parallelism Made Easier
OyvindTafjord/allennlp-demo
code for demo.allennlp.org
OyvindTafjord/MRQA-Shared-Task-2019
Resources for the MRQA 2019 Shared Task
OyvindTafjord/drop-leaderboard-example
An example submission to the AllenAI DROP leaderboard
OyvindTafjord/deep_qa
A deep NLP library, based on Keras / tf, focused on question answering (but useful for other NLP too)
OyvindTafjord/figureseer
OyvindTafjord/pnp
Probabilistic Neural Programming
OyvindTafjord/dynet
Dynamic neural network library
OyvindTafjord/pipeline
Library for building reproducible data pipelines to support experimentation
OyvindTafjord/jklol
Jayant Krishnamurthy's (machine) Learning and Optimization Library