Comments (1)
I think pre-commit install
will install it as an actual git-hook, but I see your point that it is not committed into the repo by default.
There may be some intention or concern to not do so because the comments mention that it is slightly dangerous:
Lines 16 to 29 in f118fca
A manual run adds a kind of self-check to confirm the existence of unused-in-file imports. I see this visual check as a good thing in library imports like __init__.py
(which is excluded in the code above) where the intention is to expose functionality but not necessarily use them within the file.
from evals.
Related Issues (20)
- Awaiting GPT-4 Access For Further Development HOT 2
- Functions: Support for minItems and maxItems for json schema array
- Access not working HOT 2
- Evaluate `gpt-4-0613` and `gpt-3.5-turbo-0613` yields `invalid_request_during_completion` HOT 3
- You should see GPT-4 API access enabled in your account in the next few days. HOT 1
- closedqa prompt is not adequate for gpt-4-0613
- 国际化的支持 HOT 3
- gpt-4-32k HOT 5
- Expose run_id to code being run within an eval HOT 1
- Code Evals
- Meaning of "elsuite" folder name HOT 2
- Unable to modify match_fn from within modelgraded eval .yaml file
- oaieval hangs a lot HOT 1
- Please approve pull request, changes were made.
- All evals currently in the repo appear only to have dev samples: is this correct? HOT 1
- Accuracy Score
- Sample evaluations completing after timeout cause duplicate results HOT 1
- Find claims from research paper
- Having trouble building Evals locally? Try this. HOT 1
- How to eval output with ideal_answer directly without having to define the completion_fn ? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from evals.