Comments (2)
This will happen if you don't provide your OpenAI keys.
Make sure you are passing it with:
import openai
import os
os.environ["OPENAI_API_KEY"] = "sk-xxx"
openai.api_key = os.getenv("OPENAI_API_KEY")
It's important to note that response_hallucination
requires extra LLM Calls to OpenAI.
I will also create an issue to make this error more explicit.
Let me know if that solves your issue!
from langkit.
Closing this issue assuming that the missing API key was the cause.
from langkit.
Related Issues (20)
- response_hallucination: remove llm requirement for consistency check
- Response Hallucination: decouple LLMs for sample generation and consistency checking
- text-davinci-003 OpenAI model deprecated
- Add feature to use bedrock agent to do the evaluation
- faiss-cpu - installation through pip not supported
- Original data HOT 1
- Jupyter kernel crashes on running injections module in Mac HOT 3
- Need example of prompt column name override
- Importing metrics issue since there is not a way to pass the model path if stored locally HOT 3
- Need env variable to avoid attempted download of nltk artifacts
- Better error message if OpenAI key is not provided in response_hallucination
- Explain refusal similarity HOT 1
- Specify Python version compatibility HOT 1
- consistency_check in response_hallucination HOT 1
- Use custom prompt in response_hallucination HOT 3
- add support for detoxify local models
- reduce latency in lazy initialization
- SWE-Agent: Implement the hallucinations metric from the main branch in the workflow branch
- Possible merge issue with 0.0.31 release HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from langkit.