rabbidave / eliza-thornberry-and-the-conformal-prediction-of-llm-behavior Goto Github PK
View Code? Open in Web Editor NEWPython code for use in predicting a range of LLM outputs by dimension (e.g. sentiment, topic) across fixed domain values (e.g. positive, neutral, negative) or other attributes (e.g. account details, feedback, help needed), and thus monitoring the anticipated possible drift based on the most recent outputs, as a measure of LLM Drift Detection
License: Apache License 2.0