supernovarising / hippocraticai

# Hippocratic AI Coding Assignment
Welcome to the [Hippocratic AI](https://www.hippocraticai.com) coding assignment

## Instructions
The attached code is a simple multiple-choice question taker.  We have included sample questions.  Your goal is to make this code "better"
- Do not modify testbench.py
- You may do anything you like inside hip_agent.py (or add more files) as long as the interface to testbench.py remains the same
- You must use GPT 3.5 as the LLM (not gpt 4, palm 2, fine-tuned BERT, etc)
- We included an openai api key. Please don't abuse it.

---

## Rules
- This assignment is open-ended. Part of the test is seeing what you decide is important.
- You may use any resources you like with the following restrictions
   - They must be resources that would be available to you if you worked here (so no other humans, no closed AIs, no unlicensed code, etc.)
   - Allowed resources include but not limited to Stack overflow, random blogs, Chatgpt et al. 
   - Please don't use the LangChain or a similar library (openai client library is allowed to make llm calls). We want to see you code.
   - You must cite the sources
   - If you use an AI coding tool, in addition to citing the AI generated lines of code, also please include a transcript of the prompts and completions from chat gpt that you used
- The recommended time to spend on this assignment is 4 hours, but there are no restrictions.
- DO NOT PUSH THE API KEY TO GITHUB. OpenAI will automatically delete it.
- You may ask questions.

---

## What does "Better" mean

*You* decide what better means, but here are some ideas to help get the brain-juices flowing!

- Improve the score using various well-studied methods
  - Shots
  - Chain of thought
  - Introduce documents and retrieval augmented generation (we included one open source book, but you are welcome to add whatever you like)
  - AutoGPT
- Improve the quality of the code
- Add a front end interface
- Add testbenches

---

## How will I be evaluated
Good question. We want to know the following
- Can you code
- Can you understand and deconstruct a problem
- Can you operate in an open-ended environment
- Can you be creative
- Do you understand what it means to deliver value versus check a box
- Can you *really* code
- Can you surprise us