llama_cpp.server -- Input should be [...] and 500 Internal Server Error about extended_openai_conversation

[jleinenbach]

This is what ChatGPT 4 tells you about this error:

The error message you provided indicates several key issues related to how the API expects data to be structured and how it's being provided in the request. Let’s break down the primary issues as identified in the exception messages:

1. **Role Field Mismatch**: The `'role'` in the JSON payload is set to `'assistant'` when the expected roles seem to be `'system'`, `'user'`, `'tool'`, and `'function'` in various contexts. The role needs to be corrected based on the expected usage within the API.

2. **Missing Content Field**: There is a consistent issue with a missing `'content'` field in parts of your payload. This suggests that the structure of the data being passed is incomplete according to the API's requirements.

3. **Missing Tool Call ID and Name**: The exceptions also point out that the `'tool_call_id'` and `'name'` fields are missing in some parts of your JSON. These fields are likely necessary for the API to correctly process the request.

The overall error stems from the discrepancies between what your request includes (or omits) and what the API expects. The `"POST /v1/chat/completions HTTP/1.1" 500 Internal Server Error` status code further implies that these validation errors are leading to a failure in processing the request.

[billstei]

After doing some testing using OpenAI's example code "Example invoking multiple function calls in one response" from here: https://platform.openai.com/docs/guides/function-calling I have concluded that this bug is not in Extended OpenAI Conversation integration, because the example code, running completely independently of HA or this integration, has the same problem (after modifying it to use llama_cpp.server, as above). Referring to that example code, a workaround was to change the "role": "tool", (line 70) to "role": "assistant", but that is not a real fix, just an observation for debugging. The problem seems to be in openai/_base_client.py

Closing this issue #203