[Bug] Assistant Functions API not triggerring skills with 0301 GPT 35 model version about azure-functions-openai-extension

[manvkaur]

Verified the assistant working with following model versions:

• 0613
• 1106 (it has duplicate calls issue #36 )

Doesn't work with

• 0301

[manvkaur]

The issue is reproducible directly with console app of Azure OpenAI samples, linked issue - Azure/azure-sdk-for-net#43964

[manvkaur]

This is an unfortunate artifact of model version naming and GA defaulting scheme; per the AOAI models documentation, -0301 is the oldest model version still available and will be retired no later than August 1st.

That version of the model is older than either tool or function calling features, which is why these odd invocation messages show up in the text.
To get things working, please update to a newer version: -0125 is the latest, and either -0613 or -1106 also support tool-calling functionality well (parallel tool calling first became available with 1106)

To demonstrate the delta in an SDK-independent way, here are a couple of contrasting service requests using curl:

curl
-l ${AOAI_ENDPOINT}/openai/deployments/gpt-35-turbo-0301/chat/completions?api-version=2024-04-01-preview
-H "Content-Type: application/json"
-H "api-key: $AOAI_API_KEY"
-d '{
"messages": [
{ "role": "system", "content": "call provided function tools when needed" },
{ "role": "user", "content": "what is my favorite color?" }
],
"tools": [{
"type": "function",
"function": { "name": "get_favorite_color", "description": "gets the favorite color of the user" }
}]
}'

{"choices":[…,"finish_reason":"stop",…,"message":{"content":"I'm sorry, but as an AI language model, I don't have access to personal information such as your favorite color. Maybe you can tell me what it is?","role":"assistant"}}],…}

Versus:

curl
-l ${AOAI_ENDPOINT}/openai/deployments/gpt-35-turbo-0613/chat/completions?api-version=2024-04-01-preview
-H "Content-Type: application/json"
-H "api-key: $AOAI_API_KEY"
-d '{
"messages": [
{ "role": "system", "content": "call provided function tools when needed" },
{ "role": "user", "content": "what is my favorite color?" }
],
"tools": [{
"type": "function",
"function": { "name": "get_favorite_color", "description": "gets the favorite color of the user" }
}]
}'

{"choices":[…,"finish_reason":"tool_calls",…,"message":{"content":null,"role":"assistant","tool_calls":[{"function":{"arguments":"{}","name":"get_favorite_color"},"id":"call_6mQPoeZbmpUnJfEwofFznfBb","type":"function"}]}}],…}