Skip to content

feat(openai): add tool calling support and llama.cpp compatibility#17

Merged
caseymcc merged 1 commit into
mainfrom
ava-openai-provider-fixes-v1
Apr 3, 2026
Merged

feat(openai): add tool calling support and llama.cpp compatibility#17
caseymcc merged 1 commit into
mainfrom
ava-openai-provider-fixes-v1

Conversation

@caseymcc
Copy link
Copy Markdown
Owner

@caseymcc caseymcc commented Apr 3, 2026

  • Serialize tools array in OpenAI-format request body
  • Parse tool_calls from assistant responses (function name, arguments, id)
  • Include tool_call_id and tool_calls on messages in conversation history
  • Store assistant messages with tool_calls in chatClient history
  • Add sanitizeSchemaForLlamaCpp() to convert array-typed parameters to string type, avoiding Jinja template conflict with 'items' filter
  • Handle null content in responses when finish_reason is tool_calls

- Serialize tools array in OpenAI-format request body
- Parse tool_calls from assistant responses (function name, arguments, id)
- Include tool_call_id and tool_calls on messages in conversation history
- Store assistant messages with tool_calls in chatClient history
- Add sanitizeSchemaForLlamaCpp() to convert array-typed parameters to
  string type, avoiding Jinja template conflict with 'items' filter
- Handle null content in responses when finish_reason is tool_calls
@caseymcc caseymcc merged commit 54ca04c into main Apr 3, 2026
1 check passed
@caseymcc caseymcc deleted the ava-openai-provider-fixes-v1 branch May 10, 2026 16:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant