Skip to content

feat(openai): add tool calling support and llama.cpp compatibility#16

Closed
caseymcc wants to merge 1 commit into
mainfrom
ava-openai-provider-fixes
Closed

feat(openai): add tool calling support and llama.cpp compatibility#16
caseymcc wants to merge 1 commit into
mainfrom
ava-openai-provider-fixes

Conversation

@caseymcc
Copy link
Copy Markdown
Owner

@caseymcc caseymcc commented Apr 3, 2026

  • Serialize tools array in OpenAI-format request body
  • Parse tool_calls from assistant responses (function name, arguments, id)
  • Include tool_call_id and tool_calls on messages in conversation history
  • Store assistant messages with tool_calls in chatClient history
  • Add sanitizeSchemaForLlamaCpp() to convert array-typed parameters to string type, avoiding Jinja template conflict with 'items' filter
  • Handle null content in responses when finish_reason is tool_calls

- Serialize tools array in OpenAI-format request body
- Parse tool_calls from assistant responses (function name, arguments, id)
- Include tool_call_id and tool_calls on messages in conversation history
- Store assistant messages with tool_calls in chatClient history
- Add sanitizeSchemaForLlamaCpp() to convert array-typed parameters to
  string type, avoiding Jinja template conflict with 'items' filter
- Handle null content in responses when finish_reason is tool_calls
@caseymcc caseymcc closed this Apr 3, 2026
@caseymcc caseymcc deleted the ava-openai-provider-fixes branch April 3, 2026 04:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant