Skip to content
This repository was archived by the owner on Apr 8, 2026. It is now read-only.

Local LLM Deployment Optimization#5

Open
void-b583x2-NULL wants to merge 7 commits intoamazon-science:devfrom
void-b583x2-NULL:more_extractors
Open

Local LLM Deployment Optimization#5
void-b583x2-NULL wants to merge 7 commits intoamazon-science:devfrom
void-b583x2-NULL:more_extractors

Conversation

@void-b583x2-NULL
Copy link
Copy Markdown
Contributor

Description of changes:

  • More arguments controlling the params for locally deployed LLM (Currently Mistral/Mixtral)
  • Corrected prompt for Mistral (to avoid truncations)
  • API optimization

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants