Anthropic partial chunking with tool calls #4392
Unanswered
itscharliecowan
asked this question in
Help
Replies: 1 comment
-
@itscharliecowan did you ever find a solution to this? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi there, I have been successfully using OpenAI as the model provider, and incorporated a basic RAG implementation using the examples provided on the AI SDK docs.
I wanted to test out Anthropic and installed and switched in my api/chat route - but for some reason when (and only when) the getInformation tool is called does the response come back in partial chunks as in the example below.
I switched back to OpenAI as the model and all is fine.
Anyone seen this before?
Let me check our knowledge base for any existing information about this Gong project.
I
I see
I see we
I see we have
I see we have some
I see we have some information
I see we have some information about
I see we have some information about a
I see we have some information about a CRM
I see we have some information about a CRM project,
I see we have some information about a CRM project, but
Beta Was this translation helpful? Give feedback.
All reactions