Skip to content
Discussion options

You must be logged in to vote

So for anyone in the future: We had stored messages from the provider in our db and was assuming a similar schema was needed to send back to the provider. E.g. we had content, role and then stored reasoning signature and reasoning text as a singular first-party citizen. However that wasn't sufficient. E.g. openai has an itemId for the message as well as all reasoning parts, and there can be multiple reasoningparts per message. meaning multiple signatures. So our db design was flawed. To solve it, we simply store the raw ModelMessages we get back from the provider on all our assistant messages, such that we can forward them back in on next turn exactly as we received them. That retains the…

Replies: 2 comments

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
0 replies
Answer selected by NicolaiHerforth
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Help
Labels
None yet
2 participants