Skip to content

Conversation

aswamy
Copy link
Contributor

@aswamy aswamy commented Aug 21, 2025

  • We want to expose the call count for each tool so we can pull it for metrics

PROBLEM:

  • I feel like relying on the LLM to pass in the correct call count isn't reliable enough. thoughts?

@aswamy aswamy requested a review from a team as a code owner August 21, 2025 19:58
.number()
.default(1)
.describe(
"🔗 REQUIRED: The number of times the tool has been called within one user request. The number resets after the user's request is complete.",
Copy link
Contributor

@matteodepalo matteodepalo Aug 22, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what about something like

Suggested change
"🔗 REQUIRED: The number of times the tool has been called within one user request. The number resets after the user's request is complete.",
"🔗 REQUIRED: The number of times the tool has been used to validate some generated code and all its iterations. Any time this tool responds with an overall valid status OR the user writes a new message aimed at generating different code RESET THE COUNTER. THIS IS IMPORTANT.",

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

still preserves count after updating the description as long as you're in the same conversation :(

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants