Skip to content

Conversation

ParamThakkar123
Copy link
Contributor

Added performance tests instead of just correctness testing as given in issue #75 . Fix #75

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Sep 11, 2025
Copy link
Contributor

@PaliC PaliC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fix :) This will help us get our toy agent to also give us better performance as we iterate on it.

The only "please fix this" feedback is to rebase the pr and make sure it works on main (check comment about a recent refactor).

Otherwise, things generally look solid!

@PaliC PaliC requested a review from shaahins September 11, 2025 16:52
@ParamThakkar123
Copy link
Contributor Author

@PaliC I made the changes suggested

@PaliC
Copy link
Contributor

PaliC commented Sep 12, 2025

@ParamThakkar123 I think something went wrong with rebasing as there are callsites to functions which are no longer in the file.

I'd ensure that the tests added here work, and you should be good! Ensure that the tests that are added here work #158

Also you should be able to just use compile_kernel_from_string to grab the kernel function

@ParamThakkar123
Copy link
Contributor Author

Sure @PaliC looking into it

@ParamThakkar123
Copy link
Contributor Author

ParamThakkar123 commented Sep 12, 2025

@PaliC I made some code changes and ensured that they work locally. Can you place take a look?

Copy link
Contributor

@PaliC PaliC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There's a small comment you need to address, otherwise, it seems good to merge.

Thanks :)

Copy link
Contributor

@PaliC PaliC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oops there's a bug

@ParamThakkar123
Copy link
Contributor Author

@PaliC so should I go ahead and make the changes i described in that thread ?

@ParamThakkar123
Copy link
Contributor Author

Sure @PaliC Made the fixes. And I left the refactor as it is if that wasn't something we need right now

@ParamThakkar123
Copy link
Contributor Author

ParamThakkar123 commented Sep 12, 2025

Can you please take a look ? If any changes are needed further I'll make them right away. Else we are ready to merge probably :). Sorry for the bugs I unknowingly introduced in the code @PaliC

Copy link
Contributor

@PaliC PaliC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for dealing with the back and forth! It's good to merge :)

@PaliC PaliC merged commit d04e86f into meta-pytorch:main Sep 12, 2025
3 checks passed
@ParamThakkar123
Copy link
Contributor Author

Thanks @PaliC 🫡

@ParamThakkar123 ParamThakkar123 deleted the performance_tests branch September 12, 2025 18:18
@shaahins
Copy link
Contributor

thanks for adding this @ParamThakkar123

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add performance testing to llm_relay
3 participants