Skip to content

SYCL: Add GGML_OP_MEAN operator support #16009

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

SYCL: Add GGML_OP_MEAN operator support #16009

wants to merge 2 commits into from
+34 −0

Conversation

yael-works
Copy link
Contributor

@yael-works yael-works commented Sep 15, 2025 •
edited
Loading

This PR introduces support for GGML_OP_MEAN in the SYCL backend.

Changes:

  • Added ggml_sycl_op_mean() kernel and ggml_sycl_mean() wrapper
  • Registered GGML_OP_MEAN in ggml_sycl_compute_forward()
  • Updated ggml_backend_sycl_device_supports_op() to report support
  • Added proper row-wise mean implementation with parallel division

Verification:

  • Build passes successfully with CMake + make
  • ./build/bin/test-backend-ops support -o MEAN -b sycl shows
  • ./build/bin/test-backend-ops test -o MEAN -b sycl passes with OK

@github-actions github-actions bot added ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language labels Sep 15, 2025
@yael-works
Copy link
Contributor Author

Status update:
All major builds (Linux, Windows, SYCL, CUDA, macOS-x64) passed successfully.

RISCV job failed due to missing runner:

The job was not acquired by Runner of type self-hosted even after multiple attempts
Internal server error. Correlation ID: e44cad51-7cf6-459f-9d19-6597095ade25

This appears unrelated to the code changes.

@ggerganov @ggerganov/ggml-maintainers –
Please review when convenient. This PR is ready for review & merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@NeoZhangJianyu NeoZhangJianyu Awaiting requested review from NeoZhangJianyu

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@yael-works