Skip to content

Conversation

ggerganov
Copy link
Member

@ggerganov ggerganov commented Sep 14, 2025

Major refactoring of the Metal backend to make the implementation safer and more manageable:

  • Add ggml-metal-device.h and move device code there
  • Add ggml-metal-context.h and move backend context code there
  • Migrate most kernels to inference-time compilation
  • Split ggml_metal_encode_node into per-op functions and move them to separate sources
  • Apply typedef struct ggml_mem_ranges * ggml_mem_ranges_t;

@github-actions github-actions bot added ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) devops improvements to build systems and github actions labels Sep 14, 2025
@ggerganov ggerganov force-pushed the gg/metal-refactor-and-optimize-v2 branch 3 times, most recently from c02fbab to 9b0d50c Compare September 16, 2025 12:56
@github-actions github-actions bot added the testing Everything test related label Sep 16, 2025
@ggerganov ggerganov force-pushed the gg/metal-refactor-and-optimize-v2 branch from a771b14 to 716a3d3 Compare September 16, 2025 18:25
@ggerganov ggerganov marked this pull request as ready for review September 16, 2025 21:01
@ggerganov ggerganov force-pushed the gg/metal-refactor-and-optimize-v2 branch from b01f087 to bef9295 Compare September 16, 2025 21:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Apple Metal https://en.wikipedia.org/wiki/Metal_(API) devops improvements to build systems and github actions ggml changes relating to the ggml tensor library for machine learning testing Everything test related
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant