Component
Helm Chart
Desired use case or feature
According to https://github.com/llm-d/llm-d-deployer/blob/main/charts/llm-d/values.yaml, the following Gateway Service types are supported:
# -- Gateway's service type. Ingress is only available if the service type is set to NodePort. Accepted values: ["LoadBalancer", "NodePort"]
serviceType: NodePort
- Why is the default
NodePort?
- Add type
ClusterIP to support internal inference gateways.
Proposed solution
- Update default to
LoadBalancer for consistency with most upstream gateway implementations.
- Add
ClusterIP as a supported Service type.
Alternatives
No response
Additional context or screenshots
No response