Triton RuntimeStatus.MethodInfos is missing ModelStreamInfer #80
Description
Triton provides an extension to the standard gRPC inference api for streaming (inference.GRPCInferenceService/ModelStreamInfer), this extension is required to use vLLM backend with triton.
However currently the triton runtime adapter does not advertise the existence of this gRPC method and trying to call it results in an error (inference.GRPCInferenceService/ModelStreamInfer: UNIMPLEMENTED: Method not found or not permitted: inference.GRPCInferenceService/ModelStreamInfer)
To resolve this issue, I think the ModelStreamInfer method must be added here:
modelmesh-runtime-adapter/model-mesh-triton-adapter/server/server.go
Lines 267 to 269 in f9781d2