generated from kubernetes/kubernetes-template-project
-
Notifications
You must be signed in to change notification settings - Fork 149
Open
Labels
needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.
Milestone
Description
Backend apps can signal the desired protocol by using appProtocol of a Service. Since inference backends, e.g. model servers, are not expected to use a Service, InferencePool should have a similar field that Gateway implementations can use to set the appropriate protocol when routing a request.
vLLM: Supports HTTP/1.1 (xref).
Triton: Supports HTTP/1.1 (REST) and gRPC inference protocols (xref).
Metadata
Metadata
Assignees
Labels
needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.