-
Notifications
You must be signed in to change notification settings - Fork 152
Labels
enhancementNew feature or requestNew feature or requestrefinedRequirements are refined and the issue is ready to be implemented.Requirements are refined and the issue is ready to be implemented.size/mediumEstimated to be completed within a weekEstimated to be completed within a week
Milestone
Description
Is your enhancement request related to a problem? Please describe.
Yes, we have new conformance tests GatewayWeightedAcrossTwoInferencePools that fails in the pipeline since we do not allow multiple backend refs when Inference Pool is the backend type.
What would you like to be added:
Support multiple backend refs for Inference Pools
Why this is needed:
To be gateway API inference extension conformant
Additional context
Add any other context or screenshots about the enhancement request here.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestrefinedRequirements are refined and the issue is ready to be implemented.Requirements are refined and the issue is ready to be implemented.size/mediumEstimated to be completed within a weekEstimated to be completed within a week
Type
Projects
Status
🏗 In Progress