Skip to content

Conversation

@dmchoiboi
Copy link
Contributor

Summary

  • Add concurrent_requests_per_worker to CreateModelEndpointV1Request
  • Add forwarder_type, routes, extra_routes to RunnableImageFlavor
  • Add worker_command, worker_env to RunnableImageFlavor
  • Add nodes_per_worker to endpoint requests
  • Add new models for batch completions v2, chat completion, etc.

This PR corresponds to the changes in https://github.com/scaleapi/models/pull/17091

Test plan

  • Verify the client imports correctly
  • Verify API calls work with the new fields

🤖 Generated with Claude Code

Updates the Python client with new fields and models:
- Add concurrent_requests_per_worker to CreateModelEndpointV1Request
- Add forwarder_type, routes, extra_routes to RunnableImageFlavor
- Add worker_command, worker_env to RunnableImageFlavor
- Add nodes_per_worker to endpoint requests
- Add new models for batch completions v2, chat completion, etc.

Co-Authored-By: Claude Opus 4.5 <[email protected]>
@dmchoiboi dmchoiboi requested a review from a team January 23, 2026 10:29
dmchoiboi and others added 5 commits January 23, 2026 10:01
- Add concurrent_requests_per_worker to create_model_endpoint and edit_model_endpoint
- Add forwarder_type, routes, extra_routes, worker_command, worker_env to create_model_bundle_from_runnable_image_v2

Co-Authored-By: Claude Opus 4.5 <[email protected]>
The OpenAPI generator 7.x produces incompatible api_client.py structure.
Revert api_client.py, configuration.py, exceptions.py, and __init__.py
to the original version while keeping the updated models/.

Co-Authored-By: Claude Opus 4.5 <[email protected]>
Replace improperly generated client with one using the correct
OpenAPI Generator configuration:
- Generator: python (not python-nextgen)
- Version: 6.4.0

This produces the correct structure with paths/, apis/, model/,
models/, and schemas.py that matches the existing client.

Co-Authored-By: Claude Opus 4.5 <[email protected]>
Regenerated with correct package name 'launch.api_client' to match
the actual import path.

Co-Authored-By: Claude Opus 4.5 <[email protected]>
Note: 14 .pyi files could not be reformatted by black due to
trailing commas in Union types (a known generator quirk).

Co-Authored-By: Claude Opus 4.5 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants