Skip to content

Conversation

@meffmadd
Copy link
Member

@meffmadd meffmadd commented Dec 5, 2025

No description provided.

Refactor client extraction from pydantic model into util function
Need to set model_info.id for the default chat model in example_router_config.yaml to create openai client
…o which represents the whole usage)

Add streaming responses tests
Add response "lifecycle" test code
Make the basic responses test use async client to fix debugging bug in pycharm
# Conflicts:
#	aqueduct/gateway/tests/test_image_generation.py
#	aqueduct/gateway/views/decorators.py
#	aqueduct/gateway/views/image_generation.py
@meffmadd meffmadd linked an issue Dec 5, 2025 that may be closed by this pull request
4 tasks
@meffmadd meffmadd requested a review from natkam December 5, 2025 14:27
Making mocks work again after oai_client_from_body refactor
Remove old vllm test utils
Copy link
Contributor

@natkam natkam left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I haven't reviewed everything, but I have a few nit-picks already. But let's talk about this feature next week!

@meffmadd meffmadd requested a review from natkam December 10, 2025 11:22
Copy link
Contributor

@natkam natkam left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! And thanks for the docstrings, they are exactly what I wanted!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Integrate OpenAI-Compatible Responses API

3 participants