Skip to content

Conversation

@uinstinct
Copy link
Contributor

@uinstinct uinstinct commented Jan 30, 2026

Description

Add support for requestOptions.stream in models section in config.yaml

This add supports for using reasoning models of openai using this flag.

example:

models:
  - name: o3
    provider: openai
    model: o3
    apiKey: ${{secrets.OPEN_AI_KEY}}
    roles:
      - chat
      - edit
      - apply
    capabilities:
      - tool_use
    defaultCompletionOptions:
      reasoning: true
    useLegacyCompletionsEndpoint: false
    requestOptions:
      stream: false

closes CON-5285

AI Code Review

  • Team members only: AI review runs automatically when PR is opened or marked ready for review
  • Team members can also trigger a review by commenting @continue-review

Checklist

  • [] I've read the contributing guide
  • [] The relevant docs, if any, have been updated or created
  • [] The relevant tests, if any, have been updated or created

Screen recording or screenshot

[ When applicable, please include a short screen recording or screenshot - this makes it much easier for us as contributors to review and understand your changes. See this PR as a good example. ]

Tests

[ What tests were added or updated to ensure the changes work as expected? ]


Continue Tasks: ▶️ 1 queued · ✅ 1 no changes — View all


Summary by cubic

Adds requestOptions.stream to model config and enforces it in the LLM layer. This lets you turn off streaming for OpenAI reasoning (o-series) models and addresses CON-5285.

  • New Features
    • Config schema (types and YAML) now supports requestOptions.stream: boolean.
    • BaseLLM disables streaming when completionOptions.stream or requestOptions.stream is false.
    • Streaming for OpenAI o-series/GPT-5 is only used when not using the legacy completions endpoint.

Written for commit ef4cb51. Summary will update on new commits.

@uinstinct uinstinct requested a review from a team as a code owner January 30, 2026 07:06
@uinstinct uinstinct requested review from sestinj and removed request for a team January 30, 2026 07:06
@dosubot dosubot bot added the size:S This PR changes 10-29 lines, ignoring generated files. label Jan 30, 2026
Copy link
Contributor

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 4 files

Copy link
Collaborator

@RomneyDa RomneyDa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@uinstinct since stream is already in completion options, how does this impact functionality? I think we should avoid adding a duplicate configuration option.

@github-project-automation github-project-automation bot moved this from Todo to In Progress in Issues and PRs Jan 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:S This PR changes 10-29 lines, ignoring generated files.

Projects

Status: In Progress

Development

Successfully merging this pull request may close these issues.

2 participants