Skip to content

Conversation

@micalgenus
Copy link

@micalgenus micalgenus commented Jan 30, 2026

Description

This PR fixes an issue where timeout settings were not being applied when using OpenAI-compatible backends in a local environment.

Previously, even when custom timeout values were configured, requests would still terminate based on the default timeout behavior of the OpenAI Node SDK. This change ensures that the configured timeout values are correctly propagated and respected by the backend.

AI Code Review

  • Team members only: AI review runs automatically when the PR is opened or marked as ready for review
  • Team members can also trigger a review by commenting @continue-review

Checklist

  • I've read the contributing guide
  • The relevant docs, if any, have been updated or created
  • The relevant tests, if any, have been updated or created

Screen recording or screenshot

Before

before

After

after

Tests

Before this change, requests were terminated after 10 minutes, which matches the default timeout behavior described in the OpenAI Node SDK documentation:
https://github.com/openai/openai-node?tab=readme-ov-file#timeouts

This was observed when the downstream client (Continue CLI) exited due to the timeout, even though custom timeout values were configured.

After applying this patch, running the same configuration confirms that the custom timeout settings are correctly applied and requests are no longer terminated at the default 10-minute limit.


Continue Tasks: ▶️ 1 queued — View all


Summary by cubic

Ensure configured request timeouts are applied to OpenAI-compatible backends, preventing requests from being cut off at the SDK’s 10-minute default. This makes local runs honor custom timeout settings.

  • Bug Fixes
    • Pass config.requestOptions.timeout to the OpenAI client.
    • No change when timeout is unset (SDK default applies).

Written for commit bc206b0. Summary will update on new commits.

@micalgenus micalgenus requested a review from a team as a code owner January 30, 2026 13:40
@micalgenus micalgenus requested review from sestinj and removed request for a team January 30, 2026 13:40
@dosubot dosubot bot added the size:XS This PR changes 0-9 lines, ignoring generated files. label Jan 30, 2026
@github-actions
Copy link

github-actions bot commented Jan 30, 2026

All contributors have signed the CLA ✍️ ✅
Posted by the CLA Assistant Lite bot.

@micalgenus
Copy link
Author

I have read the CLA Document and I hereby sign the CLA

Copy link
Contributor

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 1 file

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XS This PR changes 0-9 lines, ignoring generated files.

Projects

Status: Todo

Development

Successfully merging this pull request may close these issues.

1 participant