Skip to content

Commit 3457624

Browse files
authored
Increase sglang retries on CI (tensorzero#2953)
This should help to ensure a pass on the tool-call tests when running without the provider-proxy cache
1 parent 5d24c92 commit 3457624

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

.config/nextest.toml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -81,6 +81,8 @@ slow-timeout = { period = "60s", terminate-after = 2 }
8181

8282
[[profile.default.overrides]]
8383
filter = 'binary(e2e) and test(providers::sglang::)'
84+
# The model we run on SGLang often fails to emit valid tool calls, so we need many retries
85+
retries = { backoff = "fixed", count = 8, delay = "10s", jitter = true }
8486
slow-timeout = { period = "60s", terminate-after = 2 }
8587

8688
[[profile.default.overrides]]

0 commit comments

Comments
 (0)