Skip to content

fix(ci): silence sidecar flush-timeout log noise in client_side_stats test#3949

Draft
Leiyks wants to merge 1 commit into
masterfrom
leiyks/fix-ci-crashtracker-threads
Draft

fix(ci): silence sidecar flush-timeout log noise in client_side_stats test#3949
Leiyks wants to merge 1 commit into
masterfrom
leiyks/fix-ci-crashtracker-threads

Conversation

@Leiyks

@Leiyks Leiyks commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Under concurrent CI load, tests/ext/request-replayer/client_side_stats.phpt intermittently failed on a stray [ddtrace] [error] Failed synchronously flushing traces: Kind(TimedOut) line from the best-effort 5s synchronous flush — the stats themselves still arrive via the polled async sidecar path. Add DD_TRACE_LOG_LEVEL=off, matching its sibling tests client_side_stats_peer_tags / client_side_stats_trace_filters. Verified 60/60 under load in docker.

Note: the crashtracker thread-format fix originally here is now redundant — landed on master via #3953 — so this branch was rebased to contain only the client_side_stats fix.

@datadog-official

datadog-official Bot commented Jun 3, 2026

Copy link
Copy Markdown

Pipelines  Tests

Fix all issues with BitsAI

⚠️ Warnings

🚦 14 Pipeline jobs failed

DataDog/apm-reliability/dd-trace-php | ASAN Opcache tests: [8.5]   View in Datadog   GitLab

DataDog/apm-reliability/dd-trace-php | test_extension_ci: [7.0]   View in Datadog   GitLab

DataDog/apm-reliability/dd-trace-php | test_extension_ci: [7.1]   View in Datadog   GitLab

View all 14 failed jobs.

ℹ️ Info

No other issues found (see more)

🧪 All tests passed
❄️ No new flaky tests detected

🔄 Datadog auto-retried 6 jobs - 1 passed on retry View in Datadog

🎯 Code Coverage (details)
Patch Coverage: 100.00%
Overall Coverage: 54.12% (+0.00%)

Useful? React with 👍 / 👎

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 7b1e0a8 | Docs | Datadog PR Page | Give us feedback!

@Leiyks Leiyks force-pushed the leiyks/fix-ci-crashtracker-threads branch from d340f37 to 6da4162 Compare June 5, 2026 12:49
@Leiyks Leiyks changed the title fix(ci): read flattened error.threads list in crashtracker collect-all-threads test fix(ci): silence sidecar flush-timeout log noise in client_side_stats test Jun 5, 2026
…est_extension_ci]

Default-config .phpt tests fall back to the ddtrace default agent localhost:8126,
which has no listener in the CI container. Their sidecar trace sends get ECONNREFUSED
and retry (max_retries=5, exponential backoff, ~21s). Because the sidecar trace
flusher is shared across sessions, those doomed sends stall the synchronous flush of
unrelated tests (e.g. client_side_stats) past the 10s IPC read timeout -> flaky
'Failed synchronously flushing traces: Kind(TimedOut)'.

Point default traffic at the already-provisioned test-agent (9126) so those sends
succeed fast. Uses DD_AGENT_HOST/DD_TRACE_AGENT_PORT (not DD_TRACE_AGENT_URL) so
per-test --ENV-- DD_AGENT_HOST=request-replayer still takes precedence.
@Leiyks Leiyks force-pushed the leiyks/fix-ci-crashtracker-threads branch from bc04aed to 7b1e0a8 Compare June 9, 2026 16:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant