Skip to content

test: add multi-report merge test for issue#261

Open
Ma11hewThomas wants to merge 2 commits intomainfrom
test/issue-258-multi-report-summary
Open

test: add multi-report merge test for issue#261
Ma11hewThomas wants to merge 2 commits intomainfrom
test/issue-258-multi-report-summary

Conversation

@Ma11hewThomas
Copy link
Contributor

Adds two dummy CTRF shard reports simulating Playwright sharded runs:

  • shard-1: 53 tests (24 passed, 3 failed, 26 skipped)
  • shard-2: 49 tests (34 passed, 3 failed, 12 skipped)
  • Expected merged: 102 tests, 58 passed, 6 failed, 38 skipped

Adds workflow that triggers on PR to test whether the summary table shows merged totals or only a single shard's data.

Do not merge

Adds two dummy CTRF shard reports simulating Playwright sharded runs:
- shard-1: 53 tests (24 passed, 3 failed, 26 skipped)
- shard-2: 49 tests (34 passed, 3 failed, 12 skipped)
- Expected merged: 102 tests, 58 passed, 6 failed, 38 skipped

Adds workflow that triggers on PR to test whether the summary table
shows merged totals or only a single shard's data.

Refs #258
@github-actions
Copy link

Issue #258 - Multi-report merge test

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
102 58 6 38 0 0 35.0s

test-multi-report-summary: Run #1

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
102 58 6 38 0 0 0 35.0s

Some tests failed!

Name Failure Message
❌ Project permissions restrict access Expected 403 response but got 200
❌ Team activity log is accurate Activity log missing last 2 entries
❌ Bulk file delete works Expected 0 files remaining but found 2
❌ MFA prompt appears for enabled accounts Expected MFA dialog to be visible
❌ Notification bell shows unread count Expected badge count to be 3, got 0

See all failed tests here

Github Test Reporter by CTRF 💚

@github-actions
Copy link

build-and-test: Run #1394

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
77 77 0 0 0 0 0 12.8s

🎉 All tests passed!

Github Test Reporter by CTRF 💚

@github-actions
Copy link

Issue #258 - Multi-report merge test

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
102 58 6 38 0 0 35.0s

test-multi-report-summary: Run #2

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
102 58 6 38 0 0 0 35.0s

Some tests failed!

Name Failure Message
❌ Project permissions restrict access Expected 403 response but got 200
❌ Team activity log is accurate Activity log missing last 2 entries
❌ Bulk file delete works Expected 0 files remaining but found 2
❌ MFA prompt appears for enabled accounts Expected MFA dialog to be visible
❌ Notification bell shows unread count Expected badge count to be 3, got 0

See all failed tests here

Github Test Reporter by CTRF 💚

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant