chore: playwright by kyle-ssg · Pull Request #6562 · Flagsmith/flagsmith

kyle-ssg · 2026-01-20T17:27:09Z

I have read the Contributing Guide.
I have added information to docs/ if required so people know about the feature.
I have filled in the "Changes" section below.
I have filled in the "How did you test this code" section below.

Changes

Playwright Test Improvements

Faster Tests

Inputs are really fast compared to TestCafe
Tests are passing in CI around 2m30s vs ~4m

Better Local Development

Tests are re-runable via ui (you'll have to run npm run test:teardown before clicking play again)
Tests come with videos and clickable traces (these get uploaded from GitHub on failures too)
Tests can be ran very quickly and can be repeated (E2E_REPEAT=x) and exit on first failed test (E2E_RETRIES=0)

Added Claude Commands

/e2e - Run all tests (OSS + Enterprise)
/e2e-oss - Run OSS tests, auto-fix failures, re-run until passing
/e2e-ee - Run Enterprise tests, auto-fix failures, re-run until passing
/e2e-create - Create a new test following existing patterns

Note: You can have the tests repeat to guarantee no flakiness

/e2e 5 → Runs all tests with E2E_REPEAT=5 (runs once, then 5 more times if passing)
/e2e-oss 5 → Same for OSS tests only
/e2e-ee 5 → Same for enterprise tests only

HTML Reports

Interactive dashboard with search/filter
Test timeline and duration metrics
Detailed error messages with stack traces

e.g. this is a downloaded report, we can access reports of failures as well as videos / interactive traces.

CI/CD Features

GitHub Integration

Sticky PR comments with failure summaries
Direct links to ZIP artifacts containing:
HTML report
Videos of failures
Interactive traces
Screenshots
Automatic artifact cleanup

How did you test this code?

No code changes, all e2e refactoring
Run local image and keep track of any failures

…ride-row

…chore/componentise-feature-override-row # Conflicts: # frontend/web/components/feature-override/FeatureOverrideRow.tsx

github-actions · 2026-02-04T12:20:16Z

Playwright Test Results (oss - depot-ubuntu-latest-16)

9 passed

Details

9 tests across 7 suites
41.5 seconds
0613679
🔄 Run: #14783 (attempt 1)

github-actions · 2026-02-04T12:20:55Z

Playwright Test Results (oss - depot-ubuntu-latest-arm-16)

9 passed

Details

9 tests across 7 suites
1 minute, 2 seconds
0613679
🔄 Run: #14783 (attempt 1)

github-actions · 2026-02-04T12:21:40Z

Playwright Test Results (private-cloud - depot-ubuntu-latest-16)

2 passed

Details

2 tests across 2 suites
43.3 seconds
0613679
🔄 Run: #14783 (attempt 1)

github-actions · 2026-02-04T12:22:35Z

Playwright Test Results (private-cloud - depot-ubuntu-latest-arm-16)

1 passed

Details

1 test across 1 suite
1 minute, 4 seconds
0613679
🔄 Run: #14783 (attempt 1)

Zaimwa9

I'm happy to see all the tests green on my side. I have a couple of comments coming from making it happen with my setup.
I now use the docker-compose-e2e-tests, it's way more convenient than jungling with api + task processor.

Almost good to go on my side once you confirm.

@talissoncosta, I think a second review is worth here, especially to get familiar with the new setup and confirm we are all able to get the E2E suite to run on our locals

frontend/docker-compose-e2e-tests.yml

frontend/package.json

Zaimwa9 · 2026-02-06T11:30:24Z

frontend/webpack/plugins.js

 module.exports = [

    new webpack.DefinePlugin({
-        E2E: process.env.E2E,


I think we need it. I had to re-add it

Nope we dont need this - why did you need to re-add it ?

frontend/e2e/run-with-retry.ts

frontend/README.md

Zaimwa9 · 2026-02-06T14:29:34Z

frontend/README.md

+npm run test
+
+# Run with Playwright UI (for debugging)
+npm run test:dev


I would just precise that you need to build the bundle first with E2E=true npm run bundle here

We dont need E2E=true anymore

Co-authored-by: Zaimwa9 <wadii.zaim@flagsmith.com>

…ywright

# Conflicts: # frontend/README.md # frontend/package-lock.json

kyle-ssg added 30 commits September 16, 2025 10:28

fix feature override import

5fa2c8f

Fix tests

b526540

Merge branch 'feat/segment-page' into chore/componentise-feature-over…

36d5c78

…ride-row

Fix segment tab classes

3b246bd

Fix segment tab classes

53f967a

Add toast

73d31a1

Add manageSegmentsPermission to create segment

6e19718

Refactor remove segment

3c90c18

Merge branch 'feat/segment-page' into chore/componentise-feature-over…

b7826e9

…ride-row

Merge branch 'main' into chore/componentise-feature-override-row

5bf0aac

Merge branch 'main' into chore/componentise-feature-override-row

3d51e9c

fix identity override

0633e23

Componentise overrides

b8f706a

Componentise overrides

c7fd718

Refactor

c5d433a

Improve feature override row refactoring

ec576fb

CTA Feature override

149fc8c

re-add tests

596f736

Refactor

022c27d

Chore/componentise feature override row improved (#6118)

480a0a8

Refactor

9d6f43a

Merge branch 'chore/componentise-feature-override-row-improved' into …

f91a243

…chore/componentise-feature-override-row # Conflicts: # frontend/web/components/feature-override/FeatureOverrideRow.tsx

Permission fix

661872f

fix identifier

162fceb

Fix identityName param

e52f9f9

Fix edit permission check

0ba5c15

Componentise feature filters

80811d5

Fix segment override logic

a5dc772

Fix identity override logic

4d340e3

Fix identity override logic

3ee508e

kyle-ssg requested a review from Zaimwa9 February 4, 2026 12:20

Improve PR labelling, merge retry results with failures

8a3d436

github-actions bot added chore and removed chore labels Feb 4, 2026

vercel bot deployed to Preview – flagsmith-frontend-staging February 4, 2026 12:52 View deployment

vercel bot deployed to Preview – flagsmith-frontend-preview February 4, 2026 12:52 View deployment

Zaimwa9 reviewed Feb 6, 2026

View reviewed changes

kyle-ssg and others added 2 commits February 6, 2026 15:44

Update frontend/e2e/run-with-retry.ts

384eb82

Co-authored-by: Zaimwa9 <wadii.zaim@flagsmith.com>

Update frontend/package.json

29a0216

Co-authored-by: Zaimwa9 <wadii.zaim@flagsmith.com>

vercel bot deployed to Preview – flagsmith-frontend-staging February 6, 2026 15:47 View deployment

vercel bot deployed to Preview – flagsmith-frontend-preview February 6, 2026 15:47 View deployment

kyle-ssg added 2 commits February 6, 2026 15:47

Remove E2E = true

e8d85b4

Merge remote-tracking branch 'origin/chore/playwright' into chore/pla…

58f343a

…ywright

vercel bot deployed to Preview – flagsmith-frontend-staging February 6, 2026 15:50 View deployment

vercel bot deployed to Preview – flagsmith-frontend-preview February 6, 2026 15:50 View deployment

Merge branch 'main' into chore/playwright

b2d394e

# Conflicts: # frontend/README.md # frontend/package-lock.json

vercel bot deployed to Preview – docs February 6, 2026 15:51 View deployment

github-actions bot added chore and removed chore labels Feb 6, 2026

vercel bot deployed to Preview – flagsmith-frontend-staging February 6, 2026 15:53 View deployment

vercel bot deployed to Preview – flagsmith-frontend-preview February 6, 2026 15:53 View deployment

Remove E2E = true, fix package-lock

0613679

github-actions bot added chore and removed chore labels Feb 6, 2026

vercel bot had a problem deploying to Preview – flagsmith-frontend-staging February 6, 2026 16:12 Failure

vercel bot had a problem deploying to Preview – flagsmith-frontend-preview February 6, 2026 16:12 Failure

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore: playwright#6562

chore: playwright#6562
kyle-ssg wants to merge 262 commits intomainfrom
chore/playwright

kyle-ssg commented Jan 20, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Feb 4, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Feb 4, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Feb 4, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Feb 4, 2026 •

edited

Loading

Uh oh!

Zaimwa9 left a comment

Uh oh!

Uh oh!

Uh oh!

Zaimwa9 Feb 6, 2026

Uh oh!

kyle-ssg Feb 6, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Zaimwa9 Feb 6, 2026

Uh oh!

kyle-ssg Feb 6, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

kyle-ssg commented Jan 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Playwright Test Improvements

Faster Tests

Better Local Development

Added Claude Commands

HTML Reports

CI/CD Features

How did you test this code?

Uh oh!

github-actions bot commented Feb 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Playwright Test Results (oss - depot-ubuntu-latest-16)

Details

Uh oh!

github-actions bot commented Feb 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Playwright Test Results (oss - depot-ubuntu-latest-arm-16)

Details

Uh oh!

github-actions bot commented Feb 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Playwright Test Results (private-cloud - depot-ubuntu-latest-16)

Details

Uh oh!

github-actions bot commented Feb 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Playwright Test Results (private-cloud - depot-ubuntu-latest-arm-16)

Details

Uh oh!

Zaimwa9 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Zaimwa9 Feb 6, 2026

Choose a reason for hiding this comment

Uh oh!

kyle-ssg Feb 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Zaimwa9 Feb 6, 2026

Choose a reason for hiding this comment

Uh oh!

kyle-ssg Feb 6, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

kyle-ssg commented Jan 20, 2026 •

edited

Loading

github-actions bot commented Feb 4, 2026 •

edited

Loading

github-actions bot commented Feb 4, 2026 •

edited

Loading

github-actions bot commented Feb 4, 2026 •

edited

Loading

github-actions bot commented Feb 4, 2026 •

edited

Loading

kyle-ssg Feb 6, 2026 •

edited

Loading