-
Notifications
You must be signed in to change notification settings - Fork 67
fix(e2e): improve test stability and developer experience #337
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…w servers - Add HOST_MASKS for Tool Input/Result panels with dynamic timestamps - Add say-server to SLOW_SERVERS (10s) for TTS model download - Add say-server to EXTRA_WAIT_MS (30s) in generate-grid-screenshots
@modelcontextprotocol/ext-apps
@modelcontextprotocol/server-basic-react
@modelcontextprotocol/server-basic-vanillajs
@modelcontextprotocol/server-budget-allocator
@modelcontextprotocol/server-cohort-heatmap
@modelcontextprotocol/server-customer-segmentation
@modelcontextprotocol/server-map
@modelcontextprotocol/server-pdf
@modelcontextprotocol/server-scenario-modeler
@modelcontextprotocol/server-shadertoy
@modelcontextprotocol/server-sheet-music
@modelcontextprotocol/server-system-monitor
@modelcontextprotocol/server-threejs
@modelcontextprotocol/server-transcript
@modelcontextprotocol/server-video-resource
@modelcontextprotocol/server-wiki-explorer
commit: |
… screenshots - Add hideThemeToggle param to getQueryParams() - Conditionally render ThemeToggle based on ?theme=hide - Update e2e tests to use ?theme=hide for consistent screenshots
|
@ochafik looks good! (I know this is still a draft) - note that currently (with these fixes) the e2e tests break locally - since the generated image on MacOS don't match the ones that are generated in the CI. Perhaps we need to test e2e locally only with the docker |
|
@ochafik should we merge this so at least the CI will pass? |
liady
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this doesnt fix the local dev e2e, but we can merge it so that the CI will pass
Summary
Comprehensive improvements to e2e test stability and developer experience.
Changes
E2E Test Stability
HOST_MASKSfor Tool Input/Result panels with timestampssay-server: 10s in tests, 30s in grid screenshots (TTS model download)map-server: 15s (CesiumJS tile loading)waitForAppLoad: 30s (nested iframe loading)?theme=hideparam: Hide theme toggle for consistent screenshotsDeveloper Experience
update-lock:dockerscript: Regenerate package-lock.json with public npm registryCI/CD
update-snapshots.yml- manually trigger snapshot updates via GitHub ActionsBasic Host
?theme=hidequery param: Hide theme toggle buttonhttp://localhost:8080/?theme=hideTesting
All e2e tests passing after snapshot regeneration.