fix(tests): keep test-results across CI suites; loud pipeline alert
The screenshot report went silent on green CI runs. CI runs four sequential
`playwright test` invocations (wx, asyncify, kicad, perf) that all default their
outputDir to `test-results`; Playwright clears the whole outputDir at the start
of every run, so each suite wiped the previous suite's screenshots. By the time
`compare` ran, only perf-*.json remained -> all 354 baselines read as "removed"
-> the no-render guard stayed silent.
- Gate Playwright's outputDir off test-results/ in CI only
(process.env.CI ? 'pw-artifacts/<suite>' : 'test-results') in the wx / asyncify
/ kicad configs, so the committed-baseline screenshots (page.screenshot to
'test-results/...') accumulate in test-results/ across the suites for compare.
Local single-suite behavior is unchanged.
- post-discord: replace the silent no-render guard with a loud, image-less
pipeline alert ("No screenshots produced this run") when 0 render; genuine
partial removals still post as the normal capped REMOVED list.
- gitignore pw-artifacts/; upload tests/pw-artifacts/** as a CI artifact.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
parent
9b41d7321f
commit
b270507505
6 changed files with 31 additions and 4 deletions
1
.github/workflows/wasm-build.yml
vendored
1
.github/workflows/wasm-build.yml
vendored
|
|
@ -368,5 +368,6 @@ jobs:
|
|||
path: |
|
||||
tests/logs/**
|
||||
tests/test-results/**
|
||||
tests/pw-artifacts/**
|
||||
tests/playwright-report/**
|
||||
if-no-files-found: ignore
|
||||
|
|
|
|||
Loading…
Reference in a new issue