Add baseline screenshots and visual regression testing

Browse source

Add infrastructure for visual regression testing of wxWidgets WASM rendering:

- Add 121 baseline screenshots capturing all UI states tested by Playwright
- Add scripts/compare-screenshots.sh to compare test results vs baseline
- Update tests/WHATWORKS.md with documentation on screenshot comparison
- Update wxwidgets submodule with dialog refactoring

The baseline screenshots cover:
- Main app tabs (Controls, Text Input, Drawing, Lists, OpenGL, Grid, Dialogs)
- Standalone test apps (menu, toolbar, layout, aui, clipboard, filedialog, etc.)
- Dialog/MessageBox rendering (info, yes/no, error, custom dialogs)
- OpenGL rendering tests (immediate mode, vertex arrays, matrix ops)
- UI interactions (dropdowns, tab switching, z-ordering)

Use ./scripts/compare-screenshots.sh to check for visual regressions.
Small byte differences (<2%) are typically timestamps, not visual changes.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

...

This commit is contained in:

Viktor Vaczi 2025-11-29 19:55:12 +01:00

parent c445955583

commit 961455ef54

124 changed files with 182 additions and 1 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

BIN

tests/baseline-screenshots/01-loading.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 5.9 KiB

BIN

tests/baseline-screenshots/03-after-load.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 30 KiB

BIN

tests/baseline-screenshots/04-controls-tab.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 34 KiB

BIN

tests/baseline-screenshots/05-text-input-tab.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 32 KiB

BIN

tests/baseline-screenshots/06-text-input-typed.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 34 KiB

BIN

tests/baseline-screenshots/07-drawing-tab.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 36 KiB

BIN

tests/baseline-screenshots/08-drawing-done.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/09-lists-tab.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 47 KiB

BIN

tests/baseline-screenshots/10-lists-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 44 KiB

BIN

tests/baseline-screenshots/10a-choice-dropdown-open.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 44 KiB

BIN

tests/baseline-screenshots/10b-choice-selected.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 43 KiB

BIN

tests/baseline-screenshots/10c-choice-dropdown-reopen.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 43 KiB

BIN

tests/baseline-screenshots/11-file-menu.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 80 KiB

BIN

tests/baseline-screenshots/12-help-menu.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 80 KiB

BIN

tests/baseline-screenshots/13-final.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 44 KiB

BIN

tests/baseline-screenshots/14-opengl-tab.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 79 KiB

BIN

tests/baseline-screenshots/15-opengl-tests.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 79 KiB

BIN

tests/baseline-screenshots/aui-01-loaded.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 32 KiB

BIN

tests/baseline-screenshots/aui-02-panels.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 32 KiB

BIN

tests/baseline-screenshots/aui-03-close-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 32 KiB

BIN

tests/baseline-screenshots/aui-04-dragged.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 32 KiB

BIN

tests/baseline-screenshots/aui-05-multi-panel.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 32 KiB

BIN

tests/baseline-screenshots/clipboard-01-loaded.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 35 KiB

BIN

tests/baseline-screenshots/clipboard-02-copy-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 35 KiB

BIN

tests/baseline-screenshots/clipboard-03-paste-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 35 KiB

BIN

tests/baseline-screenshots/clipboard-04-check-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 42 KiB

BIN

tests/baseline-screenshots/clipboard-05-clear-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 42 KiB

BIN

tests/baseline-screenshots/clipboard-06-full-flow.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 48 KiB

BIN

tests/baseline-screenshots/dialog-01-loaded.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 34 KiB

BIN

tests/baseline-screenshots/dialog-02-info-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 42 KiB

BIN

tests/baseline-screenshots/dialog-03-yesno-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 45 KiB

BIN

tests/baseline-screenshots/dialog-04-error-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 42 KiB

BIN

tests/baseline-screenshots/dialog-05-custom-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 34 KiB

BIN

tests/baseline-screenshots/dialogs-00-initial.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 30 KiB

BIN

tests/baseline-screenshots/dialogs-01-tab-selected.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-custom-closed.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 56 KiB

BIN

tests/baseline-screenshots/dialogs-custom-open.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 56 KiB

BIN

tests/baseline-screenshots/dialogs-full-flow.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 56 KiB

BIN

tests/baseline-screenshots/dialogs-msgbox-error-closed.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-msgbox-error-open.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-msgbox-info-closed.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-msgbox-info-open.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-msgbox-yesno-closed.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-msgbox-yesno-open.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-timer-initial.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-timer-multiple.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-timer-running.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-timer-started.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/dialogs-timer-stopped.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 46 KiB

BIN

tests/baseline-screenshots/filedialog-01-loaded.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 24 KiB

BIN

tests/baseline-screenshots/filedialog-02-open-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 24 KiB

BIN

tests/baseline-screenshots/filedialog-03-save-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 24 KiB

BIN

tests/baseline-screenshots/filedialog-04-multiple-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 24 KiB

BIN

tests/baseline-screenshots/filedialog-05-all-buttons.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 24 KiB

BIN

tests/baseline-screenshots/gl-01-opengl-tab.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 69 KiB

BIN

tests/baseline-screenshots/gl-02-vertex-arrays-selected.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 75 KiB

BIN

tests/baseline-screenshots/gl-03-after-wait.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 75 KiB

BIN

tests/baseline-screenshots/gl-run-all-tests.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 69 KiB

BIN

tests/baseline-screenshots/gl-test-0-immediate-mode.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 73 KiB

BIN

tests/baseline-screenshots/gl-test-1-matrix-ops.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 72 KiB

BIN

tests/baseline-screenshots/gl-test-2-vertex-arrays.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 82 KiB

BIN

tests/baseline-screenshots/gl-test-3-state-mgmt.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 80 KiB

BIN

tests/baseline-screenshots/gl-test-4-texture-coords.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 80 KiB

BIN

tests/baseline-screenshots/glcanvas-01-on-opengl-tab.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 70 KiB

BIN

tests/baseline-screenshots/glcanvas-02-after-switch-to-controls.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 38 KiB

BIN

tests/baseline-screenshots/glcanvas-03-on-drawing-tab.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 36 KiB

BIN

tests/baseline-screenshots/glcanvas-04-on-lists-tab.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 43 KiB

BIN

tests/baseline-screenshots/grid-tab-final.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 41 KiB

BIN

tests/baseline-screenshots/layout-01-loaded.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 64 KiB

BIN

tests/baseline-screenshots/layout-02-splitter.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 64 KiB

BIN

tests/baseline-screenshots/layout-03-sash-dragged.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 64 KiB

BIN

tests/baseline-screenshots/layout-04-scrolled-left.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 66 KiB

BIN

tests/baseline-screenshots/layout-05-scrolled-right.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 63 KiB

BIN

tests/baseline-screenshots/layout-06-combined.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 64 KiB

BIN

tests/baseline-screenshots/menu-01-loaded.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 28 KiB

BIN

tests/baseline-screenshots/menu-02-menubar.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 28 KiB

BIN

tests/baseline-screenshots/menu-03-file-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 28 KiB

BIN

tests/baseline-screenshots/menu-04-edit-clicked.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 31 KiB

BIN

tests/baseline-screenshots/menu-05-all-menus.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 29 KiB

BIN

tests/baseline-screenshots/opengl-after-tests.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 70 KiB

BIN

tests/baseline-screenshots/opengl-before-debug.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 70 KiB

BIN

tests/baseline-screenshots/opengl-render.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 70 KiB

BIN

tests/baseline-screenshots/opengl-tab-initial.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 70 KiB

BIN

tests/baseline-screenshots/searchctrl-01-visible.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 41 KiB

BIN

tests/baseline-screenshots/searchctrl-02-typing.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 41 KiB

BIN

tests/baseline-screenshots/searchctrl-03-after-enter.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 41 KiB

BIN

tests/baseline-screenshots/spinctrl-01-visible.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 41 KiB

BIN

tests/baseline-screenshots/spinctrl-02-after-click.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 41 KiB

BIN

tests/baseline-screenshots/tabswitch-01-controls.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 30 KiB

BIN

tests/baseline-screenshots/tabswitch-02-opengl.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 70 KiB

BIN

tests/baseline-screenshots/tabswitch-03-lists.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 37 KiB

BIN

tests/baseline-screenshots/tabswitch-04-opengl.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 76 KiB

BIN

tests/baseline-screenshots/tabswitch-05-drawing.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 39 KiB

BIN

tests/baseline-screenshots/tabswitch-06-controls.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 45 KiB

BIN

tests/baseline-screenshots/timer-01-loaded.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 35 KiB

BIN

tests/baseline-screenshots/timer-02-started.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 35 KiB

BIN

tests/baseline-screenshots/timer-05-fast-started.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 35 KiB

BIN

tests/baseline-screenshots/timer-08-reset.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 35 KiB

BIN

tests/baseline-screenshots/toolbar-01-loaded.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 36 KiB

BIN

tests/baseline-screenshots/toolbar-02-buttons.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 36 KiB

Some files were not shown because too many files have changed in this diff Show more