2025-11-28 13:10:05 +01:00
|
|
|
# KiCad WASM Tests
|
|
|
|
|
|
|
|
|
|
Playwright tests for verifying the wxWidgets WASM port.
|
|
|
|
|
|
|
|
|
|
## Prerequisites
|
|
|
|
|
|
|
|
|
|
- Node.js 18+
|
|
|
|
|
- Emscripten SDK (for building)
|
|
|
|
|
|
|
|
|
|
## Building the Test App
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
../scripts/build-wasm-test.sh
|
|
|
|
|
```
|
|
|
|
|
|
2025-11-29 20:54:54 +01:00
|
|
|
This builds `wasm-app/minimal_test.{html,js,wasm}` and standalone test apps.
|
2025-11-28 13:10:05 +01:00
|
|
|
|
|
|
|
|
## Running Tests
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
npm install
|
|
|
|
|
npm test
|
|
|
|
|
```
|
|
|
|
|
|
2025-11-29 20:54:54 +01:00
|
|
|
To run specific tests:
|
|
|
|
|
```bash
|
|
|
|
|
npx playwright test menu.spec.ts # Run menu tests only
|
|
|
|
|
npx playwright test --grep "wxTimer" # Run tests matching pattern
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
## Test Structure
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
tests/
|
|
|
|
|
├── e2e/ # Playwright test specs
|
|
|
|
|
│ ├── utils/ # Shared test utilities
|
|
|
|
|
│ │ ├── fixtures.ts # Playwright fixtures with auto-logging
|
|
|
|
|
│ │ └── test-utils.ts # Logging and helper functions
|
|
|
|
|
│ ├── menu.spec.ts # wxMenuBar tests
|
|
|
|
|
│ ├── timer.spec.ts # wxTimer tests
|
|
|
|
|
│ ├── dialog.spec.ts # wxDialog/wxMessageBox tests
|
|
|
|
|
│ ├── tree.spec.ts # wxTreeCtrl tests
|
|
|
|
|
│ ├── grid.spec.ts # wxGrid/wxSpinCtrl/wxSearchCtrl tests
|
|
|
|
|
│ ├── opengl.spec.ts # OpenGL tab tests
|
|
|
|
|
│ ├── wxwidgets.spec.ts # Comprehensive UI interaction tests
|
|
|
|
|
│ └── ...
|
|
|
|
|
├── logs/ # Test logs (auto-generated)
|
|
|
|
|
├── test-results/ # Screenshots (auto-generated)
|
|
|
|
|
├── baseline-screenshots/ # Reference screenshots for comparison
|
|
|
|
|
├── wasm-app/ # Built WASM test applications
|
|
|
|
|
│ ├── minimal_test.html # Main test app
|
|
|
|
|
│ └── standalone/ # Individual component test apps
|
|
|
|
|
└── playwright.config.ts # Playwright configuration
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
## Logging
|
|
|
|
|
|
|
|
|
|
Each test automatically captures:
|
|
|
|
|
- Console logs with timestamps and log levels
|
|
|
|
|
- Page errors with full stack traces
|
|
|
|
|
|
|
|
|
|
Log files are written to `logs/` after each test:
|
|
|
|
|
- `<test-name>.log` - All console output
|
|
|
|
|
- `<test-name>.errors.log` - Errors only (created if errors occurred)
|
|
|
|
|
|
|
|
|
|
Example log format:
|
|
|
|
|
```
|
|
|
|
|
[2025-11-29T19:39:42.165Z] [LOG] [EVENT] Application started
|
|
|
|
|
[2025-11-29T19:39:42.733Z] [WARNING] GPU stall due to ReadPixels
|
|
|
|
|
[2025-11-29T19:39:42.801Z] [ERROR] Some error message
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
## Screenshots
|
|
|
|
|
|
|
|
|
|
Tests capture screenshots to `test-results/`. Compare against baselines:
|
|
|
|
|
```bash
|
|
|
|
|
../scripts/compare-screenshots.sh
|
|
|
|
|
```
|
|
|
|
|
|
2025-11-28 13:10:05 +01:00
|
|
|
## Viewing the App Directly
|
|
|
|
|
|
|
|
|
|
Start a local server in the wasm-app directory:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
cd wasm-app
|
|
|
|
|
npx serve .
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Then open http://localhost:3000/minimal_test.html in your browser.
|
|
|
|
|
|
|
|
|
|
Alternative using Python:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
cd wasm-app
|
|
|
|
|
python3 -m http.server 8000
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Then open http://localhost:8000/minimal_test.html
|
2025-11-29 20:54:54 +01:00
|
|
|
|
|
|
|
|
## Test Categories
|
|
|
|
|
|
|
|
|
|
| Spec File | Tests | Description |
|
|
|
|
|
|-----------|-------|-------------|
|
|
|
|
|
| `wxwidgets.spec.ts` | Comprehensive | Full UI interaction, stability, OpenGL |
|
|
|
|
|
| `menu.spec.ts` | wxMenuBar | Menu bar visibility and interactions |
|
|
|
|
|
| `timer.spec.ts` | wxTimer | Timer start/stop/reset functionality |
|
|
|
|
|
| `dialog.spec.ts` | wxDialog | Message boxes and custom dialogs |
|
|
|
|
|
| `tree.spec.ts` | wxTreeCtrl | Tree control with expand/collapse |
|
|
|
|
|
| `grid.spec.ts` | wxGrid | Grid, SpinCtrl, SearchCtrl |
|
|
|
|
|
| `opengl.spec.ts` | OpenGL | GL tests (immediate mode, vertex arrays) |
|
|
|
|
|
| `aui.spec.ts` | wxAuiManager | Dockable panels |
|
|
|
|
|
| `clipboard.spec.ts` | wxClipboard | Copy/paste operations |
|
|
|
|
|
| `filedialog.spec.ts` | wxFileDialog | File open/save dialogs |
|
|
|
|
|
| `layout.spec.ts` | wxSplitter | Splitter and scrolled windows |
|
|
|
|
|
| `toolbar.spec.ts` | wxToolBar | Toolbar buttons and status bar |
|
|
|
|
|
|
2025-11-29 22:15:56 +01:00
|
|
|
## Debugging WASM Crashes
|
|
|
|
|
|
|
|
|
|
When a test fails with a WASM crash (e.g., "memory access out of bounds"), you can build with debug symbols to get meaningful stack traces:
|
|
|
|
|
|
|
|
|
|
### Debug Build
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
# Build test apps with DWARF symbols and source maps
|
|
|
|
|
../scripts/build-wasm-test.sh --debug
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
This enables:
|
|
|
|
|
- `-g` for DWARF debug info
|
|
|
|
|
- `-gsource-map` for browser source maps
|
|
|
|
|
- `-O0` for no optimization (preserves debugging context)
|
|
|
|
|
|
|
|
|
|
### Reading Stack Traces
|
|
|
|
|
|
|
|
|
|
With a debug build, WASM stack traces show actual function names:
|
|
|
|
|
|
|
|
|
|
**Before (release build):**
|
|
|
|
|
```
|
|
|
|
|
RuntimeError: memory access out of bounds
|
|
|
|
|
at wasm-function[102]:0xfdf8
|
|
|
|
|
at wasm-function[99]:0xe6e0
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**After (debug build):**
|
|
|
|
|
```
|
|
|
|
|
RuntimeError: memory access out of bounds
|
|
|
|
|
at grid_test.wasm.GridTestFrame::LogEvent(wxString const&)
|
|
|
|
|
at grid_test.wasm.GridTestFrame::OnGridCellSelect(wxGridEvent&)
|
|
|
|
|
at grid_test.wasm.wxEventFunctorMethod<...>::operator()
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
### Using LLVM Tools
|
|
|
|
|
|
|
|
|
|
For deeper analysis, use Emscripten's LLVM tools:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
LLVM_DIR="/opt/homebrew/Cellar/emscripten/4.0.20/libexec/llvm/bin"
|
|
|
|
|
|
|
|
|
|
# Check if WASM has DWARF info
|
|
|
|
|
$LLVM_DIR/llvm-dwarfdump --debug-info wasm-app/standalone/grid/grid_test.wasm
|
|
|
|
|
|
|
|
|
|
# Disassemble with function names
|
|
|
|
|
$LLVM_DIR/llvm-objdump -d grid_test.wasm | head -200
|
|
|
|
|
```
|
|
|
|
|
|
2025-11-29 20:54:54 +01:00
|
|
|
## Known Issues
|
|
|
|
|
|
|
|
|
|
- **Timer tests**: May fail due to timing sensitivity
|
|
|
|
|
- **Tree tests**: Button click positions may vary
|