c7e507ced6
build-gal-webgl-test.sh compiles kicad headers that need boost from build-wasm/sysroot/include — a host dir on dev machines but inside the kicad-build-cache docker volume on CI (run 27370316200: ptr_vector.hpp not found). The Makefile uses only $(SYSROOT)/include, so headers suffice. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
139 lines
6.4 KiB
YAML
139 lines
6.4 KiB
YAML
# EXPERIMENT: same full build + e2e as ci-full-build.yml, but on a Ubicloud
|
|
# runner instead of an ephemeral Hetzner VM. Ubicloud runners are plain
|
|
# runs-on labels — no create/delete-runner jobs, no shared one-slot lock.
|
|
# Triggered ONLY on the ubicloud-ci branch (and manual dispatch) so it never
|
|
# competes with the Hetzner main CI. ubicloud-standard-30 (x86, 30 vcpu) is
|
|
# the closest parity to the Hetzner ccx53 (32 cores) and matches the arch the
|
|
# e2e screenshot baselines were captured on.
|
|
|
|
name: CI full build + e2e (Ubicloud)
|
|
|
|
on:
|
|
push:
|
|
branches: ["ubicloud-ci"]
|
|
# docs-only commits must not burn a paid runner slot
|
|
paths-ignore: ["docs/**", "**.md"]
|
|
workflow_dispatch:
|
|
inputs:
|
|
binaryen_version: { description: "Binaryen version for the host asyncify+-O2 step", required: false, default: "130" }
|
|
|
|
concurrency:
|
|
group: ci-ubicloud # independent of the Hetzner wasm-opt-bench slot
|
|
cancel-in-progress: false
|
|
|
|
jobs:
|
|
build-and-test:
|
|
name: Build all tools + KiCad e2e (Ubicloud)
|
|
runs-on: ubicloud-standard-30
|
|
timeout-minutes: 300
|
|
env:
|
|
KICAD_LOG_NESTED: "1"
|
|
BINARYEN_VERSION: ${{ inputs.binaryen_version || '130' }}
|
|
steps:
|
|
# Docker comes preinstalled on Ubicloud images (validated by the arm64
|
|
# repro run) — only the Binaryen from-source toolchain is needed.
|
|
- name: Install build toolchain (Binaryen from-source)
|
|
run: |
|
|
export DEBIAN_FRONTEND=noninteractive
|
|
sudo apt-get update
|
|
# xvfb: kicad e2e runs headed Firefox under a virtual display — headless
|
|
# Firefox cannot create any GL context on the GPU-less VM (see
|
|
# tests/playwright-kicad.config.ts CI prefs).
|
|
# autoconf/automake/make: the host-side wxWidgets + wx test-app builds
|
|
# (build-wxuniversal-wasm.sh regenerates ./configure on fresh checkouts).
|
|
sudo apt-get install -y cmake ninja-build g++ libjemalloc2 xvfb autoconf automake make
|
|
|
|
- uses: actions/checkout@v4
|
|
with: { submodules: recursive }
|
|
|
|
- uses: actions/setup-node@v4
|
|
with: { node-version: 20 }
|
|
|
|
# Same build recipe as ci-full-build.yml: full KiCad WASM build of ALL 6
|
|
# tools, host-side asyncify + -O2 on Binaryen v130 (BINARYEN_VERSION in
|
|
# env → get-wasm-opt.sh). 'all' = pcbnew eeschema calculator pl_editor
|
|
# symbol_editor gerbview, built in sequence.
|
|
- name: Build all KiCad tools WASM with Binaryen ${{ env.BINARYEN_VERSION }}
|
|
run: |
|
|
# Lift the docker-compose dev-Mac caps and pipeline the host-side
|
|
# asyncify+-O2 with the next tool's container compile — same tuning
|
|
# as the Hetzner workflow (rationale in ci-full-build.yml and
|
|
# docs/ci-build-slowness-findings.md). standard-30: 30 vcpu / 120 GB.
|
|
# nproc-1: Ubicloud's preinstalled docker daemon rejects a cpus limit
|
|
# equal to the host CPU count ("range of CPUs is from 0.01 to 30.00",
|
|
# run 27330725978); the Hetzner box accepted 32-of-32.
|
|
export KICAD_DOCKER_CPUS="$(( $(nproc) - 1 ))" KICAD_DOCKER_MEM=110G
|
|
export KICAD_PIPELINE=1 BINARYEN_CORES=16
|
|
# Self-built wasm-opt: official x86_64-linux tarballs run asyncify
|
|
# ~4x slower than a stock gcc -O3+LTO build (A/B run 27276830256).
|
|
export BINARYEN_BUILD_FROM_SOURCE=1
|
|
echo "Building ALL tools with BINARYEN_VERSION=${BINARYEN_VERSION}, compile -j $(nproc) on ${KICAD_DOCKER_CPUS} CPUs, pipelined wasm-opt"
|
|
./docker/build.sh all --build-deps -j "$(nproc)"
|
|
echo "wasm-opt used:"; ./scripts/common/get-wasm-opt.sh --version 2>/dev/null || true
|
|
ls -lh output/*.wasm
|
|
|
|
# Host-side wxWidgets build producing the wx test apps for `npm run test`
|
|
# (separate from the in-docker wxWidgets that KiCad links against).
|
|
# Auto-installs emsdk into tools/ on first run.
|
|
- name: Build wxWidgets (wxUniversal WASM)
|
|
run: ./scripts/build-wxuniversal-wasm.sh
|
|
|
|
- name: Build wxWidgets test apps
|
|
run: ./scripts/build-wasm-test.sh
|
|
|
|
# The GAL test compiles against kicad headers that include boost from
|
|
# build-wasm/sysroot — a real host dir on dev machines, but inside the
|
|
# docker build-cache volume on CI (run 27370316200 failed with
|
|
# "boost/ptr_container/ptr_vector.hpp not found"). Its Makefile only
|
|
# needs $(SYSROOT)/include, so copy just the headers out of the volume.
|
|
- name: Expose docker sysroot headers to host builds
|
|
run: |
|
|
VOL=$(docker volume ls -q --filter name=kicad-build-cache | head -1)
|
|
echo "sysroot volume: $VOL"
|
|
mkdir -p build-wasm/sysroot
|
|
docker run --rm -v "$VOL":/bw -v "$PWD/build-wasm/sysroot":/host alpine \
|
|
sh -c 'cp -r /bw/sysroot/include /host/'
|
|
sudo chown -R "$(id -u):$(id -g)" build-wasm/sysroot
|
|
|
|
# gal_webgl_test.{js,wasm} are gitignored build artifacts with their own
|
|
# build script — without this, all 29 gal-webgl scenarios time out on
|
|
# galTest.isReady() because the page 404s the wasm (run 27359020746).
|
|
- name: Build GAL WebGL test app
|
|
run: ./scripts/build-gal-webgl-test.sh
|
|
|
|
- name: Install test deps
|
|
working-directory: tests
|
|
run: npm ci
|
|
|
|
- name: Install Playwright browsers
|
|
working-directory: tests
|
|
run: npx playwright install --with-deps firefox chromium
|
|
|
|
- name: Stage KiCad WASM for tests
|
|
working-directory: tests
|
|
run: npm run setup:kicad
|
|
|
|
# wxWidgets e2e: bundled headless Chromium + SwiftShader (CI-gated launch
|
|
# arg in tests/playwright.config.ts).
|
|
- name: wxWidgets e2e (npm run test)
|
|
working-directory: tests
|
|
run: npm run test
|
|
|
|
- name: KiCad e2e (npm run test:kicad:ci)
|
|
working-directory: tests
|
|
# xvfb-run: headed Firefox on a virtual display — WebGL needs GLX + Mesa
|
|
# llvmpipe, which headless Firefox can't reach on a GPU-less VM.
|
|
# test:kicad:ci adds the chromium-ci project: pcbnew's wasm exceeds
|
|
# SpiderMonkey's x86-64 code budget, so those specs run on Chromium.
|
|
run: xvfb-run -a npm run test:kicad:ci
|
|
|
|
- name: Upload test logs & screenshots
|
|
if: always()
|
|
uses: actions/upload-artifact@v4
|
|
with:
|
|
name: ubicloud-e2e-${{ github.run_id }}
|
|
path: |
|
|
tests/logs/**
|
|
tests/test-results/**
|
|
tests/playwright-report/**
|
|
if-no-files-found: ignore
|