Skip to content

Infrastructure: add native desktop driver providers - #4306

Merged
Jason Morse (JasonVMo) merged 15 commits into
mainfrom
user/jasonvmo/native-driver
Sep 3, 2026
Merged

Infrastructure: add native desktop driver providers#4306
Jason Morse (JasonVMo) merged 15 commits into
mainfrom
user/jasonvmo/native-driver

Conversation

@JasonVMo

Copy link
Copy Markdown
Contributor

Summary

  • add source-built Windows/Win32 and macOS native helpers behind the shared Desktop Driver protocol, verified cache, exact application leases, cancellation, input recovery, accessibility, and native capture contracts
  • integrate the helpers with Desktop Storybook so render-only smoke remains independent while stories-and-tests attaches to the exact owned application and runs component-authored plans
  • reorganize the Desktop Driver package documentation around a user-focused README, dedicated architecture/service/native/testing/CI/security references, provider-local native guides, and a remaining-work-only plan
  • update the macOS Storybook PR job to create a trusted ephemeral code-signing identity, explicitly build the signed helper, verify its certificate and noninteractive permission diagnostic, reuse the artifact through prep/smoke, and upload the diagnostic with failure evidence

macOS CI authority model

The hosted job never prompts for privacy access or modifies TCC. desktop-driver doctor --permissions records the actual Accessibility, PostEvent, and Screen Recording state, while capability-gated tests report unavailable hosted-runner authority explicitly instead of producing a false pass.

Validation

  • yarn lint-repo
  • yarn format:check .github/workflows/pr.yml packages/agentic/desktop-driver/references/ci-integration.md
  • parsed the updated workflow as YAML and validated both embedded scripts with bash -n
  • executed the exact signing and driver workflow steps on macOS, including yarn storybook build-driver --macos and yarn desktop-driver doctor --platform macos --permissions, and verified the signed helper certificate matched the configured identity

Fixes #4257

Jason Morse (JasonVMo) and others added 10 commits August 31, 2026 14:35
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Refine native process, input, cache, framing, timeout, and UI Automation behavior after the Windows implementation audit.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Provision a trusted ephemeral signing identity, build and verify the native helper explicitly, and retain noninteractive permission diagnostics with Storybook smoke artifacts.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Export the runner-specific native cache path from a step, where the runner context is available to later Storybook commands.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Bundle size report

Tree-shaken production Metro bundles. Component costs are relative to their platform shell; shell costs are absolute.

Platform Scenario Baseline cost Current cost Cost delta Change Gzip delta Module delta
macos shell 801.3 KiB 801.3 KiB 0.0 KiB 0.00% 0.0 KiB +0
macos components-button 50.1 KiB 51.4 KiB +1.4 KiB +2.75% +0.5 KiB +7
macos components-catalog 267.3 KiB 274.6 KiB +7.3 KiB +2.72% +2.3 KiB +14
macos design-theme-state 33.3 KiB 33.4 KiB +0.1 KiB +0.40% +0.1 KiB +2
macos design-color-lib 7.1 KiB 7.1 KiB 0.0 KiB 0.00% 0.0 KiB +0
macos design-theme-state-legacy-source 35.3 KiB 35.5 KiB +0.1 KiB +0.38% +0.0 KiB +2
macos design-legacy-theme-from-flex 100.2 KiB 100.4 KiB +0.1 KiB +0.13% +0.1 KiB +2
windows shell 810.2 KiB 810.2 KiB 0.0 KiB 0.00% 0.0 KiB +0
windows components-button 50.0 KiB 51.4 KiB +1.4 KiB +2.75% +0.4 KiB +7
windows components-catalog 267.0 KiB 274.3 KiB +7.3 KiB +2.72% +2.2 KiB +14
windows design-theme-state 33.2 KiB 33.3 KiB +0.1 KiB +0.41% +0.1 KiB +2
windows design-color-lib 7.1 KiB 7.1 KiB 0.0 KiB 0.00% 0.0 KiB +0
windows design-theme-state-legacy-source 35.3 KiB 35.4 KiB +0.1 KiB +0.38% +0.0 KiB +2
windows design-legacy-theme-from-flex 100.0 KiB 100.1 KiB +0.1 KiB +0.13% +0.1 KiB +2

The job is advisory: size changes are reported but do not fail the pull request. Bundle or analysis errors still fail.


View bundle-size workflow run

Harden Windows application ownership and cleanup, map native errors to W3C semantics, run the native self-test contract, and configure Windows and Win32 Storybook PR jobs for explicit cached helper builds and prebuilt-only smoke.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Mask keyboard, pointer, and wheel capabilities on GitHub-hosted Windows while preserving interactive runner defaults, so native authored plans report truthful capability skips.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@JasonVMo
Jason Morse (JasonVMo) marked this pull request as ready for review September 3, 2026 16:15
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Infrastructure: Prove the desktop test driver on real platforms and pass its release gate

2 participants