Skip to content

feat: let an AI agent record cinematic demos (recorder CLI + skill) - #13

Merged
AbianS merged 3 commits into
mainfrom
feat/agent-recorder
Oct 19, 2026
Merged

AbianS merged 3 commits into
mainfrom
feat/agent-recorder

Conversation

@AbianS

@AbianS AbianS commented Oct 19, 2026

Copy link
Copy Markdown
Member

No description provided.

- New `.osrec` file format (lib/recording-file.ts): a raw recording (meta,
  markers, optional direction, video) that crosses browsers. The editor
  imports it from its empty screen, the popup's file icon, or a file
  packaged in the extension (`editor.html?import=`).
- Automation API in the service worker (lib/automation.ts) for the
  recorder CLI over CDP: start, stop once saved, export in base64 chunks.
  Automated sessions open no editor tab on save.
- Direction from the recorder's flow (lib/direction.ts): click tooltips,
  zooms and `hotspot: false` on the matching markers; waits cut from the
  clips as jump cuts; zoomed actions split their clip wide/zoomed/wide.
  Recordings made by hand are unchanged.
…an agent

`@rustrak/openshowcase-recorder` plays a JSON flow in headless Chromium
while the extension records it through its own capture pipeline:

- `inspect`: runs the flow fast and prints where it ends as an
  accessibility tree (screenshot only on request, `--within` to narrow).
- `record`: paced for the camera, with an injected cursor that moves like
  a hand, targets scrolled into comfortable view and waits cut out.
  The flow directs the camera (`zoom`, `hotspot: false`, `tooltip`).
- `open`: reviews a recording in the editor of a separate browser.
- `login`: saves a session once; every run works on a throwaway copy of
  the profile.
- `install-skill`: adds the skill that teaches an agent to direct short,
  cinematic user guides.

valibot moves to the `core` catalog now that two workspaces use it.
@AbianS
AbianS merged commit dec26e3 into main Oct 19, 2026
1 check passed
@AbianS
AbianS deleted the feat/agent-recorder branch October 19, 2026 19:00
@github-actions github-actions Bot mentioned this pull request Oct 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant