Skip to main content

UI Tools

Two tools for interacting with operator-visible UI surfaces: browser and canvas.


browser — tool.browser

Controls a headless browser session for page navigation, screenshot capture, text extraction, and form interaction.

Action class: render-ui | Side effects: external_side_effect | Approval: required

Operations

OperationDescription
openNavigate to a URL
screenshotCapture a PNG screenshot
extract_textExtract visible text from the page
clickClick a CSS-selected element
fillFill a form field
closeClose the browser session

Safety notes

  • All browser content is EXTERNAL_UNTRUSTED
  • Egress restricted to operator-configured allowlist
  • Requires a provisioned headless browser runtime (Playwright/Puppeteer)
  • Approval required — browsers can access external URLs

Setup

Provision a browser runtime in the execution environment and configure browser.control capability in the execution-manager.


canvas — tool.canvas

Renders structured content to the operator-visible canvas surface in the admin dashboard.

Action class: render-ui | Side effects: external_side_effect | Approval: may require

Operations

OperationDescription
renderReplace canvas content
appendAdd to existing canvas
clearClear canvas
exportReturn current canvas as string

Formats

markdown, html, json, text

Safety notes

  • HTML content is sandboxed in the dashboard renderer
  • Canvas operations are audited
  • Canvas is visible to operators in the dashboard Canvas tab

Default Sets

tool.browser is included in manasvi.toolset.workflow-operator. tool.canvas is included in manasvi.toolset.controlled-write.


See also