WorkspaceBench: Measuring Agents That Operate OpenBB Workspace
A few weeks ago at NY Tech Week I gave a talk on centralizing dashboards and agentic workflows in OpenBB Workspace. At the end I talked about how I'm seeing more analysts and quants using Claude Code and Codex to drive their work - and so we need to adapt the workspace to make it agent first.
And this is why we had just announced Workspace MCP, which enables agents to work with the workspace by reading data, building dashboards, and assembling whole apps.
If agents are going to drive this workspace for real analysts, we (OpenBB) need to find a way to measure how well they can navigate our software. And by navigate I mean being able to inspect data, call right tools, change widget parameters, build a dashboard, add new widgets on the dashboard, leverage skills, etc..
This has lead me to build WorkspaceBench.
It includes the harness, a deterministic workspace simulator, 300 different synthethically generated scenarios, graders, and everything else. The Stark Industries mock enterprise apps, which I used for the demo above, is where the benchmark's scenarios come from — the same widgets and apps, turned into tasks.