Orchestration depends on one repeated decision: who should handle this piece of work?
Daniel HomolaยทLead AI Engineer, BMW Research
Recent focus
Agentic AI architecture
GUI agents that operate screens
Related talk
LLM-Based GUI Agents
AI Engineer Paris 2025
Hypothetical example: what agents could naturally exist in any modern vehicle?
๐บ๏ธ Navigation Agent
Routing & destinations
๐ Car Control Agent
Windows, climate, seats
๐ฅ๏ธ GUI / Computer-Use Agent
Operates apps via screen
The orchestrator chooses who acts, coordinates execution, and may combine results.
Patterns can be mixed. The challenge is the runtime decision.
Control transfers.
Delegate work, await result.
Dispatch each turn.
Runtime decision:
which agent or tool should handle this piece of work?
Same selection interface, different decision.
"Which tool fits?"
Tools should not overlap
One label should work
"Who should handle this work?"
Overlap is normal
Cost, speed, reliability & UX matter
User request: "Play some jazz"
Empty screen โ Media API. Jazz playlist visible โ GUI tap can also be valid.
Overlap + context create alternatives.
Even when delegation is implemented as a tool call, it isn't one.
Same tool-calling interface. Different control semantics.
The GUI agent is a useful case study: it can reach outcomes through the same UI the user sees.
| User Request | GUI Path | Specialist Path | Best? |
|---|---|---|---|
| "Navigate to Munich" | Maps UI โ go | Navigation API | Specialist โ |
| "Close the windows" | Settings UI | Vehicle API | Specialist โ |
| "Open that restaurant's site" | Use browser screen | No specialist for this | GUI Agent โ |
| "Play some jazz" (music app open) | Tap visible playlist | Media API | Ambiguous โ๏ธ |
A direction, not a recipe.
Enterprise path: each subteam builds evals for the agent it owns.
Together with the orchestrator team, they add cross-domain collaboration cases; the union becomes one shared orchestration & delegation benchmark.
Who should handle this piece of work?
Daniel Homola ยท BMW Research
Let's connect