Designing the orchestration layer for a multi-tool AI creative pipeline
Directing Claude, Blender, UE5, Figma, and ComfyUI through one agentic interface — instead of five disconnected tools.
Problem / Context
Solo creators and small studios face fragmented, disconnected AI creative tooling. Designers prototype in one tool while assets move through another, losing context and reproducibility at every handoff — a reference image becomes a 3D mesh in one app, gets imported into an engine in another, and the reasoning that connected those steps rarely survives the trip.
Constraints
What makes this hard is not any single tool — it's the orchestration layer between them:
- Each tool (Blender, UE5, Figma, ComfyUI) has its own object model, file format, and automation surface; MCP standardizes the interface but not the underlying semantics.
- Irreversible or expensive steps (mesh generation, engine import) need approval gates rather than silent automation — a single agentic interface can't be allowed to run unattended through every step.
- Reproducibility matters: a job that worked once needs to be re-runnable, not a one-off manual sequence.
This pipeline is built on infrastructure other teams are also converging on — Siddharth Ahuja's open-source blender-mcp, Chong-U Lim's unreal-mcp, Epic's UE 5.8 MCP plugin, Figma's official MCP server, and Comfy.org's Comfy MCP — which is part of what makes this worth documenting as a system rather than a personal hack.
Process
Scope for this write-up: document the pipeline as a system diagram plus annotated interaction flows, define 1–2 concrete end-to-end jobs, capture real before/after friction from actual use, and design/annotate the control & safety layer — approval gates, guardrails, and what makes a job reproducible.
To be documented once the live capture session runs and an actual alternative approach is tested and set aside — this section will name the specific rejected approach and why, not a generic placeholder.
Solution
Real screenshots, the system diagram, and the annotated interaction flow for the chosen end-to-end job(s) go here once the pipeline run is captured. Nothing in this section is populated with placeholder or invented visuals, per the no-fabrication requirement for this case study.
Reflection
What to test next, honest limitations of the current pipeline, and any friction metrics will be written up from the real capture session — not estimated in advance.