A single generative model is being asked to solve too many difficult sub-problems simultaneously — understanding prompts, determining composition, preserving identities, reasoning about interactions, and rendering — which may exceed what one model can do well.
Generating a multi-person scene requires simultaneous prompt comprehension, subject count determination, spatial composition, interaction reasoning, identity preservation, and rendering. Fati argues this load is too heavy for a single end-to-end model, motivating modular architectures. ✦ AI generated
Fati Periqi · The TWIML AI Podcast · 2026-08-12 · original ↗
starts at this moment · 13:11
“Are we asking the models to do too many things at once?”
Maybe we are also asking a single model to solve too many difficult problems at once. Think about what happens when you generate a scene with several people. Going back to that core example now the model has to understand the prompt but what I'm asking to model and then decide how many people should appear determine where they should be placed like the composition of the scene reason about their interactions because if there's a person if there's another person most likely there there is some connection preserve and you also I didn't mention about this thing identity of the person we can give okay this is my daughter this is my son and I want them to be in the picture not like any random person and finally render everything together in all a single process. maybe this is too much.
verbatim transcript · starts at 13:11
13:19objective. Optimization at the right data is definitely very critical. That is what this paper is talking about. But we may also kind of think that maybe I mean these are models genetic models. Maybe we are also asking a single model to solve too many difficult problems at once. >> That's kind of asking the question could we possibly optimize for all the attributes that we care about? Are we a
13:46in doing so would we be asking the models to do too many things at once? >> That's a good point. Maybe we shouldn't kind of um and also I can give you an example. Think about what happens when you generate a scene with several people. Going back to that core example now the model has to understand the prompt but what I'm asking to model and then decide how many people should
14:09appear uh determine where they should be placed like the composition of the scene reason about their interactions because if there's a person if there's another person most likely there there is some connection preserve and you also I didn't mention about this thing identity of the person we can give okay this is my daughter this is my son and I want them to be in the picture not like any
14:31random person and finally render everything together in all a single process. uh maybe this is too much and that's what we explored in the other paper R2 CAM paper instead of like asking one model to do everything what if we separated for instance planning from rendering similar to what human artists might do uh and you know that kind of that kind of led us into this uh
15:01paper >> before we dive into Artican I I thinking about that comment applied to disco and again this idea about different attributes possibly a thing to keep in mind is how we've matured the way we think about like using model routers. Uh so um you know maybe you have you know a suite of models for the different attributes that you care about and then when your prompt comes in you've got
- ·One model must handle prompt comprehension, composition, interaction reasoning, and rendering simultaneously
- ·Multi-person scenes compound the challenge with identity preservation
- ·Fati argues this task load exceeds what one end-to-end model can do well
- ·This motivates modular architectures with specialized sub-components
- ·Understand the user's prompt
- ·Determine how many people should appear
- ·Compute spatial composition
- ·Reason about interactions between people
- ·Preserve identity of named subjects (e.g. 'my daughter')
- ·Render everything in a single unified process
- ·Current end-to-end models attempt all six tasks in parallel
- ·Quality degrades as sub-problem complexity scales
- ·Fati argues this motivates modular, specialized architectures