The core limitation of current text-to-image models is not image quality but controllability — they fail to generate distinct identities when asked for multiple people, producing near-identical faces instead.
Despite photorealistic outputs, current T2I models struggle with identity preservation across multiple subjects. Training objectives optimize for realism and prompt matching but do not explicitly encourage facial diversity, leading to the same face duplicated across groups. ✦ AI generated
Fati Periqi · The TWIML AI Podcast · 2026-08-12 · original ↗
starts at this moment · 6:34
“what's left for us to work on?”
This is not an image quality problem the problem that I mentioned before like we are asking the model to generate faces and and certain number of faces and it keeps generating same faces identical almost identical faces over and over again. So quality wise, image quality wise, if you look at the pixels and noise and everything, it looks realistic. But the missing piece was that those models, base models, amazing models had not really learned to create truly distinct identities because existing training objectives focus heavily on the realism and matching the user prompt, but they don't explicitly encourage diversity between people.
verbatim transcript · starts at 6:34
6:34our own models also what was interesting that uh this is not an image quality problem the problem that I mentioned before like we are asking the model to generate faces and and certain number of faces and it keeps generating same faces identical almost identical faces over and over again. So quality wise, image quality wise, if you look at the pixels and noise and everything, it looks realistic. But the m missing piece was
7:02that those models, base models, amazing models had not really learned to create truly distinct identities because uh existing training objectives focus heavily on the realism and matching the user prompt, but they don't explicitly encourage diversity. uh between people and that is very important. So that observation led us to uh a simple question what if the identity or facial appearance or any diversity you know kind of itself
7:38becomes an optimization objective. So that led into the idea behind disco. Instead of you know creating a completely new T2I model, we kept the underlying model and fine-tune it with reinforcement learning. Um we designed rewards that encourage several things simultaneously. For instance, different people within an image should have distinct identities. You don't want to, you know, kind of duplicate create duplicate faces. That's something we call in the paper as intraim image
- ·Image quality (pixels, noise) already looks realistic
- ·Problem: models generate identical faces for multiple subjects
- ·Training optimizes for realism and prompt matching
- ·No explicit objective encourages facial diversity
- ·Base models haven't learned distinct identity creation
- ·Realism is rewarded; diversity between people is not
- ·Prompt matching alone doesn't prevent face duplication
- ·需要新的训练目标
- ·显式建模身份多样性
- ·提升多人场景可控性