Direct address to camera
The prompt “A woman looking straight at camera saying clearly: "We test the slop so you do not have to."”
Mouth shapes must match specific phonemes. Easy to verify by muting and watching the lips.
- Models tested
- 16
- Top score
- 5.00 7 models tied
- Average
- 4.39
- Lowest
- 0.83 MiniMax Hailuo 02
Every model, same prompt
The clips on screen play together from the first frame, muted. Open one for sound, controls and our notes.
Vivix W1
VivixAudio says the exact line, transcribed word for word, with eye contact held to the end.
FLUX 3
Black Forest LabsAudio says the exact line, transcribed word for word, with eye contact and lips closing on the p of slop.
MiniMax H3
MiniMaxAudio present, exact line, accurate phoneme lip-sync.
Seedance 2.5
ByteDanceAudio present, mouth shapes match the stated line.
Seedance 2.0
ByteDanceAudio present, mouth shapes match the stated line.
Grok Video
xAIExact line, phoneme-accurate sync.
OpenAI Sora 2
OpenAIExact line, tight phoneme-level sync.
Google Gemini Omni
GoogleSpeaks the requested line accurately with tightly synced mouth movement, then repeats a fragment of it ('you do not have to') a second time -- minor script deviation, everything else clean. Real, accurate speech audio confirmed.
Kling 3.0 Turbo
Kuaishou
Runway Gen-4.5
RunwaySilent clip (no native audio); natural, well-coordinated speech articulation.
Kling 4.0
KuaishouThe lips follow the audio, but the line comes out as "We test the flop", heard that way by two separate transcriptions; the clip also cuts from a medium shot to a close-up at 1.25 seconds.
Google Veo 3.1
GoogleBrief gibberish audio before the intended line lands with accurate phoneme lip-sync.
Wan 3.0
AlibabaSays "We test we the slop" before delivering the full line, transcribed word by word; the lips follow both attempts.
PixVerse v5.5
PixVerseThe woman never speaks or moves her mouth at all for the full 8s despite the prompt requiring a specific spoken line -- verified via frame extraction (multiple frames all show a fully closed, neutral mouth): confirmed, not audio-related (native_audio=0 explains silence, not the total absence of articulation).
Kling 3.0
KuaishouLips mouth the line correctly, but NO audio was generated at all. Fidelity docked for the missing spoken component; audio dimension left unscored (see model note), not failed.
MiniMax Hailuo 02
MiniMaxFAILURE MODE: no audio track at all; mouth does generic open/round/close flapping unrelated to the intended line.
Ranked by our blind vision-model judge; models with the same score share a position. Read how we test.