Needed a 15 second ad for a small DTC product and had no budget for a shoot, so i spent a week testing five tools on the same brief. same product, same prompt each time, so the comparison is at least fair.
the brief: a matte black water bottle on a wooden kitchen counter, morning light from a window on the left, a hand picks it up, turns it so the light catches the side, sets it down. slow push-in. no text, no music.
i ran the same prompt (plus a still of the bottle as a start frame wherever the tool allowed it) 3 to 5 times on each tool and kept the best take. notes below.
Runway
Best for: control over the shot, editing tools around the clip.
What happened: the push-in was smooth and the light stayed where i asked. i could also fix a shot after generating instead of re-rolling the whole thing.
Flaw: a learning curve. my first two runs ignored the hand entirely because i wrote the prompt like a sentence, not a shot description. burned a few retries before i got the hang of it.
Time: about an hour to get one good take, mostly figuring out the interface.
Kling
Best for: b-roll style shots with a little movement.
What happened: with the bottle still as a start frame the bottle stayed the same bottle for the whole clip, which was not true for every tool here. the hand moved naturally.
Flaw: without a start frame the look drifted between takes. i also kept its talking shots short and split longer scripts into pieces instead of trusting one long clip.
Time: fastest to a usable take, about 3 tries.
Google Veo
Best for: cinematic, realistic-looking clips with sound.
What happened: lighting and textures were the best of the five, the wood grain and the highlight on the bottle looked properly real, and it generated sound with the clip.
Flaw: clips max out at 8 seconds, so for a 15 second ad i had to stitch two and hide the cut on the hand movement.
Time: 3 tries for the hero shot.
Luma
Best for: scenes with a lot going on and camera moves through a space.
What happened: the camera move through the kitchen looked good, the counter and window felt like a real room.
Flaw: hit or miss depending on the prompt. i rewrote mine 3-4 times, and the bottle label changed shape between takes.
Time: the most re-writes of the five.
Seedance
Best for: reference-heavy shots.
What happened: you can feed it reference images (up to 9), so i gave it the bottle from two angles and the kitchen. the product stayed closer to the references than in the others.
Flaw: i had to get the prompt very specific or it improvised, and one take added a second bottle in the background.
Time: 2-3 tries once i stopped being vague.
my honest ranking for this one brief: Kling for b-roll, Veo for the hero shot, Seedance when i need the product to stay accurate, and Runway and Luma as backups. none of them replaced a real shoot for the final cut, but for drafts and social cuts i'm not going back.
the part nobody warns you about: the retries are the real cost, not the tool. plan on 3-5 tries per usable shot and you won't be surprised.
P.S. not affiliated with any of these, just sharing what i saw. what did i miss? curious what others are running.