This AI framework can turn a single photo into expressive talking heads, pose transfers, and full-body animations with ultra-smooth motion and identity consistency.
Filmmaking / Directing : Casting issues? by Willem Elzenga
Casting issues?
Other topics in Filmmaking / Directing:
Check out Trending Discussions
Register / Log In
1 person likes this
Looks like something I’d want to try out. I like that it’s basically a puppet based on an actual performance.
Limitations? All the samples are a character in medium shot emoting, but not moving beyond that. I notice the actions never include props or interacting with environments. No feet, no turnarounds. Long hair is still tricky.
I wish the VO in the ad wasn’t AI. So distracting that the voice couldn’t even say the name of the product without that awkward pause.
No link to try it out yet, unfortunately.
Mike Boas There is an example with the characters holding props at 1:46, but as you can see, the props do not move a pixel, and the neck on the right looks very strange. Though, the result is no doubt good enough that many will use A.I. rather than hire an animator. And, for live action, you could always comp the A.I. face onto the actor, and get a decent result.
2 people like this
Interesting but certainly not far beyond Daz3D. Their use cases are essentially restricted to novelty uses, I see, and there is no kind of roadmap to market or pricing information. If the poor AI audio is an indication of what the developers accept as good, then I don't expect professional quality on it. However, it's interesting to note that this exact capability is where the legacy studios are hoping to go in the next 5-10 years - it's implied in the last SAGAftra collective agreement and in SAGAftra's own marketing to actors.
This is still in the research stage, and they do admit the limitations in their research paper, concluding with: "These challenges still need to be addressed in future research." To be fair, their work is impressive, but the question still remains: will this lead to a win-win or lose-lose situation for the industry?
Patrik Gyltefors its just another brush to work the canvas. As a director I like to have additional options. For actors that are to conventional this might be a problem. The industry has always depended on technological progress, as this is. I also like the speed of developments and see that as a win. For some that might be scary and when not adapting this might come as a lose.