Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?
This is your opportunity to ask questions. No question too simple or too silly.
Culture war topics are accepted, and proposals for a better intro post are appreciated.
Jump in the discussion.
No email address required.
Notes -
Something very much like this will be a near certainty because trying to prompt detailed poses, positions, proportions, movement paths and so on is a fool's errand. Pure written language is a horrible inefficient way to do such things while a 3D modeler uses an interface optimized for that and provides realtime feedback to the user.
To a large extent, these tools already exist. They're just limited: SCAIL struggles for movement paths with more than three characters or over nine seconds, ControlNet Pose has to be tuned for each model and sometimes even each finetune, and LoRA can uniquely handle three or four style/character/event/motion per output before they start getting funky interactions.
But even assuming that these problems can be fixed - plausible, but not a given! - there's a fundamental tradeoff between what you let the model do, and what you don't. Sometimes expressed as a double! And still hard to manage.
More options
Context Copy link
I mean if we actually get human-level AI in the picture, isn't this pretty much how traditional animation is done? Some storyboards plus a bunch of pure written language?
More options
Context Copy link
Yep. Unless you can hook the thing straight up to the animator's brain (hi there, Neuralink!) the fidgety little details will be hard to keep perfect and consistent, let alone going back and making minute changes without 'redoing' the whole shebang.
It still might beat having to go in and do all the detailed work manually, bur I know way to little about digital animation to give a real guess.
I note that this isn't all that different from standard live-action filmmaking, where you would have actors give multiple 'takes' on a scene and edit in the best ones. You're still 'prompting' actors, and refining your instructions based on the 'output' they produce, then choosing which ones you like and discarding the rest.
In fact, that might be the way to think of it, a return from the sheer tedious craftmanship of computer animation to the more 'organic' style of a Director/Prompter eliciting their ideal performance and massaging it into the final product.
More options
Context Copy link
More options
Context Copy link