Skip to content

Instantly share code, notes, and snippets.

@Ishaan28malik
Last active November 23, 2021 12:45
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Ishaan28malik/8020425ac106d20d7e6179d204945732 to your computer and use it in GitHub Desktop.
Save Ishaan28malik/8020425ac106d20d7e6179d204945732 to your computer and use it in GitHub Desktop.
Generating storyboard animations from Scripts (Disney Research)

Storyboard-Animations

Generating storyboard animations from Scripts

text-to-animation system

img

Paper resources

Post

Script Parsing Module

Given the text, it resolves mentions (typically pronouns) to the entity they refer to in the text. To facilitate entity resolution, we prepend each Description component with the Character Cues component which appears before it in the screenplay (e.g. [character]MARTHA: [dialog]“I knew it!” [description]She then jumps triumphantly → MARTHA. She then jumps triumphantly).

Text Simplification Module

Both Identify and Transform use Part-of-Speech (POS) tagging and dependency parsing modules implemented in

img2

Novel script-parsing module

  • that automatically isolates relevant text from scene descriptions in screenplays

NLP Module

  • that simplifies complex sentences using a set of linguistic rules and extracts information from the simplified sentences into predefined action representations

Animation generation model

  • that translates said representations into animation sequences
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment