Phygital+ is an Al Workspace for visual creators and design teams that combines 20+ Al networks in a NoCode tool. In this experiment we utilize this tool to extract human figures from a music video and create new characters in identical poses.
To accomplish this, we began by extracting the frames we wished to recreate from this youtube video. Next, we used four Phygital+ nodes. One node was for importing the frame, while another utilized ControlNet to generate an animal with the same pose as the person in the frame. We also used a Stable Diffusion node to create the background and a final node to merge the background and animal into a single image.
We repeated this process with all the frames we wanted to recreate, you can see the final result on this video:
Thanks to Tosolini Productions and María Sánchez Isaza for their collaboration on this R&D.
Last Updated September 21, 2023