Photo of DeepakNess DeepakNess

VACE video creation and editing

Unproofread notes

Came across this GitHub repo about an all-in-one open source AI model called VACE, which can create and edit videos of several kinds. They introduce the model as:

VACE is an all-in-one model designed for video creation and editing. It encompasses various tasks, including reference-to-video generation (R2V), video-to-video editing (V2V), and masked video-to-video editing (MV2V), allowing users to compose these tasks freely. This functionality enables users to explore diverse possibilities and streamlines their workflows effectively, offering a range of capabilities, such as Move-Anything, Swap-Anything, Reference-Anything, Expand-Anything, Animate-Anything, and more.

VACE can also be found on Hugging Face and this is the research paper attached to it. The detailed usage instructions is also provided in the docs.

Comment via email