Skip to content

Latest commit

 

History

History
60 lines (48 loc) · 2.25 KB

README.md

File metadata and controls

60 lines (48 loc) · 2.25 KB

Styled Video Generator

The Styled Video Generator is a project that generates a video from a given set of short video clips. The generator can also apply style translations to the video (e.g. painting-like videos).

Prerequisites

Getting Started

Installation

  • Clone this repo:
git clone https://github.com/williamhxy/styled_video_generator
  • Initialize the submodule "pytorch-CycleGAN-and-pix2pix":
git submodule init
  • Update the submodule "pytorch-CycleGAN-and-pix2pix":
git submodule update

Initialize

Run the "initialize.py" script in the root folder to generate the classification label record.

  • {path_to_the_video_dataset} is the path to the video dataset folder.
python initialize.py {path_to_the_video_dataset}

Generate

Run the "generate.py" script in the root folder to generate the translated output video.

  • {path_to_the_video_dataset} is the path to the video dataset folder.
  • {length_of_output_video_in_second} is the video length in second as an integer.
  • {video_frame_rate} is the frame rate per second as an integer
python generate.py {path_to_the_video_dataset} {length_of_output_video_in_second} {video_frame_rate}

Folder Structure

  • data: Folder used to keep temporary data and metadata.
  • extern: All submodule repositories are here.
  • models: Pre-trained CycleGAN models for running the image translation.
  • results: The outputs from the algorithm.
  • scripts: All supporting scripts are here.

Acknowledgments

  • An overview and reference to the CycleGAN model can be found here.
  • The CycleGAN model repository can be found here.
  • The video to image processing in this project uses the decord code.