- 54 views
- 67 downloads
Sketch-conditioned Image Generation centered on Existing Artist Workflows
-
- Author / Creator
- Loftsdottir, Dagmar
-
Many works of art are created through the process of an artist sketching and then incrementally increasing the fidelity of the artwork. This requires significant amounts of work and effort throughout, but not all steps require the same amount of artistic input. Certain parts only require following the logical consequences of an earlier decision. Other parts require multiple iterations to visualize the effect of a decision before it is executed. This thesis provides two contributions, each of which integrates with existing artist workflows.
Firstly, we propose SketchBetween, a VQ-VAE-based system which automates a part of the animation workflow which leaves full creative control in the hands of the artist. This system takes as input fully rendered keyframes and sketched in-between frames and returns a fully rendered animation. We evaluate the system by comparing it to a baseline and performing an ablation study. We also analyze a case study of its performance on human-generated input. The results of all evaluations demonstrate the systems effectiveness at automating the rendering of in-between frames based on sketches.
Secondly, we propose the task of generating images conditioned on sketches and palettes, and propose a preliminary system to perform this task using a VQ-VAE. We performed an error analysis in order to identify current limitations, to which we propose mitigations and future work.
-
- Subjects / Keywords
-
- Graduation date
- Fall 2023
-
- Type of Item
- Thesis
-
- Degree
- Master of Science
-
- License
- This thesis is made available by the University of Alberta Libraries with permission of the copyright owner solely for non-commercial purposes. This thesis, or any portion thereof, may not otherwise be copied or reproduced without the written consent of the copyright owner, except to the extent permitted by Canadian copyright law.