Hollowed-Out Icon Colorization with Controllable Diffusion Model

Icons are indispensable elements for websites and smartphone applications. In design support, some methods utilizing deep learning for the coloring of line-drawn icons have been proposed. Yet, coloring icons with hollow configurations, such as a donut shape, without unintended color spillage remains...

Full description

Saved in:

Bibliographic Details
Published in:	2024 7th International Conference on Information and Computer Technologies (ICICT) pp. 204 - 210
Main Authors:	Miyauchi, Koki, Orihara, Ryohei, Sei, Yuichi, Tahara, Yasuyuki, Ohsuga, Akihiko
Format:	Conference Proceeding
Language:	English
Published:	IEEE 15-03-2024
Subjects:	Annotations Automatic Colorization Conditional Generation Deep learning Design methodology Diffusion Model Icon Design Image color analysis Image synthesis Shape Training
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	Icons are indispensable elements for websites and smartphone applications. In design support, some methods utilizing deep learning for the coloring of line-drawn icons have been proposed. Yet, coloring icons with hollow configurations, such as a donut shape, without unintended color spillage remains a challenge. To address this, we have integrated textual annotations to specify the desired coloring area. Specifically, we painted line drawings using a Stable Diffusion-based image generation model, Uni-ControlNet, which operates on multiple conditions to generate images. To facilitate the training of this model, we assembled a dataset comprising icons, along with their corresponding captions. We proposed a quantitative index to evaluate the similarity of gradients between reference images and colored line drawings. Our method was superior to existing methods in several evaluations. In the user study focused on evaluating coloring errors in icons with hollow structures, our method outperformed existing methods. Furthermore, it was shown to be able to color icons with hollow structures, which was difficult with existing methods.
ISSN:	2769-4542
DOI:	10.1109/ICICT62343.2024.00038