Home ➤ Publications ➤ weerasundara2024multi

A Multi-Stage Approach to Image Consistency in Zero-Shot Character Art Generation for the D\&D Domain

Gayashan Weerasundara, Nisansa de Silva
CORE B Conference Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART

In the evolving landscape of computer graphics, the pursuit of consistency in image generation remains a compelling challenge. This paper delineates a comprehensive methodology that harnesses the capabilities of the Stable Diffusion (SD) model, an adept open-source image generation tool, to generate consistent and high-fidelity imagery. Beginning with the training of a generalized art style for the popular tabletop role-playing game Dungeons and Dragons, our research journeyed through specific character generation and the creation of exhaustive character sheets, culminating in the generation of consistent character images across various poses.

Keywords: Natural Language Processing | Machine Learning / Deep Learning | DnD | Image Generation | Consistency | 

@inproceedings{weerasundara2024multi,
  title={{A Multi-Stage Approach to Image Consistency in Zero-Shot Character Art Generation for the D\&D Domain}},
  author={Weerasundara, Gayashan and de Silva, Nisansa},
  booktitle={Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART},
    year={2024},
    pages={235-242},
    publisher={SciTePress},
    organization={INSTICC},
    doi={10.5220/0012317600003636},
    isbn={978-989-758-680-4},
    issn={2184-433X},
    abstract={In the evolving landscape of computer graphics, the pursuit of consistency in image generation remains a compelling challenge. This paper delineates a comprehensive methodology that harnesses the capabilities of the Stable Diffusion (SD) model, an adept open-source image generation tool, to generate consistent and high-fidelity imagery. Beginning with the training of a generalized art style for the popular tabletop role-playing game Dungeons and Dragons, our research journeyed through specific character generation and the creation of exhaustive character sheets, culminating in the generation of consistent character images across various poses.},
  misc={https://openreview.net/forum?id=wqy6yLHGmt,NLP:ML:DND,https://goo.gl/iY6aTr}
}

Related Projects

NLP for D&D

Active

PI: Nisansa de Silva

This project attempts to generate adventures, images, and encounters for Dungeons and Dragons, the world's most popular Table Top Role Playing Game.