AI-Enhanced Storytelling: Integrating Visual, Textual, and Auditory Elements Through Multimodality
Abstract
This study explores the integration of Artificial Intelligence (AI) in experience design, focusing on its role in creating a multi-sensory experience that bridges visual, textual, and auditory elements. The research centers on the album “Sky of Summer Nights,” where music generated by Suno AI complements illustrations and lyrics created by the author, Evan Raditya Pratomo. The project features three original illustrations, each corresponding to a song: “The Fairy Tale of Pink Summer,” “A Hug for Pink Moon,” and “Freed His Heart.” This research demonstrates how creative expression can be enhanced through multimodal principles, highlighting the challenges of effectively conveying messages through a combination of mediums. The findings affirm that the integration of AI can preserve the integrity of traditional design practices while offering new possibilities for innovation. By applying multimodal design theory, the study illustrates how AI is not only a tool but a catalyst for new emotional and creative experiences across disciplines. This research emphasizes the collaboration between human creativity and Suno AI, driving forward innovation in the fields of visual communication and experience design.
Keywords: sky of summer nights; multi-sensory; multimodal; creative expression; suno AI
Downloads
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike International License (CC-BY-SA 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Copyright without Restrictions
The journal permits the author(s) to hold the copyright without restrictions and will hold distributing rights without limitations.
The submitted papers are assumed to contain no proprietary material unprotected by patent or patent application; responsibility for technical content and for protection of proprietary material rests solely with the author(s) and their organizations and is not the responsibility of the Ultimart: Jurnal Komunikasi Visual or its Editorial Staff. The main (first/corresponding) author is responsible for ensuring that the article has been seen and approved by all the other authors. It is the responsibility of the author to obtain all necessary copyright release permissions for the use of any copyrighted materials in the manuscript prior to the submission.
