Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence 

Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Nikhil Singh, Guillermo Bernal, Daria Savchenko, Elena L. Glassman
CHI 2023: The ACM CHI Conference on Human Factors in Computing Systems
Session: Journals: Words and Colors
While developing a story, novices and published writers alike have had to look outside themselves for inspiration. Language models have recently been able to generate text fluently, producing new stochastic narratives upon request. However, effectively integrating such capabilities with human cognitive faculties and creative processes remains challenging. We propose to investigate this integration with a multimodal writing support interface that offers writing suggestions textually, visually, and aurally. We conduct an extensive study that combines elicitation of prior expectations before writing, observation and semi-structured interviews during writing, and outcome evaluations after writing. Our results illustrate individual and situational variation in machine-in-the-loop writing approaches, suggestion acceptance, and ways the system is helpful. Centrally, we report how participants perform \textit{integrative leaps}, by which they do cognitive work to integrate suggestions of varying semantic relevance into their developing stories. We interpret these findings, offering modeling and design recommendations for future creative writing support technologies.
Web:: programs.sigch...
Pre-recorded presentation videos for Journals at CHI 2023