1
Faculty of Engineering & IT, The British University in Dubai, United Arab Emirates
(alsharhan@outlook.com)
Abstract :
Among studies on natural language generation (NLG), computational creativity, and human-computer interaction; there is a vision of witnessing these tools collaborating with humans in generating and authoring creative content. This study aims to systematically review published studies discussing creative writing and story generation during the period of 2016-2021. This work seeks to identify the primary research methods used in NLG and creative writing studies, to locate how these studies are distributed geographically, and finally, to classify the subfields or common keywords primarily used in NLG involving creative writing. The findings suggest that experiment studies and problem-solving were the most common research methods in NLG and creative writing. Major identified themes in the reviewed articles include story generation, language models, and co-creativity, along with some gaps in foreign language translation and humour generation studies. The majority of the studies suggest that NLG tasks had a positive impact on creative writing. Common tasks related to NLG and creative writing are typically using keywords such as story generation, co-creativity, co-writing, user interface and writing tools. In future work, we aim to explore more GPT-3 capabilities in creative writing, in addition to creative writing applications in foreign language translation tasks.
Keywords :
Natural Language Processing; Natural Language Generation; Creative writing , Story Generation; language model; Co-Creativity; Co-writing; Poem Generation; writing tools; Computational creativity; Systematic Literature Review
References :
1. Alexi, A., Papathanasopoulou, G. & Papakitsos, E. C. (2016). The Development of Morphological
Generators and Related Issues: The Case of Modern Greek. Linguistics Journal., vol. 10(1), pp. 227–237
[online]. [Accessed January 28, 2021]. Available at:
https://eds.a.ebscohost.com/eds/detail/detail?vid=0&sid=33003dad-5eb4-4968-b4b6-
e188a3a55665%40sessionmgr4008&bdata=JnNpdGU9ZWRzLWxpdmU%3d#AN=128269433&db=ufh.
2. Booten, K. (2019). Toward Digital Progymnasmata. ICCC , pp. 1–8 [online]. [Accessed January 28, 2021].
Available at: http://computationalcreativity.net/iccc2019/papers/iccc19-paper-50.pdf.
3. Calderwood, A., Qiu, V., Gero, K. I. & Chilton, L. B. (n.d.). How Novelists Use Generative Language
Models: An Exploratory User Study. IUI ’20 Workshops. Cagliari [online]. [Accessed January 28, 2021].
Available at: https://transformer.huggingface.co/doc/gpt2-large.
4. Chakrabarty, T., Muresan, S. & Peng, N. (2020). Generating similes effortlessly like a Pro: A style transfer
approach for simile generation. Proceedings of the 2020 Conference on Empirical Methods in Natural
Language Processing. Association for Computational Linguistics, pp. 6455-6469,.
5. Clark, E., Ross, A. S., Tan, C., Ji, Y. & Smith, N. A. (2018). Creative Writing with a Machine in the
Loop: Case Studies on Slogans and Stories. IUI ’18: 23rd International Conference on Intelligent User
Interfaces, pp. 329–340.
6. Dale, R. & Reiter, E. (1997). Building applied natural language generation systems. Natural Language
Engineering, vol. 3(1), pp. 57–87.
7. Elkins, K. & Chun, J. (2020). Can GPT-3 Pass a Writer‟s Turing Test? Journal of Cultural Analytics. CA:
Journal of Cultural Analytics, p. 17212.
8. Grand View Research. (2019). Natural Language Generation Market Size, Share | Industry Report 2025
[online]. [Accessed January 28, 2021]. Available at: https://www.grandviewresearch.com/industryanalysis/
natural-language-generation-market.
9. Ippolito, D., Grangier, D., Callison-Burch, C. & Eck, D. (2019). Unsupervised Hierarchical Story Infilling.
Proceedings of the First Workshop on Narrative Understanding. Association for Computational Linguistics
(ACL), pp. 37–43.
10. Kazemi, D. (2020). NaNoGenMo. NaNoGenMo [online]. [Accessed January 28, 2021]. Available at:
https://nanogenmo.github.io/.
11. Kutlak, R., van Deemter, K. & Mellish, C. (2016). Production of referring expressions for an unknown
audience: A computational model of communal common ground. Frontiers in Psychology. Frontiers
Research Foundation, vol. 7(AUG).
12. Lampridis, O., Kefalas, A. & Tzallas, P. (2020). Greek Lyrics Generation. IFIP Advances in Information
and Communication Technology. Springer, pp. 445–454.
13. Manjavacas, E., Karsdorp, F., Burtenshaw, B. & Kestemont, M. (2017a). Synthetic Literature. Writing
Science Fiction in a Co-Creative Process. Proceedings of the Workshop on Computational Creativity in
Natural Language Generation (CC-NLG 2017), pp. 29–37 [online]. [Accessed January 28, 2021].
Available at: https://www.cpnb.nl.
14. Manjavacas, E., Karsdorp, F., Burtenshaw, B. & Kestemont, M. (2017b). Synthetic Literature: Writing
Science Fiction in a Co-Creative Process. Proceedings of the Workshop on Computational Creativity in
Natural Language Generation (CC-NLG 2017). Association for Computational Linguistics (ACL), pp. 29–
37.
15. Mcgovern, J. D. & Scott, G. (2016). EloquentRobot: A Tool for Automatic Poetry Generation. Proceedings
of the Seventh ACM Conference on Bioinformatics, Computational Biology, and Health Informatics.
Seattle.
16. Perera, R. & Nand, P. (2017). Recent Advances In Natural Language Generation: A Survey And
Classification Of The Empirical Literature *. Computing and Informatics.
17. Reiter, E. & Dale, R. (2000). Building Natural Language Generation Systems. Cambridge [online].
[Accessed January 27, 2021]. Available at:
https://books.google.ae/books?hl=en&lr=&id=qnWQU9C8bDkC&oi=fnd&pg=PP1&dq=%22Naturallanguage+
generation%22&ots=j0-
PfpXphB&sig=s8IZoPnnUFu1p3ubIA9518680iM&redir_esc=y#v=onepage&q=%22Naturallanguage%
20generation%22&f=false.
18. Ricelli, R. M., Monteiro, D. S. & Paraboni, I. (2020). Personality-dependent content selection in natural
language generation systems. Journal of the Brazilian Computer Society. Springer, vol. 26(1), pp. 1–21.
19. Rice, M. (2020). Can AI Writing Software Replace Writers? Built In [online]. [Accessed January 28, 2021].
Available at: https://builtin.com/artificial-intelligence/natural-language-generation.
20. Roemmele, M. & Gordon, A. (2018). Linguistic Features of Helpfulness in Automated Support for Creative
Writing. Association for Computational Linguistics (ACL), pp. 14–19.
21. Siddharthan, A., Ponnamperuma, K., Mellish, C., Zeng, C., Heptinstall, D., Robinson, A., Benn, S. & van
der Wal, R. (2019a). Blogging birds. Communications of the ACM. Association for Computing Machinery,
vol. 62(3), pp. 68–77.
22. Siddharthan, A., Ponnamperuma, K., Mellish, C., Zeng, C., Heptinstall, D., Robinson, A., Benn, S. & van
der Wal, R. (2019b). Blogging birds: Telling informative stories about the lives of birds from telemetric
data. Communications of the ACM. Association for Computing Machinery, vol. 62(3), pp. 68–77.
23. Trăuşan-Matu, Ş. (2019). Computer-based Story Generation. An Analysis from a Phenomenological
Standpoint. International Journal of User-System Interaction, vol. 12(1), pp. 39–53.
24. WILKE, S. & BEROV, L. (2018). Functional Unit Analysis: Framing and Aesthetics for Computational
Storytelling. 7th International Workshop on Computational Creativity, Concept Invention, and General
Intelligence. TriCoLore (C3GI/ISD/SCORE). [online]. [Accessed January 28, 2021]. Available at:
https://www.researchgate.net/publication/330599016_Functional_Unit_Analysis_Framing_and_Aesthetics
_for_Computational_Storytelling.
25. Yang, X. & Tiddi, I. (2020). Creative Storytelling with Language Models and Knowledge Graphs.
Proceedings of the CIKM 2020 Workshops. Galway [online]. [Accessed January 28, 2021]. Available at:
https://kmitd.github.io/ilaria/.
26. Dumay, J. & Cai, L. (2014). A review and critique of content analysis as a methodology for inquiring into
IC disclosure. Journal of Intellectual Capital. Emerald Group Publishing Ltd., vol. 15(2), pp. 264–290.
27. Hustadt, U. (2016). Research Methods in Computer Science [online]. [Accessed 29 January 2021].
Available at: https://cgi.csc.liv.ac.uk/~ullrich/COMP516/notes/lect06.pdf.
28. Writefull. (2020). Writefull. Digital Science [online]. [Accessed 29 January 2021]. Available at:
https://writefull.com/.
29. AI Writer. (2020). AI WriterTM - The best AI Text Generator, promised. AI-Writer.com [online]. [Accessed
29 January 2021]. Available at: http://ai-writer.com/.
| Style | # |
|---|---|
| MLA | Abdulla Alsharhan. "Natural Language Generation and Creative Writing A Systematic Review." International Journal of Advances in Applied Computational Intelligence, Vol. 1, No. 1, 2022 ,PP. 69-90 (Doi : https://doi.org/10.54216/IJAACI.010105) |
| APA | Abdulla Alsharhan. (2022). Natural Language Generation and Creative Writing A Systematic Review. Journal of International Journal of Advances in Applied Computational Intelligence, 1 ( 1 ), 69-90 (Doi : https://doi.org/10.54216/IJAACI.010105) |
| Chicago | Abdulla Alsharhan. "Natural Language Generation and Creative Writing A Systematic Review." Journal of International Journal of Advances in Applied Computational Intelligence, 1 no. 1 (2022): 69-90 (Doi : https://doi.org/10.54216/IJAACI.010105) |
| Harvard | Abdulla Alsharhan. (2022). Natural Language Generation and Creative Writing A Systematic Review. Journal of International Journal of Advances in Applied Computational Intelligence, 1 ( 1 ), 69-90 (Doi : https://doi.org/10.54216/IJAACI.010105) |
| Vancouver | Abdulla Alsharhan. Natural Language Generation and Creative Writing A Systematic Review. Journal of International Journal of Advances in Applied Computational Intelligence, (2022); 1 ( 1 ): 69-90 (Doi : https://doi.org/10.54216/IJAACI.010105) |
| IEEE | Abdulla Alsharhan, Natural Language Generation and Creative Writing A Systematic Review, Journal of International Journal of Advances in Applied Computational Intelligence, Vol. 1 , No. 1 , (2022) : 69-90 (Doi : https://doi.org/10.54216/IJAACI.010105) |