Zhikulina C.P., Kostromina V.V. —
Computational creativity of neural network Midjourney in a polymodal space
// Litera. – 2024. – ¹ 6.
– P. 1 - 16.
DOI: 10.25136/2409-8698.2024.6.70890
URL: https://en.e-notabene.ru/fil/article_70890.html
Read the article
Abstract: This article deals with the polymodal space in the field of computational creativity in neural networks. The object of research is a polymodal environment that integrates a series of heterogeneous codes to express a common idea, and the subject is the possibility of creating polymodal digital art using text and voice prompts in the generative network Midjourney. The aim of the study is to prove that computational creativity can be detected and described based on the results of iterations in the process of creating images, which in turn will allow us to talk about a complex polymodal system as a separate digital category of polymodality.
We used the continuous sampling method when collecting linguistic units as they occur in the analysis process; contextual analysis for the systematic identification and description of the verbal and non-verbal contexts. It was necessary to conduct an experiment with the generative network Midjourney to identify patterns in the creation of a graphic space through text and voice data input, and then compare and contrast the results of iterations with the original image.
The scientific novelty consists in the lack of research on the polymodal space in the context of neural networks and their generative ability. During the experiment, we obtained the following results: the term ‘polymodality’ in the context of the generative network Midjourney and its ‘digital art’ is due to the presence of three channels: verbal, visual and voice; tests have shown that the ability of the neural network to create images through prompt is at a high level, however, there are rough technical errors that do not allow users to fully approach the desired result when they generate an image; the summarization of the data allows us to talk about the presence of features of computational creativity in generative networks.
Zhikulina C.P. —
Alice's Tales: the transformation of the composition, fairy-tale formulas and contexts of the voice assistant in the skill "Let's come up with"
// Litera. – 2024. – ¹ 2.
– P. 45 - 64.
DOI: 10.25136/2409-8698.2024.2.69760
URL: https://en.e-notabene.ru/fil/article_69760.html
Read the article
Abstract: The subject of the study is a spontaneously generated text by the voice assistant Alice when it is creating a fairy tale together with the user, and the purpose of the study is the transformation of the structure, fairy-tale formulas and context in terms of the selection of linguistic elements and meanings using artificial intelligence technology. Particular attention has focused on the skill "Let's make it up", which became available to users in the spring of 2023. The collision and interaction of folklore canons with the realities of the 21st century give rise to an ambiguous reaction to the interactive opportunity to play the role of a storyteller together with a voice assistant.
The main research method was a continuous sample, which was used to distribute the steps, stages and actions when it is creating a fairy-tale plot together with a voice assistant. In addition, methods such as comparative and contextual analyses were used to identify similarities and differences between traditional Russian fairy tales and a spontaneously generated fairy tale plot. To obtain the data and subsequent analysis of the components, a linguistic experiment with the voice assistant Alice from Yandex was conducted and described.
The rapid development of neural network language models allows us to talk about the scientific novelty of the material under study, since this area is unexplored and is being modified too quickly. It is important to emphasize that to date, the texts of spontaneously generated fairy-tale, their structural division and the correspondence of fairy-tale formulas in them to folklore canons have not been studied. The main conclusion of the study is that the user's share in creating a fairy tale with the voice assistant Alice is greatly exaggerated.
Zhikulina C.P., Perfilieva N.V. —
The communicative potential of Russian-speaking and English-speaking voice systems
// Philology: scientific researches. – 2023. – ¹ 7.
– P. 39 - 49.
DOI: 10.7256/2454-0749.2023.7.40465
URL: https://en.e-notabene.ru/fmag/article_40465.html
Read the article
Abstract: The article describes the analysis of the "spontaneous" dialogue of two Russian and foreign voice systems. The study is relevant because the possibilities of communication of the introduction spontaneously dialogue between Russian-speaking and foreign voice systems have not been studied by now. The objects of research have become two Russian-speaking systems – Alice by Yandex, voice assistant application by Sberbank; two English voice systems – Siri by Apple Ink and Google Assistant, including their Russian version. The choice is due to their popularity among native speakers of the Russian language, which was determined by the requests of these voice assistants on the Internet. The sampling period was from January 1, 2021 to December 20, 2022. Russian-speaking and English-speaking voice systems were selected by a continuous sampling method. The article draws conclusions, including about the communicative capabilities of Russian-speaking voice systems and foreign analogues with a built-in translation function into Russian. The scientific novelty is the analysis of "spontaneous" dialogic speech and the analysis of its compliance with the norms of the modern Russian language. At the end of the article there are results of the analysis of foreign phrases and expressions with a small number of variants are summarized to generate a response to the user based on materials from the corpus of the Russian language. Also, it is not uncommon to identify features of machine translation in foreign voice analogues, unlike Russian-speaking voice assistants.