Pragmatic Aspect of Multimodal Journalistic Communication: Interaction of Recipients with Digital Data Text

Section: Media Text in a New Technological Environment: Digital Transformation of Communication

The article discusses the specifics of the recipient‘s interaction with a typical text of journalistic information, including semiotically heterogeneous elements and implemented in the digital environment. Based on structural-semiotic analysis, key structural characteristics of the typical data-text are determined, representing a multimodal complete formation in both formal and substantive aspects, where numbers play a crucial role as symbolic signs. Considering the context of implementation, pragmatic effects of using digital signs in the data-text are identified. Assumptions are formulated about the influence of the multimodal structure of the data-text on its perception by the reader, including the visual perception. In accordance with the properties of the technologically «active» environment, the role of affordances integrated into the media format and the structure of data-texts is characterized. These affordances are utilized by the consumer to construct an individual trajectory of extracting meaning. The affordance toolkit allows the user/ reader to manage the process of perception, directly influencing the understanding of the content of the media text. Assumptions are made about the determination of the model of perception of digital data-text by the professional/expert involvement of users, as well as the determination of the pragmatics of the data-text by the properties and characteristics of its structure. The significance of numbers as a sign system and an extralinguistic element is determined by the type and complexity level of the data- text structure. As a result of studying the data obtained during the research experiment, it was found that extralinguistic elements, to a greater extent than verbal text, influence the formation of the recipient‘s information picture of reality, providing its heterogeneity and volume by actualizing various modes. The perception and interaction of readers with affordances and extralinguistic elements of the data-text are diversified. In particular, it is determined by the factor of professional/expert involvement and discursive competence, as well as by the communicative tasks that the recipient solves.

Aksenova O. N. (2015) Zhurnalistika dannykh: problemy i perspektivy [Data journalism: problems and prospects]. Nauchnyy vestnik Voronezhskogo gosudarstvennogo arkhitekturno-stroitel'nogo universiteta. Ser.: Social'no-gumanitarnye nauki 3 (7): 41–44. (In Russian)

Barabanshchikov V. A., Milad M. M. (1994) Metody okulografii v issledovanii poznavatel'nykh protsessov i deyatel'nosti [Methods of oculography in the study of cognitive processes and activities]. Moscow: Institute of Psychology of the Russian Academy of Sciences Publ. 88 p. (In Russian)

Baranova E. A., Shnayder A. A. (2022) Formy podachi materialov v data-zhurnalistike [Forms of submission of materials in data journalism]. Litera 3: 98–107. DOI: 10.25136/2409-8698.2022.3.37556 (In Russian)

Berezhnaya V. S. (2020) Voprosy standartizatsii faktchekinga v zhurnalistike dannykh. Teoreticheskiy aspekt [Issues of standardization of fact-checking in data journalism. Theoretical aspect]. Nauka televideniya 16.2: 191–209. DOI: 10.30628/1994-9529-2020-16.2-191-209 (In Russian)

Butakova L. O., Mironova N. Yu. (2008) Avtor-tekst-retsipient: teksty SMI v aspekte retseptsii avtorami [Author-text-recipient: media texts in the aspect of reception by the authors]. Filologiya i chelovek 1: 19-29. (In Russian)

Deviatko I. F. Byzov A. A. (2022) Measuring Respondents' Cognitive Load Related to Making Factual and Normative Judgment. Monitoring of Public Opinion: Economic and Social Changes 6 (172): 291–308. DOI: 10.14515/monitoring.2022.6.2290

Druzhinin А. М. (2015) Mediateksty v strukture prinyatiya resheniy [Media texts in the structure of decision-making]. Prostranstvo i Vremya 9 (2): 1–11. (In Russian)

Il'icheva I. L., Karpievich M. N. (2019) Modusnaya mul'timodal'nost' mediateksta [Modus multimodality of media text]. Vestnik Polesskogo gosudarstvennogo universiteta. Seriya obshhestvennyh i gumanitarnyh nauk 1: 19–27. (In Russian)

Ivanova L. V., Kupriyanova A. V. (2023) Metazhanr v tsifrovom data-diskurse [Meta-genre in digital data discourse]. Dinamika mediasistem 3 (1): 142–149. (In Russian)

Kara-Murza S. G. (2005) Manipulyatsiya soznaniem [Manipulation of consciousness]. Moscow: Eksmo Publ. (In Russian)

Kozhanova V. Yu. (2010) Problema retseptsii mediateksta kak faktor vzaimodeystviya avtora i chitatelya [The problem of media text reception as a factor in the interaction between the author and the reader]. Vestnik Adygeyskogo gosudarstvennogo universiteta. Ser. 2: Filologiya i iskusstvovedenie 4: 1–6. (In Russian)

Kozhanova V. Yu. (2011) Retseptivnyy aspekt sozdaniya mediateksta [Receptive aspect of creating a media text]. Vestnik Adygeyskogo gosudarstvennogo universiteta. Ser. 2: Filologiya i iskusstvovedenie 2: 42-46. (In Russian)

Kozhemyakin E. A. (2022) Mul'timodal'nyy tekst kak semioticheskiy fenomen: problema diskretnosti [Multimodal text as a semiotic phenomenon: the problem of discreteness]. Lingvisticheskaya limologiya: materialy Vserossiyskoy nauchnoy konferencii s mezhdunarodnym uchastiem. Moscow. Pp. 40–43. (In Russian)

Kress G. (2009) Multimodality: A Social Semiotic Approach to Contemporary Communication (1st ed.). London: Routledge. DOI: 10.4324/9780203970034.

Leyderman N. L. (2010) Teoriya zhanra: nauchnoe izdanie [Genre theory: scientific publication]. Ekaterinburg. (In Russian)

Lisicin M. E. (2018 а) Ponyatie «zhurnalistika dannykh» v sovremennykh nauchnykh publikatsiyakh [The concept of «data journalism» in modern scientific publications]. Kommunikativnye issledovaniya 3 (17): 144–154. DOI: 10.25513/2413-6182.2018.3.144-154 (In Russian)

Lisitsin M. E. (2018 b) Ponyatie zhurnalistika dannykh v osveshchenii rossiyskikh i zarubezhnykh SMI: diss … kand filol. nauk [The concept of data journalism in the coverage of Russian and foreign media. Cand. philol. sci. diss.]. Moscow. (In Russian)

Mayer-Schönberger V., Cukier K. (2013) Big Data: A Revolution That Will Transform How We Live, Work, and Think. UK: John Murray. 

Norton D., Stark L. (1971 a) Eye movements and visual perceptionon. Scientific American 224: 34–43.

Norton D., Stark L. (1971 b) Scanpaths in eye movements during pattern perception. Science 171: 308–311.

Pastukhov A. G. (2022). Strategicheskiy mediafreyming i atributivnaya povestka [Strategic media framing and attributive agenda]. Vestnik Samarskogo universiteta. Istoriya, pedagogika, filologiya 28(4): 115–129. DOI: 10.18287/2542-0445-2022-28-4-115-129 (In Russian)

Pigichka Yu. L. (2021). Otsenka effektivnosti mobil'nykh obuchayushchikh prilozheniy: opyt mirovoy praktiki [Assessing the effectiveness of mobile learning applications: experience from world practice]. Tendentsii razvitiya nauki i obrazovaniya 71–1: 39-41. DOI 10.18411/lj-03-2021-09 (In Russian)

Pirs Ch. S. (2000) Izbrannye filosofskie proizvedeniya [Selected Philosophical Works]. Moscow: Logos Publ. (In Russian)

PoluektovA. A. (2016) Reprezentatsiya teksta i tsifrovye tekhnologii [Text representation and digital technologies]. Psikholingvisticheskie aspekty izucheniya rechevoy deyatel'nosti 14: 264–277. (In Russian)

Pstyga A. (2021) Mul'timodal'nost' mediateksta v novom kommunikativnom prostranstve (nablyudeniya i zamechaniya) [Multimodality of media text in the new communicative space (observations and remarks)]. Voprosy zhurnalistiki, pedagogiki, yazykoznaniya 40 (4): 442–450. DOI: 10.52575/2712-7451-2021-40-4-442-450 (In Russian)

Rogozina I. V. (2003) Media-kartina mira: kognitivno-semioticheskiy aspekt: dissertatsiya … doktora filol. nauk.[Media picture of the world: cognitive-semiotic aspect. Dr. philol. sci. diss.] Barnaul. (In Russian)

Sherstyukova M. N. (2012) Data-zhurnalistika kak novoe napravlenie v sisteme sredstv massovoy kommunikatsii [Data journalism as a new direction in the system of mass media]. Media. Informatsiya. Kommunikatsiya 1: 12–14. (In Russian)

Shilina A. G. (2019) Spetsifika istochnikov informatsii v zhurnalistike dannykh [Specificity of information sources in data journalism]. Mediaskop 2. Available at: http://www.mediascope.ru/2550 (accessed: 01.07.2024). DOI: 10.30547/mediascope.2.2019.9. (In Russian)

Shilina M. G. (2013) Data Journalism – data-zhurnalistika, zhurnalistika metadannykh – v strukture mediakommunikatsii: k voprosu formirovaniya teoreticheskikh issledovatel'skikh podkhodov [Data Journalism – data journalism, metadata journalism - in the structure of media communication: on the formation of theoretical research approaches]. Mediaskop 1. Available at: http://www.mediascope.ru/node/1263 (accessed: 01.07.2024). (In Russian)

Simakova S. I. (2016) Zhurnalistika dannykh kak ob"ektivnoe trebovanie vremeni i ee vliyanie na formirovanie vizual'noy zhurnalistiki [Data journalism as an objective requirement of the time and its influence on the formation of visual journalism]. Znak: problemnoe pole mediaobrazovaniya 1 (18): 18–25. (In Russian)

Simakova S. I., Enbaeva A. P. (2019) Storitelling kak priem zhurnalistskoy raboty [Storytelling as a method of journalistic work]. Znak: problemnoe pole mediaobrazovaniya 1 (31): 110–117. (In Russian)

Solomonik A. B. (2010) Funktsii znakov, znakovykh sistem i semioticheskoy real'nosti [Functions of signs, sign systems and semiotic reality]. Filosofiya znakovykh sistem i yazyk. Moscow: LKI Publ. Pp. 244–250. (In Russian)

Teplyashina A. N. (2015) Zhanrovaya model' avtorskoy zhurnalistiki [Genre model of author's journalism].Zhurnalistskiy ezhegodnik 4: 49–53. Tomsk. (In Russian)

Tertychnyy A. A. (2014) Metodologicheskaya rol' zhanrov v poznavatel'noy deyatel'nosti zhurnalista [Features of genre formation in the Internet media]. Voprosy teorii i praktiki zhurnalistiki 4: 42–48. (In Russian)

Tertychnyy A. A. (2013) Osobennosti zhanroobrazovaniya v internet-SMI [Methodological role of genres in the cognitive activity of a journalist]. Voprosy zhurnalistiki, pedagogiki, yazykoznaniya 6 (149): 172–179. (In Russian)

Tynyanov Ju. N. (1977) Oda kak oratorskiy zhanr [Ode as an oratorical genre]. Poetika. Istoriya literatury. Kino. Moscow. Pp. 227–252. (In Russian)

Yakunin A.V. (2015). Mezhdistsiplinarnyy podkhod k analizu vizual'nykh kommunikatsiy: ot chastnykh zadach k edinoy. metodologii issledovaniya [An interdisciplinary approach to the analysis of visual communications: from particular problems to a unified one. research methodology]. Mediaskop 2: 1-7. Available at: http://mediascope7.mediascope.ru/?q=node/1703 (accessed: 05.11.2024). (In Russian)

Yakunin A.V. (2017). Ot «chteniya» k «vzaimodeystviyu»: k voprosu o metodologii semioticheskogo analiza interaktivnykh media [From “reading” to “interaction”: to the question of the methodology of semiotic analysis of interactive media]. Kul'tura i tsivilizatsiya 7 (5A): 164-169. (In Russian)

Zholud' R. V. (2014) Zhurnalistika dannykh: predposylki vozniknoveniya, funktsii i vozmozhnosti [Data journalism: prerequisites for occurrence, functions and opportunities]. Vestnik Voronezhskogo gosudarstvennogo universiteta. Ser.: Filologiya. Zhurnalistika 4: 104–106. (In Russian)

To cite this article: Kozhemyakin E. A., Ivanova L. V., Kupriyanova A. V. (2024) Pragmaticheskiy aspekt mul’timodal’noy zhurnalistskoy kommunikatsii: vzaimodeystvie retsipientov s tsifrovym data-tekstom [Pragmatic aspect of multimodal journalistic communication: interaction of recipients with digital data text]. Vestnik Moskovskogo Univer- siteta. Seriya 10. Zhurnalistika 3: 89–121. DOI: 10.30547/vestnik.journ.3.2024.89121