Since the election of Donald Trump in 2017 the media has often seemed to be in a continual state of shock at the brusque manner of the forty-fifth president\u2019s speech. During the summer of 2017 I conducted a research project into transcription methods for multimodal discourse, contributing to the Changing Attitudes in Public Discourse study.<\/p>\n
The aim of the project was to find an effective means of transcribing multimodal resources such as video recordings. An effective transcription method would support analysis into public discourse, especially how conversational behaviours like arrogance manifest in public discourse. Donald Trump is relevant as many people view him as a particularly arrogant communicator. Having a method to transcribe the communicative techniques of individuals like Trump will help identify and nullify elements of arrogance in public discourse.<\/p>\n
The first step in selecting an appropriate transcription method was to identify which modalities \u2013 in this case communicative resources \u2013 would merit inclusion. Clearly, speech itself is one of the key modalities and has been the focus of most existing transcription methods. Where necessary, however, information showing specific pronunciation can be included. Verbal utterances that are not words such as laughter or coughing may also be important and were to be included. Similarly, gestures were set to be included as body language can be indicative of speaker attitudes. More subtle modalities such as eye gaze and facial expressions were also deemed potentially insightful for measuring participants\u2019 attitudes. Eye gaze, for example, may suggest that a speaker is addressing one particular participant within a larger debate.<\/p>\n
The modalities of speech, intonation, gesture, gaze and facial expression were considered to be requirements for the transcription method. It followed that the transcription method must be able to represent a range of modalities and information without becoming unclear. Furthermore, some of these modalities can be recorded through written description whereas some can be difficult to represent textually. For example, whilst we can write \u2018participant A pointed towards participant B\u2019, describing the nuances of a facial expression concisely may be challenging, or at worst misleading. It would be a benefit, therefore, for the chosen transcription method to be able to include still-frame images. The inclusion of images can help display modalities such as gesture, facial expression and even gaze without ambiguity. It also seemed important to consider that not all public debates being recorded for analysis would be alike. An effective transcription method, therefore, would be modular. A modular transcription method is flexible in its presentation, allowing the inclusion or exclusion of different modalities depending on whether they are appropriate.<\/p>\n
Research into existing multimodal transcription methods revealed four existing styles of multimodal transcription. These are: playscript, tabular, timeline and image-based. Playscript transcriptions follow the same layout as their namesake \u2013 like reading a theatre play script, each speaker turn is listed chronologically down a page and each turn is usually numbered. This is the type of transcription that many will think of immediately if asked about speech transcription. Playscript transcriptions tend to focus extensively on speech, and other modalities such as gesture are often added in italic font between turns. It is very effective for analytic styles such as conversation analysis wherein speech itself is analysed in great detail, but it is difficult to represent a number of modalities simultaneously in a playscript transcription.<\/p>\n
Tabular transcriptions separate each modality into a column or a row (depending whether the table is horizontally or vertically chronological), with simultaneous communicative events occupying the same level of the table. Tabular transcriptions are useful as they are very flexible due to their modularity. Columns or rows can be added or removed depending on how many modalities are required, and the separation of modalities allows each one to be considered in isolation if necessary. There may also be a column for images. Tabular transcription methods became one of the most suitable templates for multimodal transcription.<\/p>\n
Timeline transcripts are laid out horizontally, with each modality occupying one horizontal axis. Heading the transcription are ongoing timestamps and usually there are images included periodically \u2013 every five seconds for example. Each modality is represented effectively in real time in relation to the timestamps, making it easy to see the duration of speech acts or gestures and which actions coincide. Regular images also lend gestures and expressions more clarity. Timeline transcriptions along with tabular transcriptions were exceptionally suitable.<\/p>\n
The final transcription style, image-based, was uncommon and served a niche purpose. Images or even drawings of the event form the background, over which different modalities such as speech are superimposed. Directional arrows sometimes showed gaze. These were useful for showing specific situations, such as in instruction manuals, but it became immediately clear that the format would become unwieldy if a number of modalities were involved.<\/p>\n
Both tabular and timeline transcription methods were appropriate for multimodal transcription. Both were modular, flexible and a number of modalities could be represented clearly. However, the timeline transcription was eventually deemed superior as the capacity to visually interpret the coincidence and duration of actions offered a significant advantage.<\/p>\n
As the Changing Attitudes in Public Discourse project develops, timeline transcriptions will be a useful tool for transcribing multimodal public debates. Outlining a number of communicative modalities for direct analysis will aid identification of cues to arrogance and contribute to the creation of guidelines towards productive public debate.<\/p>\n
Image from Ethan Hein on Flickr CC.BY 2.0<\/p>\n","protected":false},"excerpt":{"rendered":"Since the election of Donald Trump in 2017 the media has often seemed to be in a continual state of shock at the brusque manner of the forty-fifth president\u2019s speech. […]","protected":false},"author":1319,"featured_media":422,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[19],"tags":[23,33,28],"custom_author":[125],"class_list":["post-419","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-open-for-debate","tag-changing-attitudes-in-public-discourse","tag-communication","tag-trump","custom_author-martin-tom"],"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p8KPlM-6L","jetpack-related-posts":[{"id":365,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/arrogance-and-the-space-of-reasons\/","url_meta":{"origin":419,"position":0},"title":"Arrogance and the Space of Reasons","author":"Alessandra Tanesini","date":"January 29, 2018","format":false,"excerpt":"\u00a0 A democracy is more than a form of government; it is primarily a mode of associated living, of conjoining communicated experience. ---John Dewey[1] \u00a0 One of the truly baffling things about the Trump era in the United States is that just when you think our political life could not\u2026","rel":"","context":"In "Open for Debate"","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/01\/Hawk.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/01\/Hawk.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/01\/Hawk.jpg?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":426,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/trust-and-trump-investigating-sincerity-and-accuracy-in-discourse\/","url_meta":{"origin":419,"position":1},"title":"TRUST and Trump: investigating sincerity and accuracy in discourse","author":"Alessandra Tanesini","date":"April 9, 2018","format":false,"excerpt":"When exploring discursive untruthfulness, modern American politics is an obvious example. Donald Trump\u2019s presidency has been continuously criticised for his use of falsity, with the aim of promoting his own biased views. However, untruthfulness is irrefutably underpinned by the notion of \u2018lying\u2019, an act that is near impossible to identify:\u2026","rel":"","context":"In "Open for Debate"","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/04\/trump.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/04\/trump.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/04\/trump.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/04\/trump.jpg?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":21,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/open-for-debate\/","url_meta":{"origin":419,"position":2},"title":"We are now open for debate","author":"Alessandra Tanesini","date":"May 18, 2017","format":false,"excerpt":"Welcome to 'Open for Debate', a blog associated with the project Changing Attitudes in Public Discourse.\u00a0We hope to use this space to debate all aspects and forms of debate. Ultimately, we would like to develop together, in the spirit of collaboration, some suggestions to improve the quality of discussions in\u2026","rel":"","context":"In "Open for Debate"","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/04\/19945231246_a0ea274061_k.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/04\/19945231246_a0ea274061_k.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/04\/19945231246_a0ea274061_k.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/04\/19945231246_a0ea274061_k.jpg?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/04\/19945231246_a0ea274061_k.jpg?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/04\/19945231246_a0ea274061_k.jpg?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":432,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/poisonous-words-arrogance-bullshit-and-accusations-of-lying-in-public-discourse\/","url_meta":{"origin":419,"position":3},"title":"Poisonous Words: Arrogance, Bullshit and Accusations of Lying in Public Discourse","author":"Alessandra Tanesini","date":"April 23, 2018","format":false,"excerpt":"As is common with international incidents today, the Skripal case, in which a Russian double agent and his daughter were poisoned with a nerve agent in Salisbury, England, has generated an abundance of fake news, conspiracy theories, deceptions, misleading, bullshit and lying. There have been many accusations of lying and\u2026","rel":"","context":"In "Open for Debate"","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/04\/all-explanations-arerubbish4754734_43ced6dc.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/04\/all-explanations-arerubbish4754734_43ced6dc.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/04\/all-explanations-arerubbish4754734_43ced6dc.jpg?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":1481,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/is-being-resilient-an-unfair-burden\/","url_meta":{"origin":419,"position":4},"title":"Is being resilient an unfair burden?","author":"Alessandra Tanesini","date":"July 11, 2022","format":false,"excerpt":"Navigating the world of public debate can be a difficult task. There are many hurdles to overcome in the process of finding out about and sharing one\u2019s views on social and political issues. There is the long and difficult task of sorting through the mass of available information in search\u2026","rel":"","context":"In "Open for Debate"","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2022\/07\/dan-meyers-hluOJZjLVXc-unsplash-2.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2022\/07\/dan-meyers-hluOJZjLVXc-unsplash-2.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2022\/07\/dan-meyers-hluOJZjLVXc-unsplash-2.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2022\/07\/dan-meyers-hluOJZjLVXc-unsplash-2.jpg?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2022\/07\/dan-meyers-hluOJZjLVXc-unsplash-2.jpg?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2022\/07\/dan-meyers-hluOJZjLVXc-unsplash-2.jpg?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":249,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/good-democracy-needs-good-questions\/","url_meta":{"origin":419,"position":5},"title":"Good Democracy Needs Good Questions","author":"Alessandra Tanesini","date":"September 25, 2017","format":false,"excerpt":"\u201cIf you were president, what would you do about Syria and the humanitarian crisis in Aleppo?\u201d This question was asked to both candidates at the second U.S. presidential debate, during the run-up to the 2016 presidential election. As per the \u2018town-hall\u2019 format of the debate, the question was asked by\u2026","rel":"","context":"In "Changing Attitudes"","block_context":{"text":"Changing Attitudes","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/changing-attitudes\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/09\/questions.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/09\/questions.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/09\/questions.jpg?resize=525%2C300&ssl=1 1.5x"},"classes":[]}],"meta_box":[],"jetpack_featured_media_url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/03\/4244624289_70b27dc8a6_z.jpg","_links":{"self":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts\/419","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/users\/1319"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/comments?post=419"}],"version-history":[{"count":4,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts\/419\/revisions"}],"predecessor-version":[{"id":424,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts\/419\/revisions\/424"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/media\/422"}],"wp:attachment":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/media?parent=419"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/categories?post=419"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/tags?post=419"},{"taxonomy":"custom_author","embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/custom_author?post=419"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}