FCP Doctoral Presentation Institute of Education
Do ? Multimodal patterns of
regularity and variation
in video-interaction
Elisabetta Adami
29:05:08 / IoE
Analysing Elisabetta Adami
Object of study:
• Interaction through videos on
29:05:08 / IoE
Analysing Elisabetta Adami
and Video-interaction
video-interaction:
communication threads made up of video files
Video X
RE: Video
X.1
• Video responses
Video
RE: X.1.1
RE: Video • Written comments
X.1.2
Video Video
RE: RE: X.1.2.1
X.2
Video RE: Video
RE: X.3 X.1.2.2
29:05:08 / IoE
18:01:08 / M.A.Gr.
Analysing Elisabetta Adami
Research question(s):
• The semiotic practices of video-interaction
– patterns of regularity and variation
• semiotic resources
• topic-relatedness
• Ultimate aim:
– current uses of video-response option
– > communicative functions of video-interaction
29:05:08 / IoE
Analysing Elisabetta Adami
Theoretical framework
• Social semiotic multimodal analysis
• (Halliday 1978; Hodge & Kress 1988; Kress & Van Leeuwen 1996, 2006)
• Further references:
– Speech acts theory + Conversation analysis
– (Searle 1969, Austin 1975, Sacks, Schlegoff, & Jefferson 1974)
29:05:08 / IoE
Analysing Elisabetta Adami
PhD research
•Request for responses
18:01:08 / M.A.Gr.
Analysing Elisabetta Adami
The corpus: video threads/1
The first thread:
• @----Where Do YouTube?----@
∙ 1 initial video
└ 792 responses
└ 33 sub-responses
└ 1 sub-sub response
∙1 video summary
└ 8 vid.responses
└ 1 sub-response
29:05:08 / IoE
Analysing Elisabetta Adami
• No (explicit) request
29:05:08 / IoE
Analysing Elisabetta Adami
The corpus: video threads/2
Third thread:
• Best video EVER!
– 1 initial video
– 611 video responses
+ N sub-responses
29:05:08 / IoE
Analysing Elisabetta Adami
The video threads: extant analysis
fully transcribed and analysed
- topic-relatedness
- multimodal deployment
- communicative functions
partially transcribed and analysed
first observations
- topic-relatedness
29:05:08 / IoE
Analysing Elisabetta Adami
29:05:08 / IoE
Analysing Elisabetta Adami
Where tubers (declare to) tube
• 59 countries (732 videos)
29:05:08 / IoE
Analysing Elisabetta Adami
Where tubers (declare to) tube
29:05:08 / IoE
Analysing Elisabetta Adami
Multimodal deployment
MODE NO. OF VIDEOS
Written Hand-writing 532 700
Type-writing 168
Image Photos 94 350
Visual Shots 73
Drawings 23
Flags 33
Maps (or satellite shot) 68
Clothing 15
Auditory Spoken (43 spoken only) 92
Soundtrack related to the topic 44
Singing 4
29:05:08 / IoE
Analysing Elisabetta Adami
Multimodal deployment
835 video responses
356 video responses
700 written language 311 spoken language
29:05:08 / IoE
Analysing Elisabetta Adami
Variations-within-attuning = differentiation
Posture writing supports/materials
Gestures Music/Sound
Facial expressions Drawing
Gaze Photo
Avatars
Layout
Clothing
Colour
Camera position
29:05:08 / IoE
Analysing Elisabetta Adami
Primary Interpersonal Function:
• The ideational (content) functions interpersonally :
– Presents each tuber’s role (leader/subversive/devoted)
• The textual (form) functions interpersonally :
– Differentiation (variation-within-attuning)
• Each video is a performative act:
– Initial video: summoning
– Video responses: gathering
– Summarising video: selective reinforcing
collective product = ‘we are’
29:05:08 / IoE
Analysing Elisabetta Adami
Topic-relatedness
• The less explicit the request, the more implied the knowledge:
•Act-related:
•formal response (parody)
•evaluation (comment)
•Tuber-related:
•evaluation
•previous acts (‘Leave Britney Alone’)
•gay/trans meeting forum
•Spam (tubing-related):
•Tuber’s purposes beyond interacting
(no. of views)
29:05:08 / IoE
Analysing Elisabetta Adami
Provisional conclusions:
• Formal regularities: attuning function (solidarity)
• Variations: differentiating function (individuality)
• Uses of video-response option:
– topic-related reply;
– tuber-related comment;
– tubing-related purposes (to get views)
• Communicative functions:
– Main interpersonal (phatic) function
(identities/relationships/community)
– Widening? (discussion on a topic?)
29:05:08 / IoE
Analysing Elisabetta Adami
comments, remarks, questions, suggestions?
Thank you!
29:05:08 / IoE