| Annotation -- SpeakerB -- BodyPosture |
primary trackSpeaker B: Body posture track. All attributes are the same as for Speaker A.
| Attributes | ||
ValueSet "Body-Direction-type" (6 tokens) |
BodyDirection | Body Posture is defined with respect to the subject's own body axis. |
ValueSet "F-Basic-type" (2 tokens) |
FeedbackBasic | Feedback basic is used to specify whether feedback is of type contact, perception and understanding (the default) or other (that is one value out of C/P/U/A). |
ValueSet "F-Direction-type" (4 tokens) |
FeedbackDirection | The direction feedback feature is used to distinguish between feedback giving, eliciting, giving-eliciting. It can also be underspecified. |
ValueSet "F-Agreement-type" (2 tokens) |
FeedbackAgreement | Direction and basic feedback can also be accompanied by signs of agreeing or not agreeing. |
ValueSet "Emotion/Attitude-type" (13 tokens) |
Emotion/Attitude | Emotions and attitudes can co-occur with any of the communicative features. They include i.a. Ekman's six basic emotions: happiness, surprise, anger, sadness, fear, disgust/contempt. |
ValueSet "Turn-type" (6 tokens) |
Turn | Turn features refer to the way in which one of the dialogue participants gains, ends or holds the turn, and reflect whether this is done in agreement or not. In a more coarse-grained scheme, one could do with the three values TurnGain, TurnEnd and TurnHold (see MUMIN 3.3). |
ValueSet "Sequencing-type" (4 tokens) |
Sequencing | Sequencing is concerned with speech act organisation and structuring into sub-dialogues. It should not be confused with turn-management, that models turn shifts among dialogue participants. |
ValueSet "InformationStructure-type" (1 tokens) |
InformationStructure | The gesture has a function relating to information structure, i.e. the organisation of the information within a sentence or utterance. It could be underlining the topic, the focus or creating emphasis and contrast. |
ValueSet "Semiotic-type" (5 tokens) |
SemioticType | Based on Peirce's theory, three types are defined: indexical, iconic and symbolic. In cases where a gesture has multiple semiotic values, the strongest should be chosen. |
MultiLink |
Addition | The gesture adds information to the corresponding speech segment, e.g. by making a concept more specific. See Poggi and Magno Caldognetto (1996). The feature was subsumed under Compatible in MUMIN 3.3. |
MultiLink |
Reinforcement | The gesture has the same meaning as the corresponding speech segment. See Poggi and Magno Caldognetto (1996). It was subsumed under Compatible in MUMIN 3.3. |
MultiLink |
Substitution | The gesture occurs in absence of words. See Poggi and Magno Caldognetto (1996). |
MultiLink |
Contradiction | The gesture contradicts the corresponding speech segment e.g. to denote sarcasm or irony. See Poggi and Magno Caldognetto (1996). It corresponds to Incompatible in MUMIN 3.3. |
MultiLink |
RelationOther | To be used if none of the other values are appropriate. A comment *must* be added. |
| Attribute Values |
Body Posture is defined with respect to the subject's own body axis.
| BodyForward | The subject is leaning forward. | |
| BodyBackward | The subject is leaning backward. | |
| BodyUp | The subject is arching or lifting the torso up. | |
| BodyDown | The subject is bending the torso down. | |
| BodySide | The subject is leaning to the side. | |
| BodyDirectionOther | To be used if none of the other values are appropriate, for instance for complex movements. A comment *must* be added. |
Feedback basic is used to specify whether feedback is of type contact, perception and understanding (the default) or other (that is one value out of C/P/U/A).
| CPU | The subject gives or elicits signs that the message is being perceived and understood (CPU means contact, perception, understanding). The feature corresponds to 'Understand' in earlier versions of the MUMIN scheme. | |
| BasicOther | The subject gives or elicits signs that the message is being perceived, but perhaps not understood. The coder may want to indicate a more specific value choosng from C, P and U, in the comment. |
The direction feedback feature is used to distinguish between feedback giving, eliciting, giving-eliciting. It can also be underspecified.
| FeedbackUnderspecified | This value should be chosen if the coder is not sure whether the subject is giving or eliciting feeback. | |
| FeedbackGiveElicit | This value should be chosen if the coder thinks that the subject is giving and eliciting feedback at the same time. | |
| FeedbackGive | The subject gives feedback by showing that they have perceived the message and are willing to maintain contact and go on in the communication. | |
| FeedbackElicit | The subject elicits signs that the interlocutor has perceived the message and is willing to maintain contact and go on in the communication. |
Direction and basic feedback can also be accompanied by signs of agreeing or not agreeing.
| Agree | The subject gives or elicits signs of agreement. In earlier versions the type was called Accept. | |
| NonAgree | The subject gives or elicits signs of lack of agreement. In earlier versions the type was called NonAccept. |
Emotions and attitudes can co-occur with any of the communicative features. They include i.a. Ekman's six basic emotions: happiness, surprise, anger, sadness, fear, disgust/contempt.
| Happy | --- | |
| Sad | --- | |
| Surprised | --- | |
| Disgusted | --- | |
| Angry | --- | |
| Frightened | --- | |
| Certain | --- | |
| Uncertain | --- | |
| Interested | --- | |
| Uninterested | --- | |
| Disappointed | --- | |
| Satisfied | --- | |
| Other | --- |
Turn features refer to the way in which one of the dialogue participants gains, ends or holds the turn, and reflect whether this is done in agreement or not. In a more coarse-grained scheme, one could do with the three values TurnGain, TurnEnd and TurnHold (see MUMIN 3.3).
| TurnTake | The speaker takes a turn that wasn't offered, possibly by interrupting. | |
| TurnAccept | The speaker accepts a turn that is being offered. | |
| TurnYield | The speaker releases the turn under pressure. | |
| TurnElicit | The speaker offers the turn to the interlocutor. | |
| TurnComplete | The speaker completes the turn as well as the conversation. The turn is not passed on. | |
| TurnHold | The speaker wishes to keep the turn (usually done by rotating the head and the gaze away from the listener). |
Sequencing is concerned with speech act organisation and structuring into sub-dialogues. It should not be confused with turn-management, that models turn shifts among dialogue participants.
| SeqOpen | Opening sequence indicates that a new speech sequence is starting, e.g. a gesture occurring together with the phrase "by the way...". | |
| SeqResume | Resume sequence indicates that a preceding speech sequence is resumed after an interruption or a false start. | |
| SeqContinue | Continue sequence indicates that the current speech sequence is going on, e.g. a gesture occurring together with enumerative phrases such as "the first... the second... the third...". | |
| SeqClose | Closing sequence indicates that the current speech sequence is closed, e.g. a gesture occurring together with phrases such as "that's it, that's all". |
The gesture has a function relating to information structure, i.e. the organisation of the information within a sentence or utterance. It could be underlining the topic, the focus or creating emphasis and contrast.
| InfoStructureUnderspecified | --- |
Based on Peirce's theory, three types are defined: indexical, iconic and symbolic. In cases where a gesture has multiple semiotic values, the strongest should be chosen.
| IndexDeictic | Indexical gestures express a relation of cause-effect between the sign (the gesture) and its meaning. In particular, Indexical Deictics locate aspects of the discourse in the physical space (e.g. by pointing). They can also be used to index the addressee. | |
| IndexNon-deictic | Indexical gestures express a relation of cause-effect between the sign (the gesture) and its meaning. In Indexical Non-deictic the indexical relation is between the gesture and the effect it establishes. Batonic or beat gestures fall into this category. | |
| Iconic | Iconic gestures express a semantic feature by similarity or homomorphism. Examples are gestures that express size (length, height, etc.) of an object mentioned in the discourse. Included in this category are also gestures that are sometimes called metaphoric. | |
| Symbolic | Symbolic gestures (emblems) are gestures in which the relation between form and content is based on social convention (e.g. the okay gesture). They are culture-specific. | |
| SemioticOther | To be used if none of the semiotic values apply. A comment must be added. |
The gesture adds information to the corresponding speech segment, e.g. by making a concept more specific. See Poggi and Magno Caldognetto (1996). The feature was subsumed under Compatible in MUMIN 3.3.
The gesture has the same meaning as the corresponding speech segment. See Poggi and Magno Caldognetto (1996). It was subsumed under Compatible in MUMIN 3.3.
The gesture occurs in absence of words. See Poggi and Magno Caldognetto (1996).
The gesture contradicts the corresponding speech segment e.g. to denote sarcasm or irony. See Poggi and Magno Caldognetto (1996). It corresponds to Incompatible in MUMIN 3.3.
To be used if none of the other values are appropriate. A comment *must* be added.
| Annotation -- SpeakerB -- BodyPosture |