Annotation -- SpeakerB -- HandGesture

`primary track`
SpeakerB.HandGesture

Speaker B: Hand gesture track. All attributes are the same as for Speaker A.

Attributes
`ValueSet "Handedness-type" (2 tokens)`	Handedness	It refers to whether one or two hands are involved.
`ValueSet "Palm-type" (3 tokens)`	Palm	It refers to whether the palm is open or closed. New wrt. MUMIN 3.3.
`ValueSet "Palm-orientation-type" (5 tokens)`	PalmOrientation	It refers to the position of the palm in space. New wrt. MUMIN 3.3.
`ValueSet "Fingers-type" (4 tokens)`	Fingers	It accounts for finger extension. New wrt. MUMIN 3.3.
`ValueSet "Amplitude-type" (3 tokens)`	Amplitude	It accounts for how broad the gesture is. New wrt. MUMIN 3.3.
`ValueSet "Trajectory-Right-Hand-type" (7 tokens)`	TrajectoryRightHand	Similar values to those used for the direction of , head and body. The feature also indicates the trajectory of the fingers if extended. The value 'complex' is a combination of several of the more basic ones. 'Other' should be used if none of the other values can be applied, and a comment must then be added. In MUMIN 3.3. there is a general trajectory feature that does not distinguish between left and righ hands.
`ValueSet "Trajectory-Left-Hand-type" (7 tokens)`	TrajectoryLeftHand	The same values as for Trajectory Right Hand. The feature also indicates the trajectory of the fingers if extended. The value 'complex' is a combination of several of the more basic ones. 'Other' should be used if none of the other values can be applied, and a comment must then be added. In MUMIN 3.3. there is a general trajectory feature that does not distinguish between left and righ hands.
`ValueSet "Hand-Repetition-type" (2 tokens)`	HandRepetition	It indicates whether the movement is repeated or not. A repeated gesture is a sequence of similar gestures in rapid succession. See also HeadRepetition. New feature wrt. MUMIN 3.3.
`ValueSet "F-Basic-type" (2 tokens)`	FeedbackBasic	Feedback basic is used to specify whether feedback is of type contact, perception and understanding (the default) or other (that is one value out of C/P/U/A).
`ValueSet "F-Direction-type" (4 tokens)`	FeedbackDirection	The direction feedback feature is used to distinguish between feedback giving, eliciting and giving-eliciting. It can also be underspecified.
`ValueSet "F-Agreement-type" (2 tokens)`	FeedbackAgreement	Basic and direction feedback can also be accompanied by signs of agreeing or not agreeing.
`ValueSet "Emotion/Attitude-type" (13 tokens)`	Emotion/Attitude	Emotions and attitudes can co-occur with any of the communicative features. They include i.a. Ekman's six basic emotions: happiness, surprise, anger, sadness, fear, disgust/contempt.
`ValueSet "Turn-type" (6 tokens)`	Turn	Turn features refer to the way in which one of the dialogue participants gains, ends or holds the turn, and reflect whether this is done in agreement or not. In a more coarse-grained scheme, one could do with the three values TurnGain, TurnEnd and TurnHold (see MUMIN 3.3).
`ValueSet "Sequencing-type" (4 tokens)`	Sequencing	Sequencing is concerned with speech act organisation and structuring into sub-dialogues. It should not be confused with turn-management, that models turn shifts among dialogue participants.
`ValueSet "InformationStructure-type" (1 tokens)`	InformationStructure	The gesture has a function relating to information structure, i.e. the organisation of the information within a sentence or utterance. It could be underlining the topic, the focus or creating emphasis and contrast.
`ValueSet "Semiotic-type" (5 tokens)`	SemioticType	Based on Peirce's theory, three types are defined: indexical, iconic and symbolic. In cases where a gesture has multiple semiotic values, the strongest should be chosen.
`MultiLink`	Addition	The gesture adds information to the corresponding speech segment, e.g. by making a concept more specific. See Poggi and Magno Caldognetto (1996). The feature was subsumed under Compatible in MUMIN 3.3.
`MultiLink`	Reinforcement	The gesture has the same meaning as the corresponding speech segment. See Poggi and Magno Caldognetto (1996). It was subsumed under Compatible in MUMIN 3.3.
`MultiLink`	Substitution	The gesture occurs in absence of words. See Poggi and Magno Caldognetto (1996).
`MultiLink`	Contradiction	The gesture contradicts the corresponding speech segment e.g. to denote sarcasm or irony. See Poggi and Magno Caldognetto (1996). It corresponds to Incompatible in MUMIN 3.3.
`MultiLink`	RelationOther	To be used if none of the other values are appropriate. A comment must be added.

Attribute Values

Handedness

It refers to whether one or two hands are involved.

BothHands	Both hands are involved
SingleHand	Either right or left hand are involved alone

Palm

It refers to whether the palm is open or closed. New wrt. MUMIN 3.3.

PalmOpen	The palm is open.
PalmClosed	The palm is closed.
PalmOther	To be used if none of the other values are appropriate. A comment must be added.

PalmOrientation

It refers to the position of the palm in space. New wrt. MUMIN 3.3.

PalmUp	The palm is horizontal and facing upwards.
PalmDown	The palm is horizontal and facing down.
PalmSide	The palm is horizontal and facing sideways.
PalmVertical	The palm is vertical.
PalmOrientationOther	To be used if none of the other values are appropriate. A comment must be added.

Fingers

It accounts for finger extension. New wrt. MUMIN 3.3.

IndexExtended	The index is extended while the rest of the fingers are not.
ThumbExtended	The thumb is extended while the rest of the fingers are not.
AllFingersExtended	All fingers are extended.
FingersOther	To be used if none of the other values are appropriate. A comment must be added.

Amplitude

It accounts for how broad the gesture is. New wrt. MUMIN 3.3.

Centre	The centre refers to a region roughly corresponding to the subject's torso. See MacNeill, D. (1992).
Periphery	The periphery refers to a region outside of the subject's torso, that above neck and shoulders, to the side of the torso or beneath the stomach. This means that the arm is somewhat extended. See MacNeill, D. (1992).
AmplitudeOther	AmplitudeOther: To be used if none of the other values are appropriate. A comment must be added.

TrajectoryRightHand

Similar values to those used for the direction of , head and body. The feature also indicates the trajectory of the fingers if extended. The value 'complex' is a combination of several of the more basic ones. 'Other' should be used if none of the other values can be applied, and a comment *must* then be added. In MUMIN 3.3. there is a general trajectory feature that does not distinguish between left and righ hands.

RightHandForward	---
RightHandBackward	---
RightHandSide	---
RightHandUp	---
RightHandDown	---
RightHandComplex	---
RightHandOther	---

TrajectoryLeftHand

The same values as for Trajectory Right Hand. The feature also indicates the trajectory of the fingers if extended. The value 'complex' is a combination of several of the more basic ones. 'Other' should be used if none of the other values can be applied, and a comment *must* then be added. In MUMIN 3.3. there is a general trajectory feature that does not distinguish between left and righ hands.

LeftHandForward	---
LeftHandBackward	---
LeftHandSide	---
LeftHandUp	---
LeftHandDown	---
LeftHandComplex	---
LeftHandOther	---

HandRepetition

It indicates whether the movement is repeated or not. A repeated gesture is a sequence of similar gestures in rapid succession. See also HeadRepetition. New feature wrt. MUMIN 3.3.

Single	---
Repeated	---

FeedbackBasic

Feedback basic is used to specify whether feedback is of type contact, perception and understanding (the default) or other (that is one value out of C/P/U/A).

CPU	The subject gives or elicits signs that the message is being perceived and understood (CPU means contact, perception, understanding). The feature corresponds to 'Understand' in earlier versions of the MUMIN scheme.
BasicOther	The subject gives or elicits signs that the message is being perceived, but perhaps not understood. The coder may want to indicate a more specific value choosng from C, P and U, in the comment.

FeedbackDirection

The direction feedback feature is used to distinguish between feedback giving, eliciting and giving-eliciting. It can also be underspecified.

FeedbackUnderspecified	This value should be chosen if the coder is not sure whether the subject is giving or eliciting feeback.
FeedbackGiveElicit	This value should be chosen if the coder thinks that the subject is giving and eliciting feedback at the same time.
FeedbackGive	The subject gives feedback by showing that they have perceived the message and are willing to maintain contact and go on in the communication.
FeedbackElicit	The subject elicits signs that the interlocutor has perceived the message and is willing to maintain contact and go on in the communication.

FeedbackAgreement

Basic and direction feedback can also be accompanied by signs of agreeing or not agreeing.

Agree	The subject gives or elicits signs of agreement. In earlier versions the type was called Accept.
NonAgree	The subject gives or elicits signs of lack of agreement. In earlier versions the type was called NonAccept.

Emotion/Attitude

Emotions and attitudes can co-occur with any of the communicative features. They include i.a. Ekman's six basic emotions: happiness, surprise, anger, sadness, fear, disgust/contempt.

Happy	---
Sad	---
Surprised	---
Disgusted	---
Angry	---
Frightened	---
Certain	---
Uncertain	---
Interested	---
Uninterested	---
Disappointed	---
Satisfied	---
Other	---

Turn

Turn features refer to the way in which one of the dialogue participants gains, ends or holds the turn, and reflect whether this is done in agreement or not. In a more coarse-grained scheme, one could do with the three values TurnGain, TurnEnd and TurnHold (see MUMIN 3.3).

TurnTake	The speaker takes a turn that wasn't offered, possibly by interrupting.
TurnAccept	The speaker accepts a turn that is being offered.
TurnYield	The speaker releases the turn under pressure.
TurnElicit	The speaker offers the turn to the interlocutor.
TurnComplete	The speaker completes the turn as well as the conversation. The turn is not passed on.
TurnHold	The speaker wishes to keep the turn (usually done by rotating the head and the gaze away from the listener).

Sequencing

Sequencing is concerned with speech act organisation and structuring into sub-dialogues. It should not be confused with turn-management, that models turn shifts among dialogue participants.

SeqOpen	Opening sequence indicates that a new speech sequence is starting, e.g. a gesture occurring together with the phrase "by the way...".
SeqResume	Resume sequence indicates that a preceding speech sequence is resumed after an interruption or a false start.
SeqContinue	Continue sequence indicates that the current speech sequence is going on, e.g. a gesture occurring together with enumerative phrases such as "the first... the second... the third...".
SeqClose	Closing sequence indicates that the current speech sequence is closed, e.g. a gesture occurring together with phrases such as "that's it, that's all".

InformationStructure

The gesture has a function relating to information structure, i.e. the organisation of the information within a sentence or utterance. It could be underlining the topic, the focus or creating emphasis and contrast.

InfoStructureUnderspecified

---

SemioticType

Based on Peirce's theory, three types are defined: indexical, iconic and symbolic. In cases where a gesture has multiple semiotic values, the strongest should be chosen.

IndexDeictic	Indexical gestures express a relation of cause-effect between the sign (the gesture) and its meaning. In particular, Indexical Deictics locate aspects of the discourse in the physical space (e.g. by pointing). They can also be used to index the addressee.
IndexNon-deictic	Indexical gestures express a relation of cause-effect between the sign (the gesture) and its meaning. In Indexical Non-deictic the indexical relation is between the gesture and the effect it establishes. Batonic or beat gestures fall into this category.
Iconic	Iconic gestures express a semantic feature by similarity or homomorphism. Examples are gestures that express size (length, height, etc.) of an object mentioned in the discourse. Included in this category are also gestures that are sometimes called metaphoric.
Symbolic	Symbolic gestures (emblems) are gestures in which the relation between form and content is based on social convention (e.g. the okay gesture). They are culture-specific.
SemioticOther	To be used if none of the semiotic values apply. A comment must be added.

Addition

The gesture adds information to the corresponding speech segment, e.g. by making a concept more specific. See Poggi and Magno Caldognetto (1996). The feature was subsumed under Compatible in MUMIN 3.3.

Reinforcement

The gesture has the same meaning as the corresponding speech segment. See Poggi and Magno Caldognetto (1996). It was subsumed under Compatible in MUMIN 3.3.

Substitution

The gesture occurs in absence of words. See Poggi and Magno Caldognetto (1996).

Contradiction

The gesture contradicts the corresponding speech segment e.g. to denote sarcasm or irony. See Poggi and Magno Caldognetto (1996). It corresponds to Incompatible in MUMIN 3.3.

RelationOther

To be used if none of the other values are appropriate. A comment *must* be added.