Joints and their relations as critical features in action discrimination

Evidence from a classification image method

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

Classifying an action as a runner or a walker is a seemingly effortless process. However, it is difficult to determine which features are used with hypothesis-driven research, because biological motion stimuli generally consist of about a dozen joints, yielding an enormous number of potential relationships among them. Here, we develop a hypothesis-free approach based on a classification image method, using experimental data from relatively few trials (;1,000 trials per subject). Employing ambiguous actions morphed between a walker and a runner, we identified three types of features that play important roles in discriminating bipedal locomotion presented in a side view: (a) critical joint feature, supported by the finding that the similarity of the movements of feet and wrists to prototypical movements of these joints were most reliably used across all participants; (b) structural features, indicated by contributions from almost all other joints, potentially through a form-based analysis; and (c) relational features, revealed by statistical correlations between joint contributions, specifically relations between the two feet, and relations between the wrists/ elbow and the hips. When the actions were inverted, only critical joint features remained to significantly influence discrimination responses. When actions were presented with continuous depth rotation, critical joint features and relational features associated strongly with responses. Using a double-pass paradigm, we estimated that the internal noise is about twice as large as the external noise, consistent with previous findings. Overall, our novel design revealed a rich set of critical features that are used in action discrimination. The visual system flexibly selects a subset of features depending on viewing conditions.

Original languageEnglish
Pages (from-to)1-17
Number of pages17
JournalJournal of Vision
Volume15
Issue number1
DOIs
Publication statusPublished - 1 Jan 2015
Externally publishedYes

Fingerprint

Joints
Wrist
Noise
Locomotion
Elbow
Hip
Foot
Research

Cite this

@article{2e7fa1849fa247b399fe2606313d71d6,
title = "Joints and their relations as critical features in action discrimination: Evidence from a classification image method",
abstract = "Classifying an action as a runner or a walker is a seemingly effortless process. However, it is difficult to determine which features are used with hypothesis-driven research, because biological motion stimuli generally consist of about a dozen joints, yielding an enormous number of potential relationships among them. Here, we develop a hypothesis-free approach based on a classification image method, using experimental data from relatively few trials (;1,000 trials per subject). Employing ambiguous actions morphed between a walker and a runner, we identified three types of features that play important roles in discriminating bipedal locomotion presented in a side view: (a) critical joint feature, supported by the finding that the similarity of the movements of feet and wrists to prototypical movements of these joints were most reliably used across all participants; (b) structural features, indicated by contributions from almost all other joints, potentially through a form-based analysis; and (c) relational features, revealed by statistical correlations between joint contributions, specifically relations between the two feet, and relations between the wrists/ elbow and the hips. When the actions were inverted, only critical joint features remained to significantly influence discrimination responses. When actions were presented with continuous depth rotation, critical joint features and relational features associated strongly with responses. Using a double-pass paradigm, we estimated that the internal noise is about twice as large as the external noise, consistent with previous findings. Overall, our novel design revealed a rich set of critical features that are used in action discrimination. The visual system flexibly selects a subset of features depending on viewing conditions.",
keywords = "Action classification, Action perception, Biological motion, Classification images, Double-pass paradigm, Locomotion/physiology, Joints/physiology, Running/classification, Humans, Walking/classification, Male, Motor Activity/physiology, Discriminant Analysis, Young Adult, Motion Perception/classification, Female",
author = "{van Boxtel}, {Jeroen J.A.} and Hongjing Lu",
year = "2015",
month = "1",
day = "1",
doi = "10.1167/15.1.20",
language = "English",
volume = "15",
pages = "1--17",
journal = "Journal of Vision",
issn = "1534-7362",
publisher = "Association for Research in Vision and Ophthalmology Inc.",
number = "1",

}

Joints and their relations as critical features in action discrimination : Evidence from a classification image method. / van Boxtel, Jeroen J.A.; Lu, Hongjing.

In: Journal of Vision, Vol. 15, No. 1, 01.01.2015, p. 1-17.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Joints and their relations as critical features in action discrimination

T2 - Evidence from a classification image method

AU - van Boxtel, Jeroen J.A.

AU - Lu, Hongjing

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Classifying an action as a runner or a walker is a seemingly effortless process. However, it is difficult to determine which features are used with hypothesis-driven research, because biological motion stimuli generally consist of about a dozen joints, yielding an enormous number of potential relationships among them. Here, we develop a hypothesis-free approach based on a classification image method, using experimental data from relatively few trials (;1,000 trials per subject). Employing ambiguous actions morphed between a walker and a runner, we identified three types of features that play important roles in discriminating bipedal locomotion presented in a side view: (a) critical joint feature, supported by the finding that the similarity of the movements of feet and wrists to prototypical movements of these joints were most reliably used across all participants; (b) structural features, indicated by contributions from almost all other joints, potentially through a form-based analysis; and (c) relational features, revealed by statistical correlations between joint contributions, specifically relations between the two feet, and relations between the wrists/ elbow and the hips. When the actions were inverted, only critical joint features remained to significantly influence discrimination responses. When actions were presented with continuous depth rotation, critical joint features and relational features associated strongly with responses. Using a double-pass paradigm, we estimated that the internal noise is about twice as large as the external noise, consistent with previous findings. Overall, our novel design revealed a rich set of critical features that are used in action discrimination. The visual system flexibly selects a subset of features depending on viewing conditions.

AB - Classifying an action as a runner or a walker is a seemingly effortless process. However, it is difficult to determine which features are used with hypothesis-driven research, because biological motion stimuli generally consist of about a dozen joints, yielding an enormous number of potential relationships among them. Here, we develop a hypothesis-free approach based on a classification image method, using experimental data from relatively few trials (;1,000 trials per subject). Employing ambiguous actions morphed between a walker and a runner, we identified three types of features that play important roles in discriminating bipedal locomotion presented in a side view: (a) critical joint feature, supported by the finding that the similarity of the movements of feet and wrists to prototypical movements of these joints were most reliably used across all participants; (b) structural features, indicated by contributions from almost all other joints, potentially through a form-based analysis; and (c) relational features, revealed by statistical correlations between joint contributions, specifically relations between the two feet, and relations between the wrists/ elbow and the hips. When the actions were inverted, only critical joint features remained to significantly influence discrimination responses. When actions were presented with continuous depth rotation, critical joint features and relational features associated strongly with responses. Using a double-pass paradigm, we estimated that the internal noise is about twice as large as the external noise, consistent with previous findings. Overall, our novel design revealed a rich set of critical features that are used in action discrimination. The visual system flexibly selects a subset of features depending on viewing conditions.

KW - Action classification

KW - Action perception

KW - Biological motion

KW - Classification images

KW - Double-pass paradigm

KW - Locomotion/physiology

KW - Joints/physiology

KW - Running/classification

KW - Humans

KW - Walking/classification

KW - Male

KW - Motor Activity/physiology

KW - Discriminant Analysis

KW - Young Adult

KW - Motion Perception/classification

KW - Female

UR - http://www.scopus.com/inward/record.url?scp=84921651114&partnerID=8YFLogxK

UR - http://www.mendeley.com/research/joints-relations-critical-features-action-discrimination-evidence-classification-image-method

U2 - 10.1167/15.1.20

DO - 10.1167/15.1.20

M3 - Article

VL - 15

SP - 1

EP - 17

JO - Journal of Vision

JF - Journal of Vision

SN - 1534-7362

IS - 1

ER -