How students reason about visualizations from large professionally collected data sets

A study of students approaching the threshold of data proficiency

Ilyse Resnick, Kim A. Kastens, Thomas F. Shipley

Research output: Contribution to journalArticle

Abstract

This study identifies a population of students who have an intermediate amount of relevant content knowledge and skill for working with data, and characterizes their approach to interpreting a challenging data-based visualization. Thirty-three undergraduate students enrolled in an introductory environmental science course reasoned about salinity data as shown in map and vertical profiles from the Mediterranean while thinking aloud and being eye-tracked. Students reasoned about 2D and 3D interpretations in the context of two hypothesis arrays (a suite of potential interpretations about a set of data). Findings suggest the students have some effective strategies in reading data: They look at cartographic elements, correctly identify the image as a salinity map, and draw inferences from the data. Common looking strategies include scanning along the salinity gradient, comparing areas of interest, and aligning the color bar with the map. Individual differences emerge in the interpretation of the data, with no interpretations being fully aligned with the scientifically normative explanation. Post hoc analyses identify reasoning tasks and spontaneous behaviors related to a construct we refer to as “data expertise,” which is intended to capture the degree of conceptual sophistication and resourcefulness in reasoning about data. A data expertise scale was developed, with scores ranging from zero (weak) to six (strong) that were normally distributed. Our findings suggest that appropriately coordinating data with a model, comparing and contrasting across data representations from different times or places, and extracting 3D structure from 2D representations are associated with data expertise.

Original languageEnglish
Pages (from-to)55-76
Number of pages22
JournalJournal of Geoscience Education
Volume66
Issue number1
DOIs
Publication statusPublished - 2018
Externally publishedYes

Fingerprint

visualization
student
interpretation
expertise
salinity
vertical profile

Cite this

@article{fa5b136c74ad4c8ca541dbde4fc12019,
title = "How students reason about visualizations from large professionally collected data sets: A study of students approaching the threshold of data proficiency",
abstract = "This study identifies a population of students who have an intermediate amount of relevant content knowledge and skill for working with data, and characterizes their approach to interpreting a challenging data-based visualization. Thirty-three undergraduate students enrolled in an introductory environmental science course reasoned about salinity data as shown in map and vertical profiles from the Mediterranean while thinking aloud and being eye-tracked. Students reasoned about 2D and 3D interpretations in the context of two hypothesis arrays (a suite of potential interpretations about a set of data). Findings suggest the students have some effective strategies in reading data: They look at cartographic elements, correctly identify the image as a salinity map, and draw inferences from the data. Common looking strategies include scanning along the salinity gradient, comparing areas of interest, and aligning the color bar with the map. Individual differences emerge in the interpretation of the data, with no interpretations being fully aligned with the scientifically normative explanation. Post hoc analyses identify reasoning tasks and spontaneous behaviors related to a construct we refer to as “data expertise,” which is intended to capture the degree of conceptual sophistication and resourcefulness in reasoning about data. A data expertise scale was developed, with scores ranging from zero (weak) to six (strong) that were normally distributed. Our findings suggest that appropriately coordinating data with a model, comparing and contrasting across data representations from different times or places, and extracting 3D structure from 2D representations are associated with data expertise.",
keywords = "Data expertise, Novice, Reasoning, STEM",
author = "Ilyse Resnick and Kastens, {Kim A.} and Shipley, {Thomas F.}",
year = "2018",
doi = "10.1080/10899995.2018.1411724",
language = "English",
volume = "66",
pages = "55--76",
journal = "Journal of Geological Education",
issn = "0022-1368",
publisher = "National Association of Geoscience Teachers Inc.",
number = "1",

}

TY - JOUR

T1 - How students reason about visualizations from large professionally collected data sets

T2 - A study of students approaching the threshold of data proficiency

AU - Resnick, Ilyse

AU - Kastens, Kim A.

AU - Shipley, Thomas F.

PY - 2018

Y1 - 2018

N2 - This study identifies a population of students who have an intermediate amount of relevant content knowledge and skill for working with data, and characterizes their approach to interpreting a challenging data-based visualization. Thirty-three undergraduate students enrolled in an introductory environmental science course reasoned about salinity data as shown in map and vertical profiles from the Mediterranean while thinking aloud and being eye-tracked. Students reasoned about 2D and 3D interpretations in the context of two hypothesis arrays (a suite of potential interpretations about a set of data). Findings suggest the students have some effective strategies in reading data: They look at cartographic elements, correctly identify the image as a salinity map, and draw inferences from the data. Common looking strategies include scanning along the salinity gradient, comparing areas of interest, and aligning the color bar with the map. Individual differences emerge in the interpretation of the data, with no interpretations being fully aligned with the scientifically normative explanation. Post hoc analyses identify reasoning tasks and spontaneous behaviors related to a construct we refer to as “data expertise,” which is intended to capture the degree of conceptual sophistication and resourcefulness in reasoning about data. A data expertise scale was developed, with scores ranging from zero (weak) to six (strong) that were normally distributed. Our findings suggest that appropriately coordinating data with a model, comparing and contrasting across data representations from different times or places, and extracting 3D structure from 2D representations are associated with data expertise.

AB - This study identifies a population of students who have an intermediate amount of relevant content knowledge and skill for working with data, and characterizes their approach to interpreting a challenging data-based visualization. Thirty-three undergraduate students enrolled in an introductory environmental science course reasoned about salinity data as shown in map and vertical profiles from the Mediterranean while thinking aloud and being eye-tracked. Students reasoned about 2D and 3D interpretations in the context of two hypothesis arrays (a suite of potential interpretations about a set of data). Findings suggest the students have some effective strategies in reading data: They look at cartographic elements, correctly identify the image as a salinity map, and draw inferences from the data. Common looking strategies include scanning along the salinity gradient, comparing areas of interest, and aligning the color bar with the map. Individual differences emerge in the interpretation of the data, with no interpretations being fully aligned with the scientifically normative explanation. Post hoc analyses identify reasoning tasks and spontaneous behaviors related to a construct we refer to as “data expertise,” which is intended to capture the degree of conceptual sophistication and resourcefulness in reasoning about data. A data expertise scale was developed, with scores ranging from zero (weak) to six (strong) that were normally distributed. Our findings suggest that appropriately coordinating data with a model, comparing and contrasting across data representations from different times or places, and extracting 3D structure from 2D representations are associated with data expertise.

KW - Data expertise

KW - Novice

KW - Reasoning

KW - STEM

UR - http://www.mendeley.com/research/students-reason-about-visualizations-large-professionally-collected-data-sets-study-students-approac

U2 - 10.1080/10899995.2018.1411724

DO - 10.1080/10899995.2018.1411724

M3 - Article

VL - 66

SP - 55

EP - 76

JO - Journal of Geological Education

JF - Journal of Geological Education

SN - 0022-1368

IS - 1

ER -