Reliability of an instrument for direct observation of urban neighbourhoods

Catherine Paquet, Margaret Cargo, Yan Kestens, Mark Daniel

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

There is an increasing interest in evaluating physical and social characteristics of deprived and wealthy neighbourhoods to explain social health disparities. Direct observations enable obtaining a comprehensive and objective representation of such characteristics. The quality of this representation rests on the use of a reliable and valid observation tool. This study reports measurement properties of an instrument that was developed to directly observe structural and contextual environmental characteristics of urban neighbourhoods with respect to urban form (e.g., street safety elements, parking), negative attributes (e.g., rubbish, crumbling masonry, graffiti), and positive attributes (e.g., maintained dwellings, sitting benches). Two trained evaluators rated the condition of streets, public spaces, dwelling units and the presence/absence of specific characteristics of 250 street blocks within 30 socio-economically diverse census tracts of the Montreal Metropolitan Census Area in 2003. Inter- and intra-rater reliability was assessed using kappa and internal consistency was ascertained using Cronbach's alpha. Inter- and intra-rater reliability was excellent (>0.80) for items pertaining to urban form, and substantial (>0.60) for domains pertaining to positive and negative characteristics. Internal consistency was acceptable (>0.70) for urban form and negative characteristics, but not for positive characteristics. This study demonstrates the psychometric properties of an instrument designed to measure positive, negative, and urban form characteristics which has utility for examining various environmental effects on many aspects of health in a wide range of research contexts.

Original languageEnglish
Pages (from-to)194-201
Number of pages8
JournalLandscape and Urban Planning
Volume97
Issue number3
DOIs
Publication statusPublished - 15 Sep 2010
Externally publishedYes

Fingerprint

census
social characteristics
masonry
public space
parking
refuse
environmental effect
safety
health
attribute
dwelling

Cite this

@article{e23bcbc9980b44d1a2d0faa815ac1ef5,
title = "Reliability of an instrument for direct observation of urban neighbourhoods",
abstract = "There is an increasing interest in evaluating physical and social characteristics of deprived and wealthy neighbourhoods to explain social health disparities. Direct observations enable obtaining a comprehensive and objective representation of such characteristics. The quality of this representation rests on the use of a reliable and valid observation tool. This study reports measurement properties of an instrument that was developed to directly observe structural and contextual environmental characteristics of urban neighbourhoods with respect to urban form (e.g., street safety elements, parking), negative attributes (e.g., rubbish, crumbling masonry, graffiti), and positive attributes (e.g., maintained dwellings, sitting benches). Two trained evaluators rated the condition of streets, public spaces, dwelling units and the presence/absence of specific characteristics of 250 street blocks within 30 socio-economically diverse census tracts of the Montreal Metropolitan Census Area in 2003. Inter- and intra-rater reliability was assessed using kappa and internal consistency was ascertained using Cronbach's alpha. Inter- and intra-rater reliability was excellent (>0.80) for items pertaining to urban form, and substantial (>0.60) for domains pertaining to positive and negative characteristics. Internal consistency was acceptable (>0.70) for urban form and negative characteristics, but not for positive characteristics. This study demonstrates the psychometric properties of an instrument designed to measure positive, negative, and urban form characteristics which has utility for examining various environmental effects on many aspects of health in a wide range of research contexts.",
keywords = "Epidemiologic measurements, Neighbourhood observations, Reliability and validity, Residence characteristics",
author = "Catherine Paquet and Margaret Cargo and Yan Kestens and Mark Daniel",
year = "2010",
month = "9",
day = "15",
doi = "10.1016/j.landurbplan.2010.06.001",
language = "English",
volume = "97",
pages = "194--201",
journal = "Landscape Planning",
issn = "0169-2046",
publisher = "Elsevier",
number = "3",

}

Reliability of an instrument for direct observation of urban neighbourhoods. / Paquet, Catherine; Cargo, Margaret; Kestens, Yan; Daniel, Mark.

In: Landscape and Urban Planning, Vol. 97, No. 3, 15.09.2010, p. 194-201.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Reliability of an instrument for direct observation of urban neighbourhoods

AU - Paquet, Catherine

AU - Cargo, Margaret

AU - Kestens, Yan

AU - Daniel, Mark

PY - 2010/9/15

Y1 - 2010/9/15

N2 - There is an increasing interest in evaluating physical and social characteristics of deprived and wealthy neighbourhoods to explain social health disparities. Direct observations enable obtaining a comprehensive and objective representation of such characteristics. The quality of this representation rests on the use of a reliable and valid observation tool. This study reports measurement properties of an instrument that was developed to directly observe structural and contextual environmental characteristics of urban neighbourhoods with respect to urban form (e.g., street safety elements, parking), negative attributes (e.g., rubbish, crumbling masonry, graffiti), and positive attributes (e.g., maintained dwellings, sitting benches). Two trained evaluators rated the condition of streets, public spaces, dwelling units and the presence/absence of specific characteristics of 250 street blocks within 30 socio-economically diverse census tracts of the Montreal Metropolitan Census Area in 2003. Inter- and intra-rater reliability was assessed using kappa and internal consistency was ascertained using Cronbach's alpha. Inter- and intra-rater reliability was excellent (>0.80) for items pertaining to urban form, and substantial (>0.60) for domains pertaining to positive and negative characteristics. Internal consistency was acceptable (>0.70) for urban form and negative characteristics, but not for positive characteristics. This study demonstrates the psychometric properties of an instrument designed to measure positive, negative, and urban form characteristics which has utility for examining various environmental effects on many aspects of health in a wide range of research contexts.

AB - There is an increasing interest in evaluating physical and social characteristics of deprived and wealthy neighbourhoods to explain social health disparities. Direct observations enable obtaining a comprehensive and objective representation of such characteristics. The quality of this representation rests on the use of a reliable and valid observation tool. This study reports measurement properties of an instrument that was developed to directly observe structural and contextual environmental characteristics of urban neighbourhoods with respect to urban form (e.g., street safety elements, parking), negative attributes (e.g., rubbish, crumbling masonry, graffiti), and positive attributes (e.g., maintained dwellings, sitting benches). Two trained evaluators rated the condition of streets, public spaces, dwelling units and the presence/absence of specific characteristics of 250 street blocks within 30 socio-economically diverse census tracts of the Montreal Metropolitan Census Area in 2003. Inter- and intra-rater reliability was assessed using kappa and internal consistency was ascertained using Cronbach's alpha. Inter- and intra-rater reliability was excellent (>0.80) for items pertaining to urban form, and substantial (>0.60) for domains pertaining to positive and negative characteristics. Internal consistency was acceptable (>0.70) for urban form and negative characteristics, but not for positive characteristics. This study demonstrates the psychometric properties of an instrument designed to measure positive, negative, and urban form characteristics which has utility for examining various environmental effects on many aspects of health in a wide range of research contexts.

KW - Epidemiologic measurements

KW - Neighbourhood observations

KW - Reliability and validity

KW - Residence characteristics

UR - http://www.scopus.com/inward/record.url?scp=77955273670&partnerID=8YFLogxK

U2 - 10.1016/j.landurbplan.2010.06.001

DO - 10.1016/j.landurbplan.2010.06.001

M3 - Article

VL - 97

SP - 194

EP - 201

JO - Landscape Planning

JF - Landscape Planning

SN - 0169-2046

IS - 3

ER -