Intercoder Reliability and Validity of WebPlotDigitizer in Extracting Graphed Data

Quantitative synthesis of data from single-case designs (SCDs) is becoming increasingly common in psychology and education journals. Because researchers do not ordinarily report numerical data in addition to graphical displays, reliance on plot digitizing tools is often a necessary component of this...

Full description

Saved in:

Bibliographic Details
Published in:	Behavior modification Vol. 41; no. 2; pp. 323 - 339
Main Authors:	Drevon, Daniel, Fursa, Sophie R., Malcolm, Allura L.
Format:	Journal Article
Language:	English
Published:	Los Angeles, CA SAGE Publications 01-03-2017 SAGE PUBLICATIONS, INC
Subjects:	Automatic Data Processing Behavioral Research - methods Digitization Humans Meta-analysis Reproducibility of Results Researchers Resistance (Psychology) Validity meta-analysis single-case design data extraction validity reliability
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	Quantitative synthesis of data from single-case designs (SCDs) is becoming increasingly common in psychology and education journals. Because researchers do not ordinarily report numerical data in addition to graphical displays, reliance on plot digitizing tools is often a necessary component of this research. Intercoder reliability of data extraction is a commonly overlooked, but potentially important, step of this process. The purpose of this study was to examine the intercoder reliability and validity of WebPlotDigitizer (Rohatgi, 2015), a web-based plot digitizing tool for extracting data from a variety of plots, including XY coordinates of interrupted time-series data. Two coders extracted 3,596 data points from 168 data series in 36 graphs across 18 studies. Results indicated high levels of intercoder reliability and validity. Implications of and recommendations based on these results are discussed in relation to researchers involved in quantitative synthesis of data from SCDs.
Bibliography:	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23
ISSN:	0145-4455 1552-4167
DOI:	10.1177/0145445516673998