In sentence acceptability experiments, subjects are typically asked to indicate their response by means of a yes/no forced choice task, an n-point numerical scale task, or a magnitude estimation (ME) task. Among these, ME is commonly taken to yield a better type of data. We submit these three response methods to a critical examination by comparing the results obtained by each in three otherwise identical experiments. These experiments explore a wide range of acceptability contrasts, from very clear to very subtle, and we find that the three methods generally appear to be equally capable of capturing these contrasts. Given the known drawbacks of ME, we conclude that yes/no and n-point tasks are more reasonable choices for most sentence judgment experiments.
Proceedings of the 29th West Coast Conference on Formal Linguistics
edited by Jaehoon Choi, E. Alan Hogue, Jeffrey Punske, Deniz Tat, Jessamyn Schertz, and Alex Trueman Table of contents
ISBN 978-1-57473-451-5 library binding
viii + 406 pages
publication date: 2012
published by Cascadilla Proceedings Project, Somerville, MA, USA