Reconsidering the impact of behavior prediction questions on illegal drug use: The importance of using proper analytic methodsFootnote

Jon Krosnick is University Fellow at Resources for the Future. We thank Patti Williams, Lauren Block, and Gavan Fitzsimons for providing us with their data sets for the analyses reported here.

References

• Atkinson , R. C. , Furlong , M. J. and Wampold , B. E. 1982 . Statistical significance, reviewer evaluations, and the scientific process: Is there a (statistically) significant relationship? . Journal of Counseling Psychology , 29 : 189 – 194 .
   Web of Science ®Google Scholar
• Barber , J. A. and Thompson , S. G. 2000 . Analysis of cost data in randomized trials: An application of the non‐parametric bootstrap. . Statistics in Medicine , 19 (23) : 3219 – 3236 .
   PubMed Web of Science ®Google Scholar
• Barrett , J. P. and Goldsmith , L. 1976 . When is n sufficiently large? . American Statistician , 30 (2) : 67 – 70 .
   Web of Science ®Google Scholar
• Clarke , K. R. and Green , R. H. 1988 . Statistical design and analysis for a ‘biological effects’ study. . Marine Ecology – Progress Series , 46 : 213 – 226 .
   Web of Science ®Google Scholar
• Cohen , J. , Cohen , P. , West , S. G. and Aiken , L. S. 2003 . Applied multiple regression / correlation analysis for the behavioral sciences , Mahwah, NJ : Lawrence Erlbaum Associates Inc . (3rd ed.)
   Google Scholar
• Delucchi , K. L. and Bostrom , A. 2004 . Methods for analysis of skewed data distributions in psychiatric clinical studies: Working with many zero values. . American Journal of Psychiatry , 161 (7) : 1159 – 1168 .
   PubMed Web of Science ®Google Scholar
• Efron , B. and Tibshirani , R. J. 1993 . An introduction to the bootstrap , New York : Chapman & Hall/CRC .
   Google Scholar
• Field , J. G. , Clarke , K. R. and Warwick , R. M. 1982 . A practical strategy for analysing multispecies distribution patterns. . Marine Ecology – Progress Series , 8 : 37 – 52 .
   Web of Science ®Google Scholar
• Gardner , W. , Mulvey , E. P. and Shaw , E. C. 1995 . Regression analyses of counts and rates: Poisson, overdispersed Poisson, and negative binomial models. . Psychological Bulletin , 118 (3) : 392 – 404 .
   PubMed Web of Science ®Google Scholar
• Gayen , A. K. 1950 . Significance of difference between the means of two non‐normal samples. . Biometrika , 37 (3/4) : 399 – 408 .
   PubMed Web of Science ®Google Scholar
• Greene , W. H. 2003 . Econometric analysis , Upper Saddle River, NJ : Prentice Hall . (5th ed.)
   Google Scholar
• Greenwald , A. G. 1975 . Consequences of prejudice against the null hypothesis. . Psychological Bulletin , 82 : 1 – 20 .
   Web of Science ®Google Scholar
• Kirk , R. E. 1995 . Experimental design: Procedures for the behavioral sciences , Pacific Grove, CA : Brooks/Cole Publishing Company . (3rd ed.)
   Google Scholar
• Lachenbruch , P. A. 1976 . Analysis of data with clumping at zero. . Biometrische Zeitschrift , 18 (5) : 351 – 356 .
   Google Scholar
• Lachenbruch , P. A. 2001 . Comparisons of two‐part models with competitors. . Statistics in Medicine , 20 : 1215 – 1234 .
   PubMed Web of Science ®Google Scholar
• Lachenbruch , P. A. 2002 . Analysis of data with excess zeros. . Statistical Methods in Medical Research , 11 (4) : 297 – 302 .
   PubMed Web of Science ®Google Scholar
• Long , J. S. 1995 . Regression models for categorical and limited dependent variables , Thousand Oaks, CA : Sage Publications .
   Google Scholar
• Long , J. S. and Ervin , L. H. 2000 . Using heteroscedasticity consistent standard errors in the linear regression model. . American Statistician , 54 (3) : 217 – 224 .
   Web of Science ®Google Scholar
• Ludbrook , J. and Dudley , H. 1998 . Why permutation tests are superior to t and F tests in biomedical research. . American Statistician , 52 (2) : 127 – 132 .
   Web of Science ®Google Scholar
• Lumley , T. , Diehr , P. , Emerson , S. and Chen , L. 2002 . The importance of the normality assumption in large public health data sets. . Annual Review of Publich Health , 23 : 151 – 169 .
   PubMed Web of Science ®Google Scholar
• McClelland , G. H. 2000 . “ Nasty data. Unruly, ill‐mannered observations can ruin your analysis. ” . In Handbook of research methods in social and personality psychology , Edited by: Reis , H. T and Judd , C. M . 393 – 411 . Cambridge, , UK : Cambridge University Press .
   Google Scholar
• Morwitz , V. G. and Fitzsimons , G. J. 2004 . The mere‐measurement effect: Why does measuring intentions change actual behavior? . Journal of Consumer Psychology , 14 (1&2) : 64 – 74 .
   Web of Science ®Google Scholar
• Morwitz , V. G. , Johnson , E. and Schmittlein , D. 1993 . Does measuring intent change behaviour. . Journal of Consumer Research , 20 (June) : 46 – 51 .
   Web of Science ®Google Scholar
• Pearson , E. S. and Please , N. W. 1975 . Relation between the shape of population distribution and the robustness of four simple test statistics. . Biometrika , 62 (2) : 223 – 241 .
   Web of Science ®Google Scholar
• Pocock , S. J. 1982 . When not to rely on the central limit theorem – An example from absenteeism data. . Communications in Statistics: Theory and Methods , 11 (19) : 2169 – 2179 .
   Web of Science ®Google Scholar
• Ratcliffe , J. F. 1968 . The effect on the t distribution of non‐normality in the sampled population. . Applied Statistics , 17 (1) : 42 – 48 .
   Google Scholar
• Rosenthal , R. 1979 . The “file drawer problem” and tolerance for null results. . Psychological Bulletin , 86 : 638 – 641 .
   Web of Science ®Google Scholar
• Sawilowsky , S. S. and Hillman , S. B. 1992 . Power of independent samples t test under a prevalent psychometric measure distribution. . Journal of Consulting and Clinical Psychology , 69 (2) : 240 – 243 .
   Web of Science ®Google Scholar
• Shadish , W. R. , Doherty , M. and Montgomery , L. M. 1989 . How many studies are in the file drawer? An estimate from the family martial psychotherapy literature. . Clinical Psychology Review , 9 : 589 – 603 .
   Web of Science ®Google Scholar
• Sherman , S. J. 1980 . On the self‐erasing nature of errors of prediction. . Journal of Personality and Social Psychology , 39 (2) : 211 – 221 .
   Web of Science ®Google Scholar
• Spangenberg , E. R. 1997 . Increasing health club attendance through self‐prophecy. . Marketing Lettters , 8 (1) : 23 – 32 .
   Google Scholar
• Spangenberg , E. R. , Sprott , D. E. , Grohmann , B. and Smith , R. J. 2003 . Mass‐communicated prediction requests: Practical application and a cognitive dissonance explanation for self‐prophecy. . Journal of Marketing , 67 (2) : 47 – 62 .
   Web of Science ®Google Scholar
• Sprott , D. E. , Spangenberg , E. R. , Block , L. G. , Fitzsimons , G. J. , Morwitz , V. G. and Williams , P. 2006 . The question–behavior effect: What we know and where we go from here. . Social Influence , 1 (2) : 129 – 137 .
   Google Scholar
• Sullivan , L. M. and D'Agostino , R. B. 1992 . Robustness of the t test applied to data distorted from normality by floor effects. . Journal of Dental Research , 71 (12) : 1938 – 1943 .
   PubMed Web of Science ®Google Scholar
• White , H. 1980 . A heteroskedasticity‐consistent covariance matrix estimator and a direct test for heteroskedasticity. . Econometrica , 48 (4) : 817 – 838 .
   Web of Science ®Google Scholar
• Williams , P. , Block , L. G. and Fitzsimons , G. J. 2006a . Simply asking questions about health behaviors increases both healthy and unhealthy behaviors. . Social Influence , 1 (2) : 117 – 127 .
   Google Scholar
• Williams , P. , Block , L. G. and Fitzsimons , G. J. 2006b . Corrigendum. . Social Influence , 1 (3) : 248
   Google Scholar
• Zhou , X. , Gao , S. and Hui , S. L. 1997 . Methods for comparing the means of two independent log‐normal samples. . Biometrics , 53 (3) : 1129 – 1135 .
   PubMed Web of Science ®Google Scholar
• Zhou , X. , Melfi , C. A. and Hui , S. L. 1997 . Methods for comparison of cost data. . Annals of Internal Medicine , 127 (8 part 2) : 752 – 756 .
   PubMed Web of Science ®Google Scholar