Statistical testing in treatment by replication designs: Three options reconsidered

References

• Allen , M. , Hale , J. , Mongeau , P. , Berkowitz‐Stafford , S. , Stafford , S. , Shanahan , W. , Agee , P. , Dillon , K. , Jackson , R. and Ray , C. 1990 . Testing a model of message sidedness: Three replications . Communication Monographs , 57 : 275 – 291 .
   Web of Science ®Google Scholar
• Barcikowski , R. S. 1981 . Statistical power with group mean as the unit of analysis . Journal of Educational Statistics , 6 : 267 – 285 .
   Google Scholar
• Boster , F. J. and Mongeau , P. A. 1984 . “ Fear arousing persuasive messages ” . In Communication yearbook , Edited by: Bostrom , R. N. Vol. 8 , 330 – 375 . Beverly Hills, CA : Sage .
   Google Scholar
• Bradac , J. J. and Mulac , A. 1984 . A molecular view of powerful and powerless speech styles: Attributional consequences of specific language features and communicator intentions . Communication Monographs , 51 : 307 – 319 .
   Web of Science ®Google Scholar
• Buller , D. B. 1986 . Distraction during persuasive communication: A meta‐analytic review . Communication Monographs , 53 : 91 – 114 .
   Web of Science ®Google Scholar
• Burgoon , M. , Hall , J. and Pfau , M. 1991 . A test of the “messages‐as‐fixed‐effect fallacy”; argument: Empirical and theoretical implications of design choices . Communication Quarterly , 39 : 18 – 34 .
   Google Scholar
• Clark , H. H. 1973 . The language‐as‐fixed‐effect fallacy . Journal of Verbal Learning & Verbal Behavior , 12 : 335 – 359 .
   Google Scholar
• Coleman , E. B. 1964 . Generalizing to a language population . Psychological Reports , 14 : 219 – 226 .
   Web of Science ®Google Scholar
• Coleman , E. B. 1979 . Generalization effects vs. random effects: Is σ2TL a source of Type I or Type II error? . Journal of Verbal Learning & Verbal Behavior , 18 : 243 – 256 .
   Google Scholar
• Cornfield , J. and Tukey , J. W. 1956 . Average values of mean squares for factorials . Annals of Mathematical Statistics , 27 : 907 – 948 .
   Google Scholar
• Dillard , J. P. , Hunter , J. E. and Burgoon , M. 1984 . Sequential‐request persuasive strategies: Meta‐analysis of the foot‐in‐the‐door and door‐in‐the‐face . Human Communication Research , 10 : 461 – 488 .
   Web of Science ®Google Scholar
• Doelger , J. A. , Hewes , D. E. and Graham , M. 1986 . Knowing when to “second‐guess”;: The mindful analysis of messages . Human Communication Research , 12 : 301 – 338 .
   Web of Science ®Google Scholar
• Fontanelle , G. A. , Phillips , A. P. and Lane , D. M. 1985 . Generalizing across stimuli as well as subjects: A neglected aspect of external validity . Journal of Applied Psychology , 70 : 101 – 107 .
   Google Scholar
• Forster , K. I. and Dickinson , R. G. 1976 . More on the language‐as‐fixed‐effect fallacy: Monte Carlo estimates of error rates for F1, F2, F', and min F' . Journal of Verbal Learning & Verbal Behavior , 15 : 132 – 142 .
   Google Scholar
• Glass , G. V. and Hopkins , K. D. 1984 . Statistical methods in education and psychology , (2nd Ed.) , Englewood Cliffs, NJ : Prentice‐Hall .
   Google Scholar
• Hample , D. and Dallinger , J. M. 1987 . Individual differences in cognitive editing standards . Human Communication Research , 14 : 123 – 144 .
   Web of Science ®Google Scholar
• Housel , T. J. 1985 . Conversational themes and attention focusing strategies: Predicting comprehension and recall . Communication Quarterly , 33 : 236 – 253 .
   Google Scholar
• Hunter , J. E. , Hamilton , M. L. and Allen , M. 1989 . The design and analysis of language experiments in communication . Communication Monographs , 56 : 341 – 363 .
   Web of Science ®Google Scholar
• Hunter , J. E. , Schmidt , F. L. and Jackson , G. B. 1982 . Meta‐analysis: Cumulating research findings across studies , Beverly Hills, CA : Sage .
   Google Scholar
• Jackson , S. 1991 . Meta‐analysis for primary and secondary data analysis: The super‐experiment metaphor . Communication Monographs , 58 : 449 – 462 .
   Web of Science ®Google Scholar
• Jackson , S. and Backus , D. 1982 . Are persuasive strategies systematically related to situational variables? . Central States Speech Journal , 33 : 469 – 479 .
   Google Scholar
• Jackson , S. and Brashers , D. June 1990 . M = ? (Choosing a “message sample”; size in communication experiments) , June , Dublin : International Communication Association .
   Google Scholar
• Jackson , S. and Brashers , D. E. May 1992 . Testing treatment effects in replicated treatments designs: An empirical comparison of two candidate tests , May , Miami : International Communication Association .
   Google Scholar
• Jackson , S. and Jacobs , S. 1983 . Generalizing about messages: Suggestions for the design and analysis of experiments . Human Communication Research , 9 : 169 – 191 .
   Web of Science ®Google Scholar
• Jackson , S. , O'Keefe , D. J. and Jacobs , S. 1988 . The search for reliable generalizations about messages: A comparison of research strategies . Human Communication Research , 15 : 127 – 141 .
   Web of Science ®Google Scholar
• Jackson , S. , O'Keefe , D. J. , Jacobs , S. and Brashers , D. 1989 . Messages as replications: Toward a message‐centered design strategy . Communication Monographs , 56 : 364 – 384 .
   Web of Science ®Google Scholar
• Jarboe , S. 1988 . A comparison of input‐output, process‐output, and input‐process‐output models of small group problem‐solving effectiveness . Communication Monographs , 55 : 121 – 142 .
   Web of Science ®Google Scholar
• Johnson , B. T. and Eagly , A. H. 1989 . Effects of involvement on persuasion: A meta‐analysis . Psychological Bulletin , 106 : 290 – 314 .
   Web of Science ®Google Scholar
• Jordan , J. M. and Roloff , M. E. 1990 . Acquiring assistance from others: The effect of indirect requests and relational intimacy on verbal compliance . Human Communication Research , 16 : 519 – 555 .
   Web of Science ®Google Scholar
• Kaid , L. L. and Boydston , J. 1987 . An experimental study of the effectiveness of negative political advertisements . Communication Quarterly , 35 : 193 – 201 .
   Google Scholar
• Kellermann , K. and Reynolds , R. A. 1990 . When ignorance is bliss: The role of motivation to reduce uncertainty in uncertainty reduction theory . Human Communication Research , 17 : 5 – 71 .
   Web of Science ®Google Scholar
• Kenny , D. A. and Judd , C. M. 1986 . Consequences of violating the independence assumption in the analysis of variance . Psychological Bulletin , 99 : 422 – 431 .
   Web of Science ®Google Scholar
• Keppel , G. 1982 . Design and analysis: A researcher's handbook , 2nd ed. , Englewood Cliffs, NJ : Prentice‐Hall .
   Google Scholar
• Keppel , G. 1991 . Design and analysis: A researcher's handbook , 3rd ed. , Englewood Cliffs, NJ : Prentice‐Hall .
   Google Scholar
• Miller , G. R. , Boster , F. , Roloff , M. and Seibold , D. 1977 . Compliance‐gaining message strategies: A typology and some findings concerning effects of situational differences . Communication Monographs , 44 : 37 – 51 .
   Web of Science ®Google Scholar
• Morley , D. D. 1988 . Meta‐analytic techniques: When generalizing to a language population is not possible . Human Communication Research , 15 : 112 – 126 .
   Web of Science ®Google Scholar
• O'Keefe , D. J. 1987 . The persuasive effects of delaying identification of high‐ and low‐credibility communicators: A meta‐analytic review . Central States Speech Journal , 38 : 63 – 72 .
   Google Scholar
• Planalp , S. 1985 . Relational schemata: A test of alternative forms of relational knowledge as guides to communication . Human Communication Research , 12 : 3 – 29 .
   Web of Science ®Google Scholar
• Richter , M. L. and Seay , M. B. 1987 . ANOVA designs with subjects and stimuli as random effects: Applications to prototype effects on recognition memory . Journal of Personality and Social Psychology , 53 : 470 – 480 .
   Web of Science ®Google Scholar
• Rogers , R. W. and Mewborn , C. R. 1976 . Fear appeals and attitude change: Effects of a threats noxiousness, probability of occurrence, and the efficacy of coping responses . Journal of Personality and Social Psychology , 34 : 54 – 61 .
   PubMed Web of Science ®Google Scholar
• Sackett , P. R. , Harris , M. H. and Orr , J. M. 1986 . On seeking moderator variables in the meta‐analysis of correlational data: A Monte Carlo investigation of statistical power and resistance to Type I error . Journal of Applied Psychology , 71 : 302 – 310 .
   Web of Science ®Google Scholar
• Santa , J. L. , Miller , J. J. and Shaw , M. L. 1979 . Using quasi F to prevent alpha inflation due to stimulus variation . Psychological Bulletin , 86 : 37 – 46 .
   Web of Science ®Google Scholar
• Slater , M. D. 1991 . Use of message stimuli in mass communication experiments: A methodological assessment and discussion . Journalism Quarterly , 68 : 412 – 421 .
   Web of Science ®Google Scholar
• Stiff , J. B. 1986 . Cognitive processing of persuasive message cues: A meta‐analytic review of the effect of supporting information on attitudes . Communication Monographs , 53 : 75 – 89 .
   Web of Science ®Google Scholar
• Stiff , J. B. , Dillard , J. P. , Somera , L. , Kim , H. and Sleight , C. 1988 . Empathy, communication, and prosocial behavior . Communication Monographs , 55 : 199 – 213 .
   Google Scholar
• Tracy , K. 1982 . “ On getting the point: Distinguishing “issues”; from “events”; an act of conversational coherence ” . In Communication yearbook , Edited by: Burgoon , M. Vol. 5 , 279 – 301 . Beverly Hills : Sage .
   Google Scholar
• Tracy , K. 1983 . The issue‐event distinction: A rule of conversation and its scope condition . Human Communication Research , 9 : 320 – 334 .
   Web of Science ®Google Scholar
• Villuame , W. A. , Jackson , J. and Schouten , T. G. 1989 . Issue‐event extensions and interaction involvement: Text‐based and meaning‐based discourse strategies . Human Communication Research , 15 : 407 – 427 .
   Google Scholar
• Wickens , T. D. and Keppel , G. 1983 . On the choice of design and of test statistic in the analysis of experiments with sampled materials . Journal of Verbal Learning and Verbal Behavior , 22 : 296 – 309 .
   Google Scholar
• Wike , E. L. and Church , J. D. 1976 . Comments on Clark's “The Language‐as‐Fixed‐Effect Fallacy.”; . Journal of Verbal Learning & Verbal Behavior , 15 : 249 – 255 .
   Google Scholar
• Winer , B. J. 1971 . Statistical principles in experimental design , 2nd ed. , New York : McGraw‐Hill .
   Google Scholar
• Yeaton , W. H. and Sechrest , L. 1987 . Use and misuse of no‐difference findings in eliminating threats to validity . Evaluation Review , 10 : 836 – 852 .
   Google Scholar
• Zahn , C. 1989 . The bases for differing evaluations of male and female speech evidence from ratings of transcribed conversation . Communication Monographs , 56 : 59 – 74 .
   Web of Science ®Google Scholar