Quantifying the presence of evidential value and selective reporting in food-related inhibitory control training: a p-curve analysis

References

• ** Indicates articles extracted from the Allom et al. (2016) and Jones et al. (2016) meta-analyses.
   Google Scholar
• † Indicates articles included in the updated p-curve analysis.
   Google Scholar
• Acharya, S. D., Elci, O. U., Sereika, S. M., Music, E., Styn, M. A., Turk, M. W., & Burke, L. E. (2009). Adherence to a behavioral weight loss treatment program enhances weight loss and improvements in biomarkers. Patient Preference and Adherence, 3, 151–160.
   PubMed Web of Science ®Google Scholar
• **Adams, R. C., Lawrence, N. S., Verbruggen, F., & Chambers, C. D. (2017). Training response inhibition to reduce food consumption: Mechanisms, stimulus specificity and appropriate training protocols. Appetite, 109, 11–23. doi: 10.1016/j.appet.2016.11.014
   PubMed Web of Science ®Google Scholar
• **Allom, V., & Mullan, B. (2015). Two inhibitory control training interventions designed to improve eating behaviour and determine mechanisms of change. Appetite, 89, 282–290. doi: 10.1016/j.appet.2015.02.022
   PubMed Web of Science ®Google Scholar
• Allom, V., Mullan, B., & Hagger, M. (2016). Does inhibitory control training improve health behaviour? A meta-analysis. Health Psychology Reviews, 10, 168–186. doi: 10.1080/17437199.2015.1051078
   PubMed Web of Science ®Google Scholar
• Anderson, R. ( Ed.). (2003). Obesity: Etiology, assessment, treatment, and prevention. Champaign, IL: Human Kinetics.
   Google Scholar
• Avenell, A., Broom, J., Brown, T. J., Poobalan, A., Aucott, L., Stearns, S. C., … Grant, A. M. (2004). Systematic review of the long-term effects and economic consequences of treatments for obesity and implications for health improvement. Health Technology Assessment, 8, iii–iiv. doi: 10.3310/hta8210
   PubMed Web of Science ®Google Scholar
• Baguley, T. (2009). Standardized or simple effect size: What should be reported? British Journal of Psychology, 100, 603–617. doi: 10.1348/000712608X377117
   PubMed Web of Science ®Google Scholar
• Baldwin, S. A. (2017). Improving the rigor of psychophysiology research. International Journal of Psychophysiology, 111, 5–16. doi: 10.1016/j.ijpsycho.2016.04.006
   PubMed Web of Science ®Google Scholar
• Bazzano, L. A., Hu, T., Reynolds, K., Yao, L., Bunol, C., Liu, Y., … He, J. (2014). Effects of low-carbohydrate and low-fat diets. Annals of Internal Medicine, 161, 309–318. doi: 10.7326/M14-0180
   PubMed Web of Science ®Google Scholar
• †Bongers, P., Houben, K., & Jansen, A. (2018). Double up! Examining the effects of adding inhibition training to food cue exposure in chocolate-loving female students. Appetite, 121, 154–162. doi: 10.1016/j.appet.2017.11.096
   PubMed Web of Science ®Google Scholar
• **Bowley, C., Faricy, C., Hegarty, B., Johnstone, S. J., Smith, J., Kelly, P., & Rushby, J. A. (2013). The effects of inhibitory control training on alcohol consumption, implicit alcohol-related cognitions and brain electrical activity. International Journal of Psychophysiology, 89, 342–348. doi: 10.1016/j.ijpsycho.2013.04.011
   PubMed Web of Science ®Google Scholar
• Button, K. S., Ioannidis, J. P., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S., & Munafo, M. R. (2013). Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience, 14, 365–376. doi: 10.1038/nrn3475
   PubMed Web of Science ®Google Scholar
• Carbine, K. A., Christensen, E., LeCheminant, J. D., Bailey, B. W., Tucker, L. A., & Larson, M. J. (2017). Testing food-related inhibitory control to high- and low-calorie food stimuli: Electrophysiological responses to high-calorie food stimuli predict calorie and carbohydrate intake. Psychophysiology, 54, 982–997. doi: 10.1111/psyp.12860
   PubMed Web of Science ®Google Scholar
• Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J. (2018, June 15). Correcting for bias in psychology: A comparison of meta-analytic methods. doi: 10.17605/OSF.IO/9H3NU
   Google Scholar
• Centers for Disease Control and Prevention. (2015). Losing weight. Retrieved from https://www.cdc.gov/healthyweight/losing_weight/
   Google Scholar
• Clayson, P. E., & Miller, G. A. (2017a). ERP reliability analysis (ERA) toolbox: An open-source toolbox for analyzing the reliability of event-related brain potentials. International Journal of Psychophysiology, 111, 68–79. doi: 10.1016/j.ijpsycho.2016.10.012
   PubMed Web of Science ®Google Scholar
• Clayson, P. E., & Miller, G. A. (2017b). Psychometric considerations in the measurement of event-related brain potentials: Guidelines for measurement and reporting. International Journal of Psychophysiology, 111, 57–67. doi: 10.1016/j.ijpsycho.2016.09.005
   PubMed Web of Science ®Google Scholar
• **Di Lemma, L. C. G., & Field, M. (2017). Cue avoidance training and inhibitory control training for the reduction of alcohol consumption: A comparison of effectiveness and investigation of their mechanisms of action. Psychopharmacology, 234. doi: 10.1007/s00213-017-4639-0
   PubMed Web of Science ®Google Scholar
• Elfhag, K. & Rössner, S. (2009). Weight loss maintenance and weight cycling. In P. G. Kopelman, I. D. Caterson, & W. H. Dietz (Eds.), Clinical Obesity in adults and Children (3rd ed., pp. 351–365). Oxford, UK: Wiley-Blackwell
   Google Scholar
• Fanelli, D. (2012). Negative results are disappearing from most disciplines and countries. Scientometrics, 90, 891–904. doi: 10.1007/s11192-011-0494-7
   Web of Science ®Google Scholar
• Flegal, K. M., Graubard, B. I., Williamson, D. F., & Gail, M. H. (2007). Cause-specific excess deaths associated with underweight, overweight, and obesity. Journal of American Medical Association, 298, 2028–2037. doi: 10.1001/jama.298.17.2028
   PubMed Web of Science ®Google Scholar
• †Forman, E. M., Shaw, J. A., Goldstein, S. P., Butryn, M. L., Martin, L. M., Meiran, N., … Manasse, S. M. (2016). Mindful decision making and inhibitory control training as complementary means to decrease snack consumption. Appetite, 103, 176–183. doi: 10.1016/j.appet.2016.04.014
   PubMed Web of Science ®Google Scholar
• Gelman, A., & Geurts, H. M. (2017). The statistical crisis in science: How is it relevant to clinical neuropsychology? The Clinical Neuropsychologist, 31, 1000–1014. doi: 10.1080/13854046.2016.1277557
   PubMed Web of Science ®Google Scholar
• Grilo, C. M., Wilfley, D. E., Brownell, K. D., & Rodin, J. (1994). Teasing, body image, and self-esteem in a clinical sample of obese women. Addictive Behaviors, 19, 443–450. doi: 10.1016/0306-4603(94)90066-3
   PubMed Web of Science ®Google Scholar
• **Guerrieri, R., Nederkoorn, C., & Jansen, A. (2012). Disinhibition is easier learned than inhibition. The effects of (dis)inhibition training on food intake. Appetite, 59, 96–99. doi: 10.1016/j.appet.2012.04.006
   PubMed Web of Science ®Google Scholar
• **Guerrieri, R., Nederkoorn, C., Schrooten, M., Martijn, C., & Jansen, A. (2009). Inducing impulsivity leads high and low restrained eaters into overeating whereas current dieters stick to their diet. Appetite, 53, 93–100. doi: 10.1016/j.appet.2009.05.013
   PubMed Web of Science ®Google Scholar
• Guo, Q., Thabane, L., Hall, G., McKinnon, M., Goeree, R., & Pullenayegum, E. (2014). A systematic review of the reporting of sample size calculations and corresponding data components in observational functional magnetic resonance imaging studies. NeuroImage, 86, 172–181. doi: 10.1016/j.neuroimage.2013.08.012
   PubMed Web of Science ®Google Scholar
• Hainer, V., Toplak, H., & Mitrakou, A. (2008). Treatment modalities of obesity: What fits whom? Diabetes Care, 31, S269–S277. doi: 10.2337/dc08-s265
   PubMed Web of Science ®Google Scholar
• Head, M. L., Holman, L., Lanfear, R., Kahn, A. T., & Jennions, M. D. (2015). The extent and consequences of p-hacking in science. PLoS Biology, 13, e1002106. doi: 10.1371/journal.pbio.1002106
   PubMed Web of Science ®Google Scholar
• Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327, 557–560. doi:10.1136/ bmj.327.7414.557 doi: 10.1136/bmj.327.7414.557
   PubMed Web of Science ®Google Scholar
• **Houben, K. (2011). Overcoming the urge to splurge: Influencing eating behavior by manipulating inhibitory control. Journal of Behavior Therapy and Experimental Psychiatry, 42, 384–388. doi: 10.1016/j.jbtep.2011.02.008
   PubMed Web of Science ®Google Scholar
• **Houben, K., Havermans, R. C., Nederkoorn, C., & Jansen, A. (2012). Beer à No-Go: Learning to stop responding to alcohol cues reduces alcohol intake via reduced affective associations rather than increased response inhibition. Addiction, 107, 1280–1287. doi: 10.1111/j.1360-0443.2012.03827.x
   PubMed Web of Science ®Google Scholar
• **Houben, K., & Jansen, A. (2011). Training inhibitory control. A recipe for resisting sweet temptations. Appetite, 56, 345–349. doi: 10.1016/j.appet.2010.12.017
   PubMed Web of Science ®Google Scholar
• **Houben, K., & Jansen, A. (2015). Chocolate equals stop. Chocolate-specific inhibition training reduces chocolate intake and go associations with chocolate. Appetite, 87, 318–323. doi: 10.1016/j.appet.2015.01.005
   PubMed Web of Science ®Google Scholar
• **Houben, K., Nederkoorn, C., Wiers, R. W., & Jansen, A. (2011). Resisting temptation: Decreasing alcohol-related affect and drinking behavior by training response inhibition. Drug and Alcohol Dependence, 116, 132–136. doi: 10.1016/j.drugalcdep.2010.12.011
   PubMed Web of Science ®Google Scholar
• Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2, e124. doi: 10.1371/journal.pmed.0020124
   PubMed Web of Science ®Google Scholar
• Ioannidis, J. P. A. (2008). Why most discovered true associations are inflated. Epidemiology, 19, 640–648. doi: 10.1097/EDE.0b013e31818131e7
   PubMed Web of Science ®Google Scholar
• Jasinska, A. J., Yasuda, M., Burant, C. F., Gregor, N., Khatri, S., Sweet, M., & Falk, E. B. (2012). Impulsivity and inhibitory control deficits are associated with unhealthy eating in young adults. Appetite, 59, 738–747. doi: 10.1016/j.appet.2012.08.001
   PubMed Web of Science ®Google Scholar
• Jensen, M. D., Ryan, D. H., Apovian, C. M., Ard, J. D., Comuzzie, A. G., Donato, K. A., … Yanovski, S. Z. (2014). 2013 AHA/ACC/TOS guideline for the management of overweight and obesity in adults: A report of the American College of Cardiology/American Heart Association task force on practice guidelines and The Obesity Society. Circulation, 129, S102–S138. doi: 10.1161/01.cir.0000437739.71477.ee
   PubMed Web of Science ®Google Scholar
• John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23, 524–532. doi: 10.1177/0956797611430953
   PubMed Web of Science ®Google Scholar
• Jones, A., Di Lemma, L. C., Robinson, E., Christiansen, P., Nolan, S., Tudur-Smith, C., & Field, M. (2016). Inhibitory control training for appetitive behaviour change: A meta-analytic investigation of mechanisms of action and moderators of effectiveness. Appetite, 97, 16–28. doi: 10.1016/j.appet.2015.11.013
   PubMed Web of Science ®Google Scholar
• **Jones, A., & Field, M. (2013). The effects of cue-specific inhibition training on alcohol consumption in heavy social drinkers. Experimental and Clinical Psychopharmacology, 21, 8–16. doi: 10.1037/a0030683
   PubMed Web of Science ®Google Scholar
• †Kakoschke, N., Kemps, E., & Tiggemann, M. (2017). The effect of combined avoidance and control training on implicit food evaluation and choice. Journal of Behavior Therapy and Experimental Psychiatry, 55, 99–105. doi: 10.1016/j.jbtep.2017.01.002
   PubMed Web of Science ®Google Scholar
• Kastorini, C. M., & Panagiotakos, D. B. (2009). Dietary patterns and prevention of type 2 diabetes: From research to clinical practice; A systematic review. Current Diabetes Reviews, 5, 221–227. doi: 10.2174/157339909789804341
   PubMedGoogle Scholar
• Klem, M. L., Wing, R. R., McGuire, M. T., Seagle, H. M., & Hill, J. O. (1997). A descriptive study of individuals successful at long-term maintenance of substantial weight loss. The American Journal of Clinical Nutrition, 66, 239–246. doi: 10.1093/ajcn/66.2.239
   PubMed Web of Science ®Google Scholar
• Ko, Y., & Miller, J. (2013). Signal-related contributions to stopping-interference effects in selective response inhibition. Experimental Brain Research, 228, 205–212. doi: 10.1007/s00221-013-3552-y
   PubMed Web of Science ®Google Scholar
• Laddu, D., Dow, C., Hingle, M., Thomson, C., & Going, S. (2011). A review of evidence-based strategies to treat obesity in adults. Nutrition in Clinical Practice, 26, 512–525. doi: 10.1177/0884533611418335
   PubMed Web of Science ®Google Scholar
• Lakens, D., & Evers, E. R. K. (2014). Sailing from the seas of chaos into the corridor of stability: Practical recommendations to increase the informational value of studies. Perspectives on Psychological Science, 9, 278–292. doi: 10.1177/1745691614528520
   Web of Science ®Google Scholar
• Larson, M. J., & Carbine, K. A. (2017). Sample size calculations in human electrophysiology (EEG and ERP) studies: A systematic review and recommendations for increased rigor. International Journal of Psychophysiology, 111, 33–41. doi: 10.1016/j.ijpsycho.2016.06.015
   PubMed Web of Science ®Google Scholar
• †Lawrence, N. S., O’Sullivan, J., Parslow, D., Javaid, M., Adams, R. C., Chambers, C. D., … Verbruggen, F. (2015a). Training response inhibition to food is associated with weight loss and reduced energy intake. Appetite, 95, 17–28. doi: 10.1016/j.appet.2015.06.009
   PubMed Web of Science ®Google Scholar
• **Lawrence, N. S., Verbruggen, F., Morrison, S., Adams, R. C., & Chambers, C. D. (2015b). Stopping to food can reduce intake. Effects of stimulus-specificity and individual differences in dietary restraint. Appetite, 85, 91–103. doi: 10.1016/j.appet.2014.11.006
   PubMed Web of Science ®Google Scholar
• Luppino, F. S., de Wit, L. M., Bouvy, P. F., Stijnen, T., Cuijpers, P., Penninx, B. W., & Zitman, F. G. (2010). Overweight, obesity, and depression: A systematic review and meta-analysis of longitudinal studies. Archives of General Psychiatry, 67, 220–229. doi: 10.1001/archgenpsychiatry.2010.2
   PubMed Web of Science ®Google Scholar
• Matarese, L. E., & Pories, W. J. (2014). Adult weight loss diets: Metabolic effects and outcomes. Nutrition in Clinical Practice, 29, 759–767. doi: 10.1177/0884533614550251
   PubMed Web of Science ®Google Scholar
• McShane, B. B., Bockenholt, U., & Hansen, K. T. (2016). Adjusting for publication bias in meta-analysis: An evaluation of selection methods and some cautionary notes. Perspectives on Psychological Science, 11, 730–749. doi: 10.1177/1745691616662243
   Web of Science ®Google Scholar
• Munafo, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., … Ioannidis, J. P. A. (2017). A manifesto for reproducible science. Nature Human Behavior, 1. doi: 10.1038/s41562-016-0021
   Web of Science ®Google Scholar
• Mushtaq, R., Shoib, S., Shah, T., & Mushtaq, S. (2014). Relationship between loneliness, psychiatric disorders and physical health? A review on the psychological aspects of loneliness. Journal of Clinical and Diagnostic Research, 8, WE01–WE04. doi: 10.7860/JCDR/2014/10077.4828
   PubMedGoogle Scholar
• **Nagy, A. B. (2012). “Can you resist temptation?” The effectiveness of computerized response inhibition training to reduce alcohol use among heavy drinkers (Masters thesis). Maastricht University Maastricht, the Netherlands. Retrieved from https://pub.maastrichtuniversity.nl/2fa754bd-6e9a-46c6-ae00-e9f70be7eb24
   Google Scholar
• Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018). Preregistration revolution. PNAS. doi: 10.1073/pnas.1708274114
   Web of Science ®Google Scholar
• †Oomen, D., Grol, M., Spronk, D., Booth, C., & Fox, E. (2018). Beating uncontrolled eating: Training inhibitory control to reduce food intake and food cue sensitivity. Appetite, 131, 73–83. doi: 10.1016/j.appet.2018.09.007
   PubMed Web of Science ®Google Scholar
• Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, aac4716. doi:10.1126/science/aac4716 doi: 10.1126/science.aac4716
   PubMed Web of Science ®Google Scholar
• †Poppelaars, A., Scholten, H., Granic, I., Veling, H., Johnson-Glenberg, M. C., & Luijten, M. (2018). When winning is losing: A randomized controlled trial testing a video game to train food-specific inhibitory control. Appetite, 129, 143–154. doi: 10.1016/j.appet.2018.06.039
   PubMed Web of Science ®Google Scholar
• Robinson, E., Bevelander, K. E., Field, M., & Jones, A. (2018). Methodological and reporting quality in laboratory studies of human eating behavior. Appetite, 125, 486–491. doi: 10.1016/j.appet.2018.02.008
   PubMed Web of Science ®Google Scholar
• Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86(3), 638–641. doi: 10.1037/0033-2909.86.3.638
   Web of Science ®Google Scholar
• Schwartz, J. (2016). Nutritional therapy. Primary Care: Clinics in Office Practice, 43, 69–81. doi: 10.1016/j.pop.2015.08.012
   PubMed Web of Science ®Google Scholar
• Simmons, J., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology. Psychological Science, 22, 1359–1366. doi: 10.1177/0956797611417632
   PubMed Web of Science ®Google Scholar
• Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014a). P-curve and effect size: Correcting for publication bias using only significant results. Perspectives on Psychological Science, 9, 666–681. doi: 10.1177/1745691614553988
   Web of Science ®Google Scholar
• Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014b). P-curve: A key to the file-drawer. Journal of Experimental Psychology: General, 143, 534–547. doi: 10.1037/a0033242
   PubMed Web of Science ®Google Scholar
• Simonsohn, U., Simmons, J. P., & Nelson, L. D. (2015). Better p-curves: Making p-curve analysis more robust to errors, fraud, and ambitious p-hacking, a reply to Ulrich and Miller (2015). Journal of Experimental Psychology: General, 144, 1146–1152. doi: 10.1037/xge0000104
   PubMed Web of Science ®Google Scholar
• Stice, E., Yokum, S., Veling, H., Kemps, E., & Lawrence, N. S. (2017). Pilot test of novel food response and attention training treatment for obesity: Brain imaging data suggest actions shape valuation. Behaviour Research and Therapy, 94, 60–70. doi: 10.1016/j.brat.2017.04.007
   PubMed Web of Science ®Google Scholar
• Szucs, D., & Ioannidis, J. P. A. (2017). Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature. PLoS Biology, 15, e2000797. doi: 10.1371/journal.pbio.2000797
   PubMed Web of Science ®Google Scholar
• †Turton, R., Nazar, B. P., Burgess, E. E., Lawrence, N. S., Cardi, V., Treasure, J., & Hirsch, C. R. (2018). To go or not to go: A proof of concept study testing food-specific inhibition training for women with eating and weight disorders. European Eating Disorders Review, 26(1), 11–21. doi: 10.1002/erv.2566
   PubMed Web of Science ®Google Scholar
• Ulrich, R., & Miller, J. (2015). p-hacking by post hoc selection with multiple opportunities: Detectability by skewness test?: Comment on Simonsohn, Nelson, and Simmons (2014). Journal of Experimental Psychology: General, 144, 1137–1145. doi: 10.1037/xge0000086
   PubMed Web of Science ®Google Scholar
• Vainik, U., Dagherm, A., Dube, L., & Fellows, L. K. (2013). Neurobehavioural correlates of body mass index and eating behaviours in adults: A systematic review. Neuroscience & Biobehavioral Reviews, 37, 279–299. doi: 10.1016/j.neubiorev.2012.11.008
   PubMed Web of Science ®Google Scholar
• **Van Koningsbruggen, G. M., Veling, H., Stroebe, W., & Aarts, H. (2014). Comparing two psychological interventions in reducing impulsive processes of eating behaviour: Effects on self-selected portion size. British Journal of Health Psychology, 19, 767–782. doi: 10.1111/bjhp.12075
   PubMed Web of Science ®Google Scholar
• **Veling, H., Aarts, H., & Papies, E. K. (2011). Using stop signals to inhibit chronic dieters’ responses toward palatable foods. Behaviour Research and Therapy, 49, 771–780. doi: 10.1016/j.brat.2011.08.005
   PubMed Web of Science ®Google Scholar
• **Veling, H., Aarts, H., & Stroebe, W. (2013). Using stop signals to reduce impulsive choices for palatable unhealthy foods. British Journal of Health Psychology, 18, 354–368. doi: 10.1111/j.2044-8287.2012.02092.x
   PubMed Web of Science ®Google Scholar
• **Veling, H., van Koningsbruggen, G. M., Aarts, H., & Stroebe, W. (2014). Targeting impulsive processes of eating behavior via the internet. Effects on body weight. Appetite, 78, 102–109. doi: 10.1016/j.appet.2014.03.014
   PubMed Web of Science ®Google Scholar
• **Werthmann, J., Field, M., Roefs, A., Nederkoorn, C., & Jansen, A. (2014). Attention bias for chocolate increases chocolate consumption – An attention bias modification study. Journal of Behavior Therapy and Experimental Psychiatry, 45, 136–143. doi: 10.1016/j.jbtep.2013.09.009
   PubMed Web of Science ®Google Scholar