Connectivity between visual and auditory cortices mediates the influence of argument strength on the effectiveness of smoking-cessation videos among smokers low in sensation seeking

Abstract

Purpose

Argument strength (AS) is a validated measure of persuasiveness that has been identified as one of the key variables determining the effectiveness of video ads. Smoking-cessation videos with high AS are more effective at reducing smoking behavior than videos with low AS. The neural processes that mediate the effects of AS on subsequent smoking have not been identified. In the present study, we tested whether the efficacy of high-AS smoking-cessation videos is determined by the level of integration of visual and auditory (ie, multisensory) processes. In addition, we tested differences in sensation seeking, which is repeatedly associated with smokers’ sensitivity to cessation interventions.

Patients and methods

Using functional magnetic resonance imaging (fMRI), we recorded the brain response of 66 smokers randomly assigned to view either 16 high-AS or 16 low-AS smoking-cessation videos. Multisensory processing was assessed by the functional connectivity between brain regions that encoded visual and auditory information in the videos. Smoking behavior was indexed by the urine level of cotinine, a nicotine metabolite, immediately before and approximately 30 days after the fMRI session.

Results

We found a significant moderated mediation effect, such that the connectivity between visual and auditory cortices mediated the effect of AS on subsequent smoking, but only for smokers lower in sensation seeking. The prediction performance of the model was confirmed by leave-one-out cross-validation.

Conclusion

Our study suggests that audiovisual integration underlies the greater efficacy of high- vs low-AS smoking-cessation videos for individuals lower in sensation seeking. High-sensation-seeking smokers may be responsive to other characteristics of smoking-cessation videos.

Keywords:

• smoking
• health communication
• functional magnetic resonance imaging
• brain connectivity
• sensation seeking

Introduction

Video ads or public service announcements have long been a key component of public health campaigns promoting smoking cessation¹ and other health behaviors.^2,3 Argument strength (AS) is a validated measure of persuasiveness that has been identified as one of the key variables determining video ads’ effectiveness.^4–6 Studies show that video messages with higher AS are more effective in changing attitudes and behaviors^6–8 and that AS has distinct neural correlates.^6,9 However, less is known about the brain mechanisms that mediate the effects of AS on behavioral outcomes.

Neuroimaging studies suggest that brain response to health messages is a useful intermediate outcome measure of the effectiveness of these messages.^6,9–13 In addition, unlike the purely visual pictorial and textual messages, videos carry both visual and auditory content that requires sustained externally paced processing over time. Therefore, effective video messaging depends on coherent integration of visual and auditory information,¹⁴ which is likely to engage multiple brain regions.^15–18 However, prior analyses have not considered this multisensory nature of videos; by focusing on a single index of sensory impact (ie, “message sensation value”),^12,13 these analyses were limited to regional neural responses without examining inter-regional connectivity.^6,10–12 This perhaps explains why previously identified neural predictors of message effectiveness (such as medial prefrontal activity) did not mediate the greater effectiveness of high-AS videos.⁶

Health communication research has provided useful tools that use content analyses to capture the multisensory nature of health promotion videos.^{6,12,13,19–21} One is “message sensation value”, a measure of sensor input that reflects the overall amount of visual and auditory features in a video.^6,12,13,19 A more recent “I-squared” (I²) measure quantitatively assesses the visual and auditory information introduced in each video.^20,21 The I² instrument contains an independent scale for visual and auditory modalities, which offers an advantage for the study of multisensory integration. Connectivity analysis is a rapidly growing area of neuroimaging research that investigates the functional interactions between brain regions.²² By examining the functional connectivity between brain regions that encode the two information modalities (ie, visual and auditory), one could obtain novel information about the multisensory encoding of videos.^17,23,24 This may unravel the neurocognitive basis of the greater effectiveness of video messages that are higher in AS. The present study examined the connectivity between visual and auditory cortices as an index of multisensory processing in smokers watching either high- or low-AS videos. Our working hypothesis was that such connectivity while viewing smoking-cessation videos would mediate the effect of AS and subsequent change in smoking behavior.

Audience characteristics are another important factor that contributes to the outcomes of smoking-cessation messaging that have not been taken into account in previous research of neural correlates of AS.⁶ Studies indicate that sensation seeking may be a key characteristic modulating individuals’ ability to change their behavior in response to health messages. Individuals that are high in sensation seeking tend to be more impulsive in the pursuit of rewarding experiences than low sensation seekers,^25–28 resulting in greater difficulty in resisting a rewarding behavior, such as smoking.^29–31 Therefore, it is possible that even when health messages are processed equally at the sensory level by high and low sensation seekers, those lower in sensation seeking benefit more readily from the high-AS video messages.

Using functional magnetic resonance imaging (fMRI), our previous study showed that smokers’ neural and behavioral responses to AS are modulated by the sensory impact (ie, “Message Sensation Value”) of smoking-cessation videos.⁶ In the present study, we conducted further analysis of these data by accounting for multisensory processing and sensation seeking. We aimed at identifying the neurocognitive mechanism that underlies the greater effectiveness of high-AS vs low-AS smoking-cessation video messages, and their potential interaction with sensation seeking. We examined the connectivity between the cortices that process visual and auditory information as a measure of multisensory integration. Smoking was assessed by the level of cotinine, a nicotine metabolite, in the urine, which is considered a reliable marker of actual smoking behavior.^6,32–35 We hypothesized that 1) smoking-cessation videos with higher AS would produce greater brain connectivity between visual and auditory cortices, and that 2) greater connectivity would predict less smoking among the low-sensation-seeking smokers. We sought to test these hypotheses by examining the moderated mediation model where AS and future smoking behavior were the independent and outcome variables, respectively, and the connectivity between the visual and auditory cortices and sensation seeking were the mediator and moderator, respectively.^36–39 Finally, we explored the predictive power of the model by testing how well subsequent smoking behavior was predicted by AS, sensation seeking, and brain connectivity using leave-one-out cross-validation.

Materials and methods

Participants

Seventy-four non-treatment-seeking adult smokers participated in the previously described study.⁶ Eight participants were excluded due to excessive (>1 voxel) head motion during the MRI scan, leaving 66 participants (32 female; 5 left-handed) who passed MRI quality control for the final analysis. Participants reported their racial-ethnic characteristics as follows: 38 White, 22 African American, 4 Asian, and 2 Hispanic. Their ages ranged from 18 to 49 years (mean±SE=30.58±1.19), with 14.13±0.23 years of education. All participants gave written informed consent to participate in the protocol approved by the University of Pennsylvania Institutional Review Board. This study was conducted in accordance with the Declaration of Helsinki. Exclusion criteria were 1) presence of DSM-IV-TR Axis 1 psychiatric disorder,⁴⁰ except for nicotine/tobacco use disorder; 2) urine drug screen positive for illicit opioids, benzodiazepines, cannabinoids, cocaine, or methamphetamine; 3) baseline urinary cotinine levels<50 ng/mL;⁴¹ 4) presence of medical or neurological disorder or treatment that may affect the cerebrovascular system; and 5) safety-related contraindications for MRI scanning.

Materials and design

One hundred ninety-nine 30-s long smoking-cessation videos targeting adult smokers were obtained from the collection of the Annenberg School of Communication.^4–6,21

For each video, visual and auditory stimulation were quantified using the I² instrument.^20,21 For the visual I², two trained coders viewed each video and located where camera changes occurred or visual structural features (eg, a video graphic) were introduced in a way that mimicked camera changes. For each camera change/structural feature, coders considered the amount of new visual information according to seven visual characteristics: change in emotionally arousing images, novel focal point of the scene, unrelatedness to the previous scene, new object, closer distance, different perspective, and form change. A camera change/structural feature could have a score ranging from 0 to 7. For each video, the scores were summed across all camera changes/structural features, resulting in a total visual I² score for that video. Similarly, for the auditory I², two trained coders located where auditory structural features (eg, voice change, music onset) were introduced in each video. For each structural feature, the coders considered the presence of five auditory characteristics: new sound or silence, unrelatedness to the previous scene, voice change, emotional sound, and emotion change. The total score across all auditory structural features resulted in the auditory I² for each video. Prior research showed high inter-coder reliability on the visual I² (Krippendorff’s α=0.94) and auditory I² (Kendall’s τ=0.76) scores.²¹

AS determination followed the procedure previously reported and utilized by previous studies.^4–6 Briefly, two trained coders viewed the videos, transcribed the verbal arguments, and extracted the main arguments of each video. These arguments were then reviewed by two different coders who edited the text to capture all the content of the videos stated explicitly via voice and text on screen and implicitly through the visuals. The arguments extracted from each video were assessed for perceived AS in a survey of 387 current smokers, who were asked to rate the arguments from eight to twelve videos using an 11-item questionnaire (eg, “the statement is a reason for quitting smoking that is convincing”; 5-point scale, 1=strongly disagree, 5=strongly agree). A balanced design was used so that each video was rated by an average of 38 smokers. The means of the 38 raters for each argument were converted to z scores, and then those scores were summed across arguments for each video to produce an overall z score for each video.^4–6

From the available 199 videos, we selected 32 videos whose AS scores fell in the top or bottom quartiles, yielding 16 high-AS and 16 low-AS videos.⁶ The high-AS and low-AS videos did not differ in visual I² (38.88±5.40 vs 30.25±5.84, t(30)=−1.08, p=0.29) or auditory I² (7.69±1.09 vs 8.56±1.19, t(30)=0.54, p=0.59). Participants were randomly assigned to either the high-AS condition (N=34) or the low-AS condition (N=32).

fMRI task

Participants underwent fMRI while watching either the 16 high-AS smoking-cessation videos or the 16 low-AS ones. For each participant, the videos were presented in a random order. Each video was preceded and followed by a 16-second rest period (grey crosshair on a homogenous black background). Each video was 30-s long and was presented only once.

Behavioral assessments

Sensation seeking was assessed using the Brief Sensation Seeking Scale (BSSS).⁴² It is an eight-item, self-report measure, in which respondents rate their agreement to each item on a 4-point scale (1=disagree strongly, 4=agree strongly). Higher scores indicate higher levels of sensation seeking. Participants’ severity of nicotine dependence was assessed by the Fagerstrom Test of Nicotine Dependence (FTND).⁴³ This is a six-item, self-report measure with a range of 0–10, with higher scores reflecting greater nicotine dependence. Both BSSS and FTND have shown good test–retest reliability.^42,44 Urine cotinine levels were measured using the HPLC tandem mass spectrometry system (Agilent Technologies) with a limit of detection of 2 ng/mL.^6,41

Procedure

The study was comprised of phone screening, baseline assessment, a video+fMRI session, and a follow-up session 1 month later. At the baseline session, participants were evaluated for eligibility, demographics, and handedness.⁴⁵ One hour before the fMRI session, participants provided urine samples for baseline cotinine levels, reported the average number of cigarettes smoked per day in the past 30 days (CPD), and completed the BSSS and FTND. After assessments and 30–45 mins before the beginning of the fMRI session, participants were given an opportunity to smoke one of their own cigarettes outdoors under observation. All participants took the opportunity to smoke. Before the video task began, participants were instructed to attend to the videos. At the follow-up session approximately 30 days later (mean±SE=33.06±1.81 d), the CPD and FTND scores were recorded, the video engagement test was completed, and the repeat urine samples for cotinine levels were obtained. Of the 66 participants who completed the fMRI session, all completed the baseline FTND and CPD, 65 completed the BSSS, 62 completed the baseline assessment of urine cotinine, 50 completed the follow-up CPD, 56 completed the follow-up FTND, and 51 completed the follow-up assessment of urine cotinine.

fMRI data acquisition and processing

MRI imaging was performed using Siemens Tim Trio 3T (Erlangen) system and a 32-channel receive-only head coil. Blood oxygenation level-dependent (BOLD) fMRI was performed, using a whole-brain, single-shot gradient-echo echo-planar sequence with the following parameters: TR/TE=2000/30 ms, FOV=220 mm, matrix=64×64, slice thickness/gap=3.4/0 mm, 32 slices, effective voxel resolution of 3.4×3.4×3.4 mm³. fMRI is a non-invasive technique that has been widely used to investigate brain function. By measuring changes in the blood oxygenation level in the brain, BOLD fMRI allows detection of regional hemodynamic responses as a result of neural activities.⁴⁶ After BOLD fMRI, 5 mins MPRAGE T1-weighted images were acquired as high-resolution structural/anatomical images with the following parameters: TR/TE=1630/3.87 ms, FOV=250 mm, matrix=256×192, effective voxel resolution of 1×1×1 mm³. An oblique acquisition, oriented along the anterior commissure–posterior commissure line allowed coverage of the entire brain with the exception of the lower cerebellum.

Imaging data were analyzed using SPM 12 (Wellcome Trust Centre for Neuroimaging, London, UK) following the guidelines by Friston et al (2007).⁴⁷ The functional images were adjusted for slice timing and realigned to the first scan to correct for head motion. The structural images were coregistered to the functional images so that they are geometrically aligned to each other in the same coordinate system. The structural images were normalized into stereotactic Montreal Neurological Institutespace with 3-mm cubic voxels, and the resulting normalization parameters were then used to normalize the functional images. Lastly, the normalized functional images were spatially smoothed by a Gaussian filter with full-width/half-maximum parameter set to 8 mm. Subject-level statistical analyses were performed voxelwise by modeling the videos using a canonical hemodynamic response function. Furthermore, the model included the normalized visual and auditory I² scores in order to test the parametric modulation of visual information and auditory information. There was no correlation between visual and auditory I² scores (r=−0.10, p=0.58), indicating that the analysis did not suffer from multicollinearity. Six rigid body motion parameters were included as covariates, and the rest periods were treated as an implicit baseline. Significant activation at the group-level was identified at p<0.05 corrected for familywise error and cluster size k>50 contingent voxels. One-sample t-tests across all participants were used to identify the visual and auditory cortices that responded to visual and auditory information by the contrast of visual vs auditory parametric modulation and vice versa. Independent-sample t-tests examined the differences between high-AS and low-AS participants in the neural response at the visual and auditory cortices.

Regions of interest (ROIs) were defined as spheres centered at the peak voxels of activation from the one-sample t-tests with a radius of 5 mm using MarsBaR (http://marsbar.sourceforge.net). Specifically, the visual and auditory cortices were defined based on the parametric effects of visual and auditory I² scores, respectively. The time series of the BOLD signal at the ROIs were extracted and high-pass filtered, and the effect of head motion was removed by regressing out the six motion parameters from the signal. The connectivity between the visual and auditory cortices was calculated as the Fisher-transformed correlation coefficient between the time series of the corresponding ROIs.

To test the specificity of the connectivity between visual and auditory cortices, we also examined the connectivity of a number of control ROIs defined by term-based meta-analysis in the Neurosynth database (neurosynth.org). These control ROIs (and their associated terms and coordinates) include the dorsal anterior cingulate cortex (term=“attention”, x/y/z=6/16/42), bilateral dorsolateral prefrontal cortex (term=“attention”, x/y/z=−28/0/52 & 28/-2/54), bilateral inferior parietal lobule (term=“attention”, x/y/z=−26/-50/52 & 26/-56/52), ventromedial prefrontal cortex (term=“default mode”, x/y/z=−2/50/-6), precuneus (term=“default mode”, x/y/z=2/-54/26), bilateral angular gyrus (term=“default mode”, x/y/z=−46/-70/32 & 50/-62/32), bilateral amygdala (term=“emotion”, x/y/z=−20/-4/-16 & 24/-4/-16), bilateral postcentral gyrus (term=“somatosensory”, x/y/z=−56/-20/20 & 56/-18/38), bilateral insula (term=“somatosensory”, x/y/z=−36/-12/8 & 42/-16/14), paracentral lobule (term=“somatosensory”, x/y/z=−10/-34/60), mid-cingulate cortex (term=“somatosensory”, x/y/z=−2/4/38), supplementary motor area (term=“somatosensory”, x/y/z=−2/-8/54), bilateral thalamus (term=“somatosensory”, x/y/z=−12/-16/4 & 14/-18/10), bilateral hippocampus (term=“episodic memory”, x/y/z=−26/-16/-20 & 32/-14/-16), and bilateral parahippocampal gyrus (term=“episodic memory”, x/y/z=−22/-30/-14 & 22/-24/-20).

Moderated mediation analysis

Moderated mediation analysis tests the extent to which the moderator influences the effect of the independent variable on the outcome variable through the mediator.^36–38 We conducted this analysis using a bootstrapping procedure implemented in the PROCESS macro for SPSS 22 (http://www.processmacro.org).^38,39 We tested the role of visual and auditory cortical connectivity as a mediator between AS condition (high vs low) and follow-up cotinine levels (adjusted for baseline levels), moderated by participants’ levels of sensation seeking. Before analysis, follow-up cotinine levels were adjusted for the baseline levels. High-AS and low-AS groups were coded as 1 and −1, respectively. The index of moderated mediation was computed to test for the significance of moderated mediation effects based on a bias-corrected bootstrap approximation with 5000 iterations. To visualize the moderating effect of sensation seeking, the association between brain connectivity and follow-up cotinine levels was plotted separately for smokers in the higher quartile of sensation seeking and those in the lower quartile. We also tested the significance of the direct effect of AS on cotinine levels that did not go through the mediator, in order to determine whether brain connectivity fully or partially mediated AS’s effect on cotinine levels. Lastly, we examined the contribution of brain connectivity to the prediction of follow-up cotinine levels by comparing the moderated mediation model to a reduced model with only AS and sensation seeking as predictors.

Prediction analysis

We used the leave-one-out cross-validation analysis to test the predictive power of the moderated mediation model on follow-up cotinine levels (adjusted for baseline). We performed a regression analysis on all but one participant, with cotinine levels as the dependent variable and with independent variables of AS, visual-auditory cortical connectivity, sensation seeking, and the interaction between connectivity and sensation seeking. The parameter estimates obtained from the regression model were then applied to the omitted participant, yielding a predicted value of his/her cotinine level. After repeating this procedure in every participant, the inaccuracy of prediction was estimated by the mean squared error (MSE), that is, MSE=[∑_i(Ŷ_–i–Y_i)²]/N, where N is the number of participants, Y_i is the actual cotinine level for the i-th participant, and Ŷ_–i is the predicted cotinine level for the i-th participant based on the regression model with all but the i-th participant. The significance of MSE was determined by a permutation test.⁴⁸ For each of the 5,000 permutations, a random MSE (ie, MSE_null) was calculated after permuting the cotinine levels while leaving the independent variables fixed. This yielded an empirical distribution of prediction inaccuracy under the null hypothesis that the cotinine levels could not be predicted by AS, visual-auditory cortical connectivity, sensation seeking, or the interaction between connectivity and sensation seeking. The significance of the original MSE was then calculated as Prob(MSE≥MSE_null).

Results

Demographic and behavioral variables

Participants’ baseline and follow-up demographic and behavioral measures are summarized in Table 1. The high-AS and low-AS groups did not differ on any of these measures (ps>0.17), except that the high-AS group’s follow-up cotinine levels were significantly lower than the low-AS group after controlling for baseline cotinine levels (F(1,46)=6.01, p<0.02).

Table 1 Summary of behavioral measures (N or mean±SE)

	High-AS group	Low-AS group
Baseline
Gender	18 male, 16 female	16 male, 16 female
Race	21 Cau, 8 AA, 3 Asian, 2 Hisp	17 Cau, 14 AA, 1 Asian
Age (years)	29.68±1.54	31.53±1.83
Education (years)	14.09±0.31	14.17±0.35
BSSS	2.89±0.10	2.84±0.11
FTND	4.38±0.40	4.56±0.43
Cigarettes per day	14.59±1.23	15.06±1.28
Cotinine (ng/mL)	1451.47±388.81	1524.70±225.20
Follow-up
FTND	4.23±0.45	4.23±0.54
Cigarettes per day	13.93±1.19	15.00±1.74
Cotinine (ng/mL)	1142.80±205.02	1770.95±297.88

Abbreviations: AS, argument strength; BSSS, Brief Sensation Seeking Scale; FTND, Fagerstrom Test of Nicotine Dependence; Cau, Caucasian; AA, African American; Hisp, Hispanic.

fMRI results

The amount of visual information in the smoking-cessation videos, as indicated by the visual I² scores, was positively associated with the neural response in the occipital cortex (k=5539, Z=8.33, x/y/z=27/-67/-10) (Figure 1, regions in red-yellow). The amount of auditory information, as indicated by the auditory I² scores, was positively associated with neural response in the bilateral posterior superior temporal cortex (left: k=909, Z=7.82, x/y/z=−57/-22/-1; right: k=808, Z=7.46, x/y/z=60/-10/-1) as well as the right parietal cortex (k=56, Z=6.04, x/y/z=51/-61/47) and the thalamus (k=78, Z=5.82, x/y/z=−6/-4/8) (Figure 1, regions in blue-green). The activity in these regions did not differ between high-AS and low-AS groups. There was a positive connectivity between the visual and auditory cortices (mean±SE=0.62±0.03, t(65)=23.60, p<0.0001), which was significantly greater in the high-AS group compared to the low-AS group (0.73±0.03 vs 0.50±0.03, t(64)=5.13, p<0.00001). The connectivity among the control ROIs as well as their connectivity with the visual and auditory cortices did not differ between the high-AS and low-AS groups (t(64)=−1.94–1.59, ps>0.05).

Figure 1 Brain responses associated with the visual and auditory I² scores (p<0.05 corrected for familywise error).

Moderated mediation analysis

To test our hypotheses, we ran a mediated moderation model such that visual-auditory cortical connectivity mediated the effect of AS on the follow-up cotinine levels (adjusted for baseline), and that the mediation was further moderated by sensation seeking (Figure 2, upper panel). Table 2 shows that sensation seeking significantly moderated the indirect effect of AS on the follow-up cotinine levels through brain connectivity (index of moderated mediation=40.52, SE=18.45, p=0.01). Lower sensation seeking was associated with greater mediation effect. The moderated mediation effect was not significant for the connectivity among the control ROIs as well as their connectivity with the visual and auditory cortices (ps>0.05).

Figure 2 Upper panel: the moderated mediation model with sensation seeking moderating the indirect effect of argument strength on cotinine levels through visual-auditory cortical connectivity. Lower left panel: smokers who watched the high-argument strength (AS) videos showed greater connectivity between the visual and auditory cortices than those who watched the low-AS ones. Lower right panel: greater visual-auditory cortical connectivity (x-axis) was associated with reduced cotinine levels (y-axis) among smokers in the lower quartile but not higher quartile of sensation seeking.

Table 2 Results of the moderated mediation model

Model 1 (Outcome: Visual-auditory cortical connectivity)
Predictor	B	SE	t(47)	p
Argument strength	0.10	0.03	3.65	0.0007
R²=0.22, F(1,47)=13.34, p=0.0007
Model 2 (Outcome: Follow-up cotinine levels, adjusted for baseline)
Predictors	B	SE	t(44)	p
Argument strength	-202.20	116.42	-1.74	0.09
Visual-auditory cortical connectivity	-438.29	544.15	-0.81	0.42
Sensation seeking	-39.98	23.59	-1.69	0.10
Connectivity × Sensation seeking	401.03	107.12	3.74	0.0005
R²=0.44, F(4,44)=8.78, p=0.00003
Conditional indirect effect
Sensation seeking levels	Boot. B	Boot. SE	95% Boot. CI
Lower quartile	-158.39	83.28	[-369.36, -25.01]
Higher quartile	44.19	44.63	[-25.13, 162.58]

Abbreviation: Boot., bootstrapping with 5,000 iterations.

Estimations of individual paths are shown in Table 2. Consistent with our first hypothesis, high-AS smoking-cessation videos produced greater connectivity between the visual and auditory cortices than the low-AS videos (Figure 2, lower left panel). Consistent with our second hypothesis, the association between brain connectivity and follow-up cotinine levels (adjusted for baseline) was moderated by sensation seeking, such that greater connectivity predicted less smoking only among low-sensation-seeking smokers (Figure 2, lower right panel). We confirmed our previous report⁶ by showing a significant total effect of AS on cotinine, but the direct effect was not significant, suggesting a full mediation effect.

Compared to the model with only AS and sensation seeking as predictors, the addition of brain connectivity and its interaction with sensation seeking led to a significantly improved model fit (ΔR²=0.18, F(2, 44)=7.29, p=0.002).

Prediction analysis

Leave-one-out cross-validation (p<0.0002; Figure 3) confirmed the predictive power of the above moderated mediation model – that is, the follow-up cotinine levels could be predicted sufficiently well by the moderated mediation model.

Figure 3 Leave-one-out cross-validation showing that the moderated mediation model was predictive of follow-up cotinine levels with significantly smaller prediction error (ie, MSE) as compared to the null distribution of prediction error (MSE_null) obtained through 5,000 permutations. Green solid line: actual MSE value produced by the original data. Red dashed line: 5th percentile of the empirical MSE_null produced by permutation.

Abbreviation: MSE, mean squared error of prediction.

Discussion

We showed that high-AS smoking-cessation videos induced greater connectivity between the occipital and bilateral posterior temporal cortices. These regions are involved in the encoding of visual and auditory information, respectively. The findings extend our previous study⁶ which showed that videos with higher AS are more effective in changing smokers’ subsequent smoking behavior. The connectivity between the visual and auditory cortices in turn showed a negative association with future smoking behavior in smokers low in sensation seeking. Such association was not found for the connectivity of brain regions underlying attention, default mode, emotion, somatosensory processing, or episodic memory. These findings provide experimental support to the hypotheses that multisensory brain connectivity mediates the behavioral effectiveness of high-AS smoking-cessation videos, but that the strength of the mediation depends on the individual’s level of sensation seeking.

Our study is the first to show that the visual and auditory components of the I² measure are linked to the neural activity and the visual and auditory cortices, respectively, during viewing of videos. The visual and auditory cortices are connected both anatomically⁴⁹ and functionally.²³ The activity in the auditory cortex is modulated by visual input,⁵⁰ and the visual cortical activity can in turn be modulated by auditory input.²⁴ Such neural connectivity has been shown to underlie concurrent processing of visual and auditory information.^15–17,51 The connectivity is further modulated by factors such as the synchrony between the visual and auditory input^16,17 and one’s familiarity with the multimodal stimuli.⁵² Our findings extend prior knowledge by showing that smoking-cessation videos with higher AS induced greater occipitotemporal connectivity, suggesting that such connectivity is a marker of the persuasiveness of complex sensory stimuli.

Results of prior studies of the link between sensory processing and outcomes of public health video messages have been inconsistent. For example, neural activity at the sensory cortices in response to safe-sex videos was negatively correlated with change in attitudes toward condom use,¹³ while the association between activity in these regions in response to smoking-cessation videos and reduction in smoking was positive.⁵³ One potential source of this apparent discrepancy may be variability in the ads’ AS.⁶ The present study showed that connectivity mediated the effect of AS on the low-sensation-seeking smokers’ subsequent smoking behavior. This suggests that the connectivity between the visual and auditory cortices may better reflect the effectiveness of video messages than the independent measures of visual and auditory cortical activity. Integration of multimodal information may be an intermediate mechanism underlying effective processing of persuasive video messages.

The role sensation seeking plays in various substance use disorders including smoking is well established.^30,31,54,55 However, data on the relationship between sensation seeking and reducing or quitting smoking is inconclusive – some studies show that high-sensation-seeking smokers are less compliant with cessation treatment⁵⁶ and less likely to quit smoking,^57,58 whereas other studies have found no association between sensation seeking and readiness to change smoking behavior⁵⁹ or quit attempts.⁶⁰ Our findings suggest an alternative explanation for this inconsistency by showing that although both high- and low-sensation seeking smokers may respond to smoking-cessation videos, low-sensation-seeking smokers are more readily influenced by the integration of visual and auditory information in high-AS videos. Smokers higher in sensation seeking appeared to exhibit a trend for lower levels of cotinine at follow-up, regardless of visual-auditory integration. According to the moderated mediation model, the inability of high-sensation seeking smokers to benefit from high-AS videos is unlikely to be due to poor processing of the videos, given similar multisensory processing between high and low sensation seekers. Thus, they may have responded to other characteristics of the videos, with brain activity that was not related to the connectivity between visual and auditory cortices. We believe that an important next step is to explore how anti-smoking communication (as well as other public health messaging) helps high sensation seekers improve their control over reward-pursuing behaviors.

Our findings may have implications on health behavior management from two perspectives. First, they point to greater integration of visual and auditory information as an independent measure of effectiveness of a video. Such measure could be used to evaluate future public health video ads. Future design of health promotion video ads should not only focus on the level of visual and auditory stimulation, but also the coherence of the two modalities. Second, we proposed a moderated mediation model that could predict future health behavior using baseline variables including sensation seeking, brain connectivity, and AS of videos. Specifically, the addition of brain connectivity to the model significantly improved the prediction. Although fMRI is not practical in some research sttings, our findings can be applied to techniques that are more accessible, especially the electroencephalogram and the functional near-infrared spectroscopy, which could be used to assess brain connectivity. Successful prediction of future behavior change will allow early identification of individuals that are less likely to benefit from health communications and may thus require additional interventions.

The present study comes with a number of limitations. First, we did not test whether the association between AS and audiovisual integration is specific to smokers and smoking-cessation videos. Although the potential implications for health communications do not depend on such specificity, it would be interesting for future studies to investigate whether our findings extend to health promotion videos on other public health issues. Second, although we showed that watching high-AS videos induced greater visual-auditory cortical connectivity, it remains to be determined whether such connectivity is associated with greater effectiveness of video stimuli. It is possible that increasing the connectivity could improve the comprehension of the messages. It would also be important to examine whether viewers with greater connectivity will find the videos more persuasive. Third, it is unclear how long the moderated mediation effect would last beyond the 1-month follow-up. Future longitudinal research could address this question by having a longer follow-up and by testing the outcome of repeated exposure to the messages. Fourth, research with adolescents suggests that it is the overlap between measured sensation seeking and impulsivity, but not the attraction to exciting sensation, that underlies the persistence of smoking and use of other drugs.^61,62 Future studies should examine to what extent the effects of sensation seeking are attributable to impulsivity. Fifth, we observed that the visual I² scores were positively associated with the neural activity of a substantial area of the visual cortex that likely spanned the extrastriate visual cortical areas (including V2, V3, V4, and V5), but not the primary visual cortex V1. This is consistent with the nature of visual I² which mainly indexes the amount of complex visual information such as camera change, new objects and novel focal point of the scene, instead of low-level properties of visual stimulation such as brightness and smoothness. It is possible different subregions of the visual cortex were engaged in different aspects of visual processing during our task. However, given the complexity of our video stimuli, we were not able to achieve a fine-grained mapping of visual processing onto the brain. We hope that future research will address this issue by using more advanced analytical techniques. Lastly, although we only focused on the sensory cortices, many other brain regions are also involved in the processing of the smoking-cessation videos.⁶ One of the most important regions is the medial prefrontal cortex, whose response to health messages has been shown to predict future health behavior change.^6,10,11 Likewise, besides sensation seeking, responsiveness to smoking-cessation interventions may also depend on other factors ranging from biological, such as nicotine metabolic rate,^63,64 to socio-psychological, such as susceptibility to peer influence.^65,66 A replication in a larger sample, and with a wider range of biological and behavioral variables, could provide a better understanding of how different factors, including the activity and connectivity of other brain regions, interact to mediate and influence the efficacy of anti-smoking as well as other types of health messaging.

Conclusions

Our findings highlight the importance of multisensory integration in the processing of smoking-cessation videos by showing that the connectivity between visual and auditory cortices mediated the greater efficacy of high- vs low-AS videos for smokers with lower levels of sensation seeking. These findings may help to inform future efforts to refine health communication strategies so that smokers with different levels of sensation seeking and related traits will be more able to reduce and eventually quit smoking.

Acknowledgments

The study was supported by the Annenberg Public Policy Center of the University of Pennsylvania and by grants from the National Institutes of Health (DA036028, DA028874, and HD084746).

Disclosure

The authors report no conflicts of interest in this work.