15,636
Views
152
CrossRef citations to date
0
Altmetric
Original Articles

Integrated Reporting and Assurance of Sustainability Information: An Experimental Study on Professional Investors’ Information Processing

, &
Pages 559-581 | Received 02 Dec 2015, Accepted 04 Dec 2016, Published online: 12 Jan 2017

Abstract

Sustainability-related non-financial information is increasingly deemed value relevant. Against this background, two recent trends in non-financial reporting are frequently discussed: integrated reporting and assurance of sustainability information. Using an established framework of information acquisition, evaluation, and weighting, this experimental study investigated how the choice of reporting format interacts with the voluntary assurance of sustainability information. The results from a sample of professional investors underline the important role of assurance in the context of voluntary disclosure and illustrate the relevant interaction with the reporting format. Assurance of sustainability information positively affected professional investors’ evaluation of a firm’s sustainability performance, resulted in a higher weighting of this information, and led to higher investment-related judgments. However, this assurance effect was weaker in the case of integrated reporting compared to separate reporting. We attribute this effect to a cognitive bias in decision-making when assured financial performance and non-assured sustainability performance are presented in the same report.

Introduction

In recent years, it has become increasingly common for companies to disclose information about their non-financial performance and engage in sustainability reporting alongside traditional financial reporting.Footnote1 Investors are the key addressees of such reporting, and there is initial evidence that they consider non-financial information value relevant (e.g. Berthelot, Coulmont, & Serret, Citation2012; Dhaliwal, Radhakrishnan, Tsang, & Yang, Citation2012). Nevertheless, how professional investors process sustainability information and what influences this process are questions that have received little attention (a notable exception is the work of Holm & Rikhardsson, Citation2008). In this context, two specific aspects of reporting currently receive specific attention from researchers and corporate practice: the integration of sustainability information with financial information (i.e. integrated reporting) and voluntary external assurance of sustainability information (see Erkens, Paugam, & Stolowy, Citation2015, for an overview of recent literature). The present study examines how these two prominent features of firms’ sustainability disclosure interact and influence professional investors’ information processing.

First, integrated reporting aims at overcoming the previously dominant separation of financial information from sustainability information by the publication of a single integrated report (IIRC, Citation2013; Jensen & Berg, Citation2012; Lozano & Huisingh, Citation2011). The International Integrated Reporting Council (IIRC) argues that the integration of financial and sustainability information will better satisfy investors’ information needs by providing a more holistic picture of a company and its performance. The IIRC defines an integrated report as one that ‘brings together material information about an organization’s strategy, governance, performance and prospects in a way that reflects the commercial, social and environmental context within which it operates’ (Citation2013, p. 3). Merging sustainability and financial information into a single document might overcome a potential disconnect in professional investors’ processing of the two types of information (Arnold, Bassen, & Frank, Citation2012) by initiating ‘integrated thinking’ as advocated by the IIRC (Citation2013, p. 2). Therefore, in this study, we seek to shed light on professional investors’ processing of corporate sustainability information in integrated and separate reporting formats.

Second, external assurance of sustainability information is supposed to improve its credibility (Kolk & Perego, Citation2010; O’Dwyer, Citation2011). Previous studies provide evidence of the positive effects of external assurance on the perceived credibility of sustainability information (e.g. Brown-Liburd & Zamora, Citation2015; Pflugrath, Roebuck, & Simnett, Citation2011). However, the combination of integrated reporting with the assurance of sustainability-related information is uncharted territory in corporate practice and scholarly research. Not only is there little practical guidance for assurance engagements in integrated reporting (Cohen & Simnett, Citation2015) but also, to the best of our knowledge, no studies have addressed potential interaction effects. This is a relevant shortcoming because the choice of reporting format cannot be separated from managerial decisions to acquire assurance services since we look at a constellation of mandatory assurance of financial information and voluntary assurance of non-financial information. This specific setting might cause a decision-making bias emanating from the assured financial information in the integrated reporting format, thus influencing the overall perception of the disclosed information. Therefore, analyzing the interaction of reporting format and assurance is important and is at the center of this study.

Using an experimental 2 × 2 full-factorial, between-subjects design, and drawing on the basic Maines and McDaniel (Citation2000) model and more recent advancements (e.g. Hodge, Hopkins, & Wood, Citation2010; Lachmann, Stefani, & Wöhrmann, Citation2015), this study investigates investors’ sustainability information processing based on different presentation formats (i.e. integrated and separate reports), which differ in the provision of external assurance (i.e. assured and non-assured sustainability information). In doing so, this study contributes to the literature on non-financial reporting in the following ways. First, we extend prior research on the issues of integrated reporting and external assurance of sustainability information, by specifically examining potential interaction effects. Second, the extant literature comprises few studies that explicitly consider sustainability information in investors’ decision-making process (e.g. Arnold et al., Citation2012; Dhaliwal, Li, Tsang, & Yang, Citation2011). Third, to the best of the authors’ knowledge, this is the first study to examine professional investors’ processing of sustainability information.

Our findings indicate that although combining sustainability and financial information in a single report increases potential access to sustainability information, the format does not aid improved acquisition of sustainability information. However, the choice of reporting format interacts with voluntary assurance of sustainability information. In the case of non-assured sustainability information, integrated reporting positively affected professional investors’ evaluation of a firm’s sustainability performance, resulted in a higher weighting of this information, and led to higher investment-related judgments. We attribute this finding to a halo effect emanating from the (mandatory) assurance of financial information in the integrated reporting format. This finding further contributes to experimental literature on integrated reporting, which had emphasized only the potential debiasing effects of this reporting format (e.g. Arnold et al., Citation2012).

The remainder of this paper is structured as follows. The next section provides background information on the assurance of sustainability-related information and integrated reporting. We then formulate hypotheses about investors’ processing of sustainability information, before we explain the experimental design. We then present the results of our analysis. In the final section, we discuss our findings, as well as the limitations of our approach and potential avenues for future research.

Integrated Reporting and Assurance in Peer-reviewed Literature

The integration of financial and sustainability information is a fairly new phenomenon in the overall development of sustainability-related disclosure (Fifka, Citation2013; Hahn & Kühnen, Citation2013). Earlier literature began by describing the connection of financial with non-financial information and proponents of integrated reporting often call for a more holistic view on companies (e.g. Yongvanich & Guthrie, Citation2006). In this regard, terms such as ‘triple-bottom-line reporting’ arose in order to describe such an integrated perspective (Archel, Fernández, & Larrinaga, Citation2008; Kent & Monem, Citation2008; Skouloudis, Evangelinos, & Kourmousis, Citation2010).

Determinants of integrated reporting seemed to be one of the first areas of interest in scholarly research. From a micro-perspective, studies indicate that firm size, growth opportunities, profitability, gender diversity on the board, or the assurance of non-financial reports positively correlate with the adoption of integrated reporting (Frías-Aceituno, Rodríguez-Ariza, & García-Sánchez, Citation2013b, Citation2014; Sierra-García, Zorio-Grima, & García-Benau, Citation2015). From a macro perspective, several country-level determinants, such the legal system, value system, and the intensity of market coordination, have been considered as potential determinants (Frías-Aceituno, Rodríguez-Ariza, & García-Sánchez, Citation2013a; García-Sánchez, Rodríguez-Ariza, & Frías-Aceituno, Citation2013; Jensen & Berg, Citation2012).

However, the impact and validity of the proposed benefits of integrated reporting remain ambiguous, and only a few studies have hitherto attempted to assess the costs and benefits of integrated reporting. Azam, Warraich, and Awan (Citation2011) described how integrating financial and non-financial information could improve, for example, stakeholder trust, reputation, and customer loyalty. More specifically, Serafeim (Citation2015) concluded that firms adopting integrated reporting are associated with more long-term-oriented and fewer transient investors. Similarly, Churet and Eccles (Citation2014) described the positive effect of integrated reporting on the effectiveness of sustainability management, thus creating long-term firm value. In contrast, Maniora (Citation2015) indicated that companies do not benefit in terms of economic and sustainability performance by switching from stand-alone non-financial reports to integrated reports. In summary, the few studies on the effects of integrated reporting have yielded heterogeneous results.

Further research may reinforce one of these positions. Recently, however, Brown and Dillard (Citation2014) argued that integrated reporting follows an ideologically closed approach, which hinders critical reflection. This argument is supported by Flower (Citation2015), who furthermore pointed to weaknesses in the framework of the IIRC, such as unregulated content and the exclusion of sustainability issues. Thus, research needs to clarify ‘the impact of integrated reporting on decision making outcomes [as well as] analyst responses to integrated reports’ (Adams, Citation2015, p. 27) in order to fully understand the influence integrated reporting will have on companies, investors, and potential other stakeholders.

As for the use of integrated reports, several questions have been posed about the reliability of the reported information (Eccles & Saltzman, Citation2011). With respect to investors’ judgment and decision-making process, research shows that only credible information is accounted for in investment-related judgments (Healy & Palepu, Citation2001). In general, it may be assumed that external assurance of sustainability-related information influences perceived credibility. Using external assurance, companies seek to reduce information asymmetries and agency costs and increase the credibility of sustainability-related information, which can, for example, lead to lower equity capital costs (Dhaliwal et al., Citation2011; for an overview, see Huang & Watson, Citation2015). However, third-party assurance of non-financial information is still voluntary. In respect of non-financial information in integrated reporting, Eccles and Saltzman (Citation2011) observed that, ‘even when assurance is provided, it is not done with the same degree of rigor as the audit of a financial report’ (p. 59). In this regard, scholars question whether assurance statements on sustainability information should also be integrated with financial statement audits and how the integrated presentation of financial and sustainability information affects the use of such information (Ballou, Casey, Grenier, & Heitger, Citation2012).

Finally, there is a growing body of experimental research on aspects of non-financial reporting that tackles the different aspects of individual decision-making inspiring the present study. Ghosh and Wu (Citation2012) confirmed in their experiment that both financial and non-financial information are generally used by analysts when making financial judgements (a similar finding was reported by Alwert, Bornemann, & Will, Citation2009). Further experiments indicate that the use and impact of sustainability-related information can vary according to cross-national determinants (van der Laan Smith, Adhikari, Tondkar, & Andrews, Citation2010), the qualitative and quantitative nature of the given information (Rikhardsson & Holm, Citation2008), the disclosing entity (Reimsbach & Hahn, Citation2015), or the type of media used (Cho, Phillips, Hageman, & Patten, Citation2009). With regard to our specific research questions, prior experimental findings on the effects of integrating financial and sustainability information and on the effects of assuring sustainability information are most interesting. Several experimental studies consistently found a positive effect of sustainability assurance on the perceived reliability of the respective information for report users (Brown-Liburd & Zamora, Citation2015; Hodge, Subramaniam, & Stewart, Citation2009; Pflugrath et al., Citation2011). This effect, however, seems to be context-specific and more pronounced when sustainability-related performance is positive (Brown-Liburd & Zamora, Citation2015; Coram, Monroe, & Woodliff, Citation2009). Ultimately, such increased perceived reliability and credibility can even translate into higher stock price estimates (Coram et al., Citation2009). Experimental research on integrated reporting, however, is still very scarce. As shown in experimental evidence by Arnold et al. (Citation2012), an anchoring bias influences the assessment of sustainability information that is provided in a stand-alone sustainability report and an integrated report may help to avoid distorted valuations, thus serving as a debiasing tool. Our study further focuses the processing of sustainability information presented in separate and integrated reports and adds the influence of assuring this information to the analysis, emphasizing how these two important aspects of sustainability disclosure interact.

Theory and Hypothesis Development

In general, investment-related decision-making includes cognitive tasks that can be explained and grounded in human factors and psychological research (Muradoglu & Harvey, Citation2012). To assess investors’ information processing, Maines and McDaniel’s (Citation2000) model is employed here. Their comprehensive framework is based on psychological research and is generally regarded as influential in contemporary (experimental) accounting research (Dunbar & Weber, Citation2014) because the framework breaks down the decision-making process into testable constituent processes (Rangel, Camerer, & Montague, Citation2008). Consequentially, the model has regularly been applied by scholars in recent topical articles (e.g. Clor-Proell, Proell, & Warfield, Citation2014; Dilla, Janvrin, & Jeffrey, Citation2013; Janvrin, Pinsker, & Mascha, Citation2013; Lachmann et al., Citation2015; Müller, Riedl, & Sellhorn, Citation2015). For the present study, the model differentiates between possible alternative explanations of the way in which the integration of financial and sustainability information and the assurance of sustainability information interact and affect investors’ judgments.

Maines and McDaniel (Citation2000) suggest that investors’ judgments develop during a three-stage information process. The first stage, information acquisition, refers to investors’ ability to store and recall specific information. The second stage, information evaluation, involves an investor assessing the characteristics of the given information ‘in a way that enables its use’ (Hirshleifer & Teoh, Citation2003, p. 342). The third stage, information weighting, refers to the perceived relevance and reliability of a particular piece of information when an investor makes investment-related judgments. Considering each stage in the Maines and McDaniel (Citation2000) framework, and referencing different theories that explain cognitive bias and limitations in decision-making, we formulate specific hypotheses about investors’ processing of sustainability information.

In developing hypothesis H1 on the acquisition of information in separate and integrated reporting formats, we refer to the concept of the ‘cognitive costs’ of processing information, as described in the Maines and McDaniel (Citation2000) model. Then, we follow Hodge et al.’s (Citation2010) extension of this model, which is based on Wickens and Carswell’s (Citation1995) proximity compatibility principle. Based on cognitive-psychology research such as Russo (Citation1977), Maines and McDaniel (Citation2000) argued that presentation formats influence information processing by imposing differential cognitive costs on decision-makers. The scholars identified two formal dimensions related to these processing costs (i.e. isolation and aggregation), which were extended by Hodge et al. (Citation2010), who added the proximity effect as a third dimension.

According to Wickens and Carswell (Citation1995), the proximity compatibility principle explains the relationship between the cognitive processing and visual presentation of objects during a task or decision process. In this context, proximity is categorized as either display or task proximity. Display proximity describes the distance between different display features and whether the user/reader of the information can perceive these different objects simultaneously. Thus, high display proximity means that multiple sources of information are displayed in close proximity (also see Hodge et al., Citation2010). Here, Hodge et al. (Citation2010) established a link to the cognitive cost category proposed by Maines and McDaniel (Citation2000). Results showed that owing to limited working (short-term) memory, individuals find it difficult to acquire multiple pieces of information at the same time, especially when the information is dispersed (i.e. presented in low display proximity). Low display proximity is thus associated with a higher cognitive cost of acquiring information. Task proximity, however, is the degree of the combination of multiple sources of information required for a specific task or judgment. In other words, high task proximity is a situation in which different information sources should be considered to solve the task. The proximity compatibility principle argues that high task proximity should be supported by high display proximity and vice versa.

Applying the cognitive cost theory and the proximity compatibility principle to the analysis of integrated and separated reports suggests that the acquisition of sustainability-related information when an investor makes investment-related judgments based on an integrated report entails lower cognitive costs for the decision-maker than judgments based on the separate reporting format. Investment-related judgments typically represent high task proximity, and thus should be supported by high display proximity. Hodge et al. (Citation2010) explicitly stated that information located in separate documents implies dispersed information and thus low display proximity. This is the case in separate reporting in which financial- and sustainability-related performance information is located in two stand-alone reports. Hodge et al. (Citation2010) proposed that one way of enhancing the acquisition of multiple pieces of information is to present them in closer proximity, for example, in a single document. Thus, we expect that in the sustainability information acquisition stage, investors who receive an integrated report are more likely to acquire (i.e. store and recall) sustainability information than those who receive separate financial and sustainability reports:

H1: Professional investors who receive an integrated report are more likely to store and recall sustainability information than investors who receive separate financial and sustainability reports.

Other than the integration of information, the assurance does not influence the display proximity of the information relevant for an investment task because the presentation format is not changed. Consequentially, assurance does not reduce the cognitive cost of acquiring information. This is why we neither expect a main effect of assurance nor do we expect assurance to interact with the reporting format in the acquisition stage. In line with this, prior literature focused on the effects of voluntary assurance on reliability and credibility as relevant factors in the evaluation and weighting stage instead of scrutinizing the acquisition stage. Specifically, existing research indicates that voluntary assurance of sustainability information increases its perceived reliability and credibility (Brown-Liburd & Zamora, Citation2015; Coram et al., Citation2009; Hodge et al., Citation2009; Pflugrath et al., Citation2011). This is especially relevant in the case of positive sustainability information, which is generally prone to greenwashing allegations (Lyon & Montgomery, Citation2015). In general, sustainability information has to be perceived as credible and reliable to be meaningful and reduce information asymmetries. As a costly signal, assurance helps increase transparency and trust in the assured information. Furthermore, assurance can even act as a ‘quality surrogate’ for sustainability performance by positively influencing a company’s reputation related to sustainability (e.g. Birkey, Michelon, Patten, & Sankara, Citation2016; Cheng, Green, & Ko, Citation2015). The argument is that, in the absence of directly verifiable information, investors may turn to secondary information, expecting companies that invest in external assurance to have a better performance than companies that refrain from using costly assurance services. We thus expect the presence of externally assured sustainability information to lead to a higher perceived sustainability performance and weighting of the sustainability information. According to the Maines and McDaniel (Citation2000) framework, this should also lead to higher investment-related judgments in the case of assured sustainability information. Furthermore, the question of how assurance interacts with the (integrated or separated) reporting format in an investment-decision context remains an unanswered question. Here, we expect a cognitive bias when financial performance and sustainability performance are presented in the same report. Specifically, we expect a halo effect emanating from the (mandatory) assurance of financial information in the integrated reporting format.Footnote2

The halo effect was first documented decades ago in psychological research and describes the tendency of an observer’s overall impression of an object to influence the observer’s evaluation of that object’s properties in a way that is consistent with the overall evaluation (Asch, Citation1946; Nisbett & Wilson, Citation1977; Thorndike, Citation1920). The halo effect is typically more pronounced when the properties are ill-defined in the decision-maker’s mindset (e.g. Thorndike, Citation1920). The halo effect has been demonstrated in a variety of business- and economics-related domains, most prominently in consumer behavior (e.g. Beckwith & Lehmann, Citation1975; Boatwright, Kalra, & Zhang, Citation2008) and recently in the domain of CSR (Chernev & Blair, Citation2015). Although little accounting and auditing-related research has explicitly referred to the halo effect (e.g. O’Donnell & Schultz, Citation2005), it is well suited to describe the potential interaction effects of the integration and assurance of financial and sustainability information.

As argued above, we expect investors’ estimates of a firm’s sustainability performance as well as their weighting of this information and the resulting investment-related judgments to increase in the case of assured sustainability information compared to non-assured sustainability information. However, a halo effect may occur when the sustainability performance and the financial performance are presented in the same report. As assurance for financial information is mandatory, an integrated report will always contain an assurance statement. Thus, the overall impression is that of assured information, even if the sustainability-related information in this report (i.e. one of the ‘properties’ in the report) is actually non-assured. Any incremental effect of the voluntary assurance of sustainability information performance is likely to be muted. In contrast, in a separate reporting format this halo effect is absent and the effect of voluntary assurance of sustainability performance should be stronger. Thus, we hypothesize the following ordinal interaction effect that is also graphically depicted in the left column (‘expected patterns’) of Figure  (we discuss the specific contrast weights used to test this interaction in the Results section):

H2: The effect of the assurance of sustainability information on professional investors’ (i) evaluation and (ii) weighting of this information, as well as (iii) their investment-related judgments is weaker in the case of integrated reporting compared to separate reporting.

Method

Participants

Institutional investors represent the most influential providers of financial capital (Ferreira & Matos, Citation2008) and are thus the main addressees of integrated reporting as advocated by the IIRC (also see de Villiers, Rinaldi, Unerman, & Guthrie, Citation2014). To achieve high external validity, our sample comprised 104 professional analysts and fund managers who serve as proxies for professional investors. We recruited them through various professional social networks (e.g. LinkedIn, Xing, and Unience) and the mailing list of a German-based investors’ association. In total, we sent out 778 invitations to participate in the online experiment (with two follow-up e-mails at two-week intervals to those who did not initially respond) and achieved a response rate of 13.4%.Footnote3 Participants did not receive any financial or material incentive for participating. Instead, they were offered an individual profile of their answers and decisions, including comparisons with their fellow professionals, as well as a dossier about recent trends and future outlooks in corporate reporting. Given the profile of the selected group – highly skilled participants with very limited available time – we consider the response rate to be quite high. We tested the results for non-response bias using late responses as a proxy for non-responses (Oppenheim, Citation2000; Wallace & Mellor, Citation1988). The results of a χ2 test did not show significant differences between early and late respondents. Participants mean age was 40.2 years, and the mean time in their professional role was 11.8 years (median 11.0). Thirteen participants (12.5%) had a Ph.D. and 25 (24.0%) a CFA (Chartered Financial Analyst) qualification. Most of the participants were working in Germany (58.7%), probably because of the use of a German-based mailing list and the business social network Xing which has a strong presence in German-speaking countries. The remainder of the participants were working in the US (11.5%), or Spain (9.6%), or in France, the Netherlands, Turkey, Italy, the UK, or Denmark (all <5%). Results of a χ2 test did not show significant differences regarding the dependent variables between the group of German-based and other participants.

Design

Our experiment followed a 2 × 2 full-factorial, between-subjects design (Figure ). All participants were randomly assigned to one of the experimental groups. The two manipulated variables were integration and assurance. We held constant the sustainability and financial information content in all experimental conditions. Thus, all participants had access to exactly the same general introduction to the company, financial highlights, sustainability highlights, tabulated financial and sustainability key performance indicators, consolidated income statement, consolidated statement of cash flows, consolidated statement of financial position, and external assurance statement (see Appendix A for more details). A Kruskal–Wallis test did not reveal significant differences between the four groups in terms of personal characteristics (p values > .1).

Figure 1. Experimental groups

Figure 1. Experimental groups

The independent variable integration was operationalized through the presentation format of sustainability and financial information. Half of the participants received financial and sustainability information in a traditional reporting format – the two types of information disclosed in separate documents – reflecting the common practice of a stand-alone sustainability report and a regular annual financial report. The other half received an integrated report that combined financial and sustainability information in a single document, that is, both in the narrative parts of the reports and the KPIs, thus following the reference of the IIRC.Footnote4 Where financial and sustainability information was mixed, financial data were placed right above sustainability data, mirroring widespread corporate practice in integrated reporting, in which financial information is usually presented first.

For the independent variable assurance, we manipulated the presence of an external assurance of the disclosed sustainability information. Other than for the assurance of financial information, external assurance of sustainability information is usually voluntary. The sustainability information presented in the material was either assured or not. For the assured condition, this either meant that a dedicated sustainability assurance statement was included in a separate sustainability report (in the case of separate sustainability and financial reports) or that there was a combined assurance statement for financial and sustainability information (in the case of an integrated report). Furthermore, following examples from corporate practice, a notice next to the sustainability data itself indicated whether the information was assured (see, e.g. CVS Health Corporation, Citation2015; Samsung Electronics, Citation2015; Volkswagen AG, Citation2015). A reasonable assurance level was provided for financial and sustainability information. In the non-assured condition, however, the respective assurance statement covered financial information only.

The dependent variables in this study were geared toward the three levels of information processing, as introduced by Maines and McDaniel (Citation2000). In all four groups, the participants were asked to evaluate the hypothetical company ‘Beta’. Prior research in accounting and psychology indicates that the acquisition of information requires accessing (Hewitt, Citation2009) and viewing this information (Dilla et al., Citation2013) and that successful acquisition can be tested by decision-makers’ ability to recall the content of specific information items (e.g. Hales, Venkataraman, & Wilks, Citation2012). Thus, we tracked whether the participants accessed the different reports offered to them, and used manipulation checks to assess whether they correctly stored and recalled specific sustainability information in the material, to analyze the acquisition of sustainability information. With regard to investors’ evaluation of sustainability information, the participants were asked to evaluate Beta’s sustainability performance (susp) on an 11-point scale ranging from 0 (very weak) to 10 (very strong). For the weighting of sustainability information, we adopted the approach by Lachmann et al. (Citation2015) (similar to that of Hales et al., Citation2012), asking the participants to rate the relevance of financial information items (e.g. earnings and cash flows) and sustainability information when making their investment-related judgments, on an 11-point scale ranging from 0 (not at all important) to 10 (extremely important). To standardize the answers, we subtracted the mean of the relevance of financial information items from the scale value attributed to the relevance of sustainability information. This gives us a standardized measure of the weighting of sustainability information relative to the weighting of financial information (weight).Footnote5 Finally, to capture participants’ investment-related judgments, we followed Cianci and Kaplan (Citation2008) and asked participants to rate the company in terms of investment attractiveness (invest) using an 11-point scale ranging from 0 (absolutely not investable) to 10 (top investment).Footnote6

Task

Our experiment was administered online. The experimental task required the participants to complete several steps (Figure ). After accessing the webpage, the participants first read the instructions and a brief introduction to the fictitious company Beta, after which they were asked to judge the company and, depending on the experimental condition, were offered access to the respective report. In the separate condition (i.e. separate financial and sustainability reports), participants were presented hyperlinks to PDF files of both reports on the initial page of the online study. The link to the financial report was placed directly above the link to the sustainability report, thus mirroring usual practice in the download areas of company websites. In the integrated condition, only one hyperlink was provided. Throughout the process of forming investment-related judgments, the participants had potential access to the reports, so that they could choose which report(s) to access in order to obtain the required information to complete the task. They were not allowed to proceed until they had answered all the questions, nor were they allowed to go back to the previous page while answering a given question. After completing this task, the reports were no longer accessible. Finally, the participants were asked to respond to manipulation checks and demographic questions (e.g. age, work experience, gender, and mother tongue).

Figure 2. Flow of the experiment

Figure 2. Flow of the experiment

The experimental material on the fictive company Beta was modeled following actual reports from a real-life company covering the material illustrated above. We chose this company as a model because it had published an integrated report for three consecutive years. To prevent any prior knowledge of the company affecting the participants’ judgment, we disguised its identity (as similarly in Holm & Rikhardsson, Citation2008; Reimsbach & Hahn, Citation2015). We pretested the entire material to assess its internal consistency and plausibility (Wason, Polonsky, & Hyman, Citation2002). Eight professional investors and eight PhD students with a background in finance or sustainability completed the pretest experiment and suggested minor changes to the material to enhance its understandability and ensure the level of appropriateness and realism. We excluded all pretest participants from the final experiment and checked that they were not in contact with any of the final participants.

Results

Hypothesis Testing

Two factors influenced the acquisition of sustainability information (H1) in our experiment. First, the participants needed to access the report that contained the sustainability information. Although the participants who received the integrated report were automatically provided with sustainability information, those who received separate reports could opt for access to the sustainability report. To check this condition, we observed whether the participants actually accessed the respective files when they performed the experimental task. Second, if the participants accessed the respective report (the sustainability report or the integrated report, depending on the experimental condition), we were interested in whether they stored and recalled the given sustainability information.

Regarding the first premise, approximately one-quarter of the participants who received separate reports did not access the stand-alone sustainability report (14 out of 55, see Panel A, Table ). To analyze the second premise and provide a holistic picture of information acquisition, we used a post-experimental online questionnaire to discover whether the participants were able to recall the content and format of several pieces of sustainability-related information. Regarding content, we analyzed whether the participants correctly answered questions about the change in the company’s CO2 emissions and the percentage of women in senior management. To address format-related information acquisition, we analyzed whether the participants correctly recalled that sustainability KPIs were also reported in a tabulated format. The overall level of information acquisition was high; the percentage of correct answers ranged from 81.1% to 100% (see Panel B, Table ).

Table 1. Information acquisition

To test H1, we used χ2 tests (untabulated) to identify statistically significant differences in the percentage of correct sustainability-related answers between the groups that received integrated and separate reports. In analyzing all 90 participants who accessed sustainability information, we found no statistically significant quota differences between the separate (41 participants) and integrated (49 participants) conditions for two of the three measures of sustainability information acquisition (p > .1). Only for the CO2-related question did the χ2 test indicate (marginally) statistically significant differences (χ2 = 3.10, p < .1), with 87.8% (43 out of 49) of the participants in the integrated condition correctly recalling CO2-related information, compared to 73.2% (30 out of 41) of the participants in the separate condition who accessed sustainability information.

The results do not support H1. Although the integration of sustainability and financial information generally increased potential access to sustainability information, this did not lead into improved acquisition of sustainability information in our setting. Furthermore, and as expected, the presence or absence of assurance did not affect information acquisition nor did it interact with the reporting format.Footnote7 However, professional investors show a generally high level of sustainability information acquisition, regardless of the reporting format and the provision of assurance.

The plotted results for the (joint) effects of integration and assurance of sustainability information on professional investors’ evaluation (i) and weighting (ii) of sustainability information, as well as the corresponding investment-related judgments (iii) are depicted in the right column of Figure . The left column graphically depicts our qualitative predictions as formulated in H2.

Figure 3. Predicted pattern and plotted results

Figure 3. Predicted pattern and plotted results

Prior literature has already documented the positive effects of assurance of sustainability information on the perception of investors and other stakeholders (e.g. Birkey et al., Citation2016; Brown-Liburd & Zamora, Citation2015; Cheng et al., Citation2015; Coram et al., Citation2009; Hodge et al., Citation2009; Pflugrath et al., Citation2011,) and we can confirm these findings. To test these aspects, we again excluded the 14 participants who did not access the sustainability report, because evaluating and weighting the information required access to the report.Footnote8

The mean evaluation of sustainability performance (susp) was 6.93 for the participants who received assured sustainability information and 4.98 for those who received non-assured sustainability information (see Panel A, Table ). The mean standardized value of sustainability information weighting (weight) for all participants who acquired sustainability information was −2.53. The negative sign of the standardized values indicates that the participants still regarded the sustainability information as less important than the financial information. The mean weight was −3.20 for participants who received non-assured sustainability information and −1.87 for those who received assured sustainability information (Panel A, Table ). Regarding the investment-related judgments, we analyzed participants’ judgments of the overall investment attractiveness of the company (invest). The mean invest was 5.44 for participants who received non-assured sustainability information and 6.76 for those who received assured sustainability information (Panel A, Table ).

Table 2. Information evaluation

Table 3. Information weighting

Table 4. Investment-related judgments

The ANOVA results further indicate that the effects of assurance of sustainability information on participants’ perceived sustainability performance (Panel B in Table ), on the participants’ weighting of sustainability information (Panel B in Table ),Footnote9 and on the corresponding investment-related judgments (Panel B in Table ) were all statistically significant (p < .01). Together with the plotted data (see Figure ) and an additional series of post hoc tests (i.e. Scheffé, Bonferroni, and Games-Howell),Footnote10 the results clearly confirm previous findings and reveal that assured sustainability information was always associated with a higher perceived sustainability performance than non-assured information and that participants placed significantly more weight on their sustainability performance evaluation if this weighting was based on assured sustainability information. Furthermore, investors’ information processing leads to higher investment-related judgments if these judgments are based on assured sustainability information.

In H2, we predicted that the effect of the assurance of sustainability information on professional investors’ evaluations, weightings, and investment-related judgments would be weaker in the case of integrated reporting compared to separate reporting. Therefore, differences in the dependent variables between assured and non-assured information should be less pronounced in the integrated reporting format and more pronounced in the separate reporting format. A visual matching of the expected and actual patterns in Figure  supports this notion. As predicted, the actual results (right column, Figure ) show a rather flat line in all assured conditions and a slope in the non-assured conditions. The difference in participants’ evaluations of the firm’s sustainability performance between assured and non-assured information drops from 2.76 in the separate reporting treatments (= 6.90 [separate & assured] – 4.14 [separate & non-assured]) to 1.25 (= 6.96 [integrated & assured] – 5.71 [integrated & non-assured]) in the integrated reporting treatments. These differences are significant for the integrated (F = 10.74, p < .01) and the separate (F = 24.42, p < .01) reporting format. We find an almost identical pattern for the weighting and investment-related judgment stages. The difference in the standardized weighting measure drops from 1.58 in the separate reporting treatments (= −1.90 [separate & assured] – −3.48 [separate & non-assured]) to 1.12 (= −1.84 [integrated & assured] – −2.96 [integrated & non-assured]) in the integrated reporting treatments. Again, these differences are significant for the integrated (F = 13.25, p < .01) and the separate (F = 14.81, p < .01) reporting format. Finally, the difference in the perceived investment attractiveness drops from 1.71 in the separate reporting treatments (= 6.85 [separate & assured] – 5.14 [separate & non-assured]) to 0.97 (= 6.68 [integrated & assured] – 5.71 [integrated & non-assured]) in the integrated reporting treatments. Here as well, the differences are significant for the integrated (F = 6.01, p = .01) and the separate (F = 15.10, p < .01) reporting format. These findings are in line with H2.

However, although the ANOVA interaction term (Integrated × Assured) was statistically significant for the participants’ perceived sustainability performance (Panel B in Table ), it was not statistically significant for participants’ weighting of sustainability information (Panel B in Table ) and the corresponding investment-related judgments (Panel B in Table ). As we had predicted an ordinal interaction, for which ANOVA is less powerful as a statistical tool (see Buckless & Ravenscroft, Citation1990), we further analyzed the functional form of the interaction using planned contrasts (Buckless & Ravenscroft, Citation1990; also see Lachmann et al., Citation2015), which increase the statistical power without increasing Type I error rates. We used contrast weights of −3 for the separate & non-assured condition, −1 for the integrated & non-assured condition, and +2 for both assured conditions (i.e. integrated & assured, and separate & assured).Footnote11 This is consistent with our qualitative predictions that assured sustainability information is always associated with (i) a higher perceived sustainability performance, (ii) greater weighting of the sustainability information, and (iii) higher investment-related judgments and that this assurance effect is larger in the case of separate reporting compared to integrated reporting. The results of the planned contrast tests of interaction are reported in Panel C of Tables . All three planned contrasts were statistically significant (p < .01). Taken together, these results provide ample support for H2 and hint at an ordinal interaction between the reporting format and the provision of assurance.

Discussion and Conclusion

This study presents the results of an experimental analysis of the effects of the integration and assurance of sustainability and financial information on the investment-related judgments of professional investors. Our distinctive group of participants made investment-related judgments based on financial and (assured or non-assured) sustainability information about a real listed company (with its identity concealed) in either a separate or integrated presentation format.

We specifically tested two hypotheses, and our results indicate that the integration of sustainability and financial information did not lead to an improved acquisition of this type of information (H1). However, the integration increased professional investors’ potential access to sustainability information, because readers could not entirely opt out of encountering sustainability information during their information processing. This in itself remains an important objective of integrated reporting, because, as our experiment indicated, a substantial number of professional investors showed no interest in the separate sustainability report. Those participants who accessed the sustainability information showed good ability to store and recall sustainability information, even in the separate reporting condition. We thus assume that those professional investors who actively chose to access and read the stand-alone sustainability report deemed sustainability information relevant, with the result that they stored and recalled it, despite the higher cognitive costs associated with the low display proximity of separate reporting. The higher display proximity of integrated reporting thus was not found to have a statistically significant additional effect on the acquisition of sustainability information. We see these findings to be consistent with prior research documenting a specific search strategy for professional investors. Such investors typically use well-defined valuation models and thus often exhibit a directed search strategy focusing on the information that is most important for the task at hand (Hodge, Kennedy, & Maines, Citation2004). The generally high level of acquisition of sustainability-related information indicates that investors already include this information in their search strategy; this therefore superimposes the missing proximity compatibility in the separate reporting condition, that is, the suboptimal relationship between the cognitive processing and visual presentation of objects during the investment task.

Regarding the three subsequent stages of information processing, our results indicate that the assurance of sustainability information (i) was associated with an increase in the perceived sustainability performance, (ii) resulted in higher weighting of this information, and (iii) led to higher investment-related judgments. These results are in line with previous empirical work on the effects of assurance and non-financial performance (e.g. Birkey et al., Citation2016; Brown-Liburd & Zamora, Citation2015; Cheng et al., Citation2015) and support the notion that sustainability assurance represents a costly signal that enhances the credibility and relevance of the reported information (Connelly, Certo, Ireland, & Reutzel, Citation2010; Spence, Citation1973). The fact that the assurance of sustainability information apparently functioned as a quality surrogate in the evaluation stage, however, carries certain perils. The original purpose of assurance statements was to confirm and verify the accuracy of information and not the quality of the underlying performance. As mirrored in the results of our experiment, this should lead to a higher weighting of assured sustainability information compared to non-assured information. However, the assurance process does not improve the performance of the company’s sustainability performance per se. Instead, the assurance process rather confirms the accuracy of the reported data. Thus, an increased perception of the sustainability performance might be misplaced. However, the assurance effect in the evaluation stage may wear off when the assurance of sustainability information becomes the norm and is no longer useful as a costly quality signal. For large multinational companies, this tendency for isomorphism in sustainability assurance, in which companies gradually align their behavior to ensure legitimacy (e.g. DiMaggio & Powell, Citation1983), can already be observed (see KPMG, Citation2015). However, the tendency to attribute increased credibility to assured sustainability information in the weighting stage is not risk-free, because it diverts the problem of uncertain quality of the sustainability content to a third party (i.e. the auditor). Given that the procedure for sustainability-related assurance and its content are still in the development stage, this third party may not be familiar with the topic (see also Kim, Green, & Johnstone, Citation2016); therefore, the quality of the assurance itself is not always certain (Gürtürk & Hahn, Citation2016; Junior, Best, & Cotter, Citation2014). Nevertheless, from a managerial perspective, our results support the notion that companies should seek assurance for their sustainability information to enhance the perceived sustainability performance and achieve a higher investment willingness. This is, as hypothesized and observed in H2, more important if the company issues a stand-alone sustainability report compared to an integrated report.

We specifically expected that the incremental assurance effect would be weaker in the case of integrated reporting compared to separate reporting (H2). The results of our planned contrast analyses clearly support this notion, and the differences between the assured and non-assured information were less pronounced in the case of integrated reporting. We see these findings as consistent with a cognitive bias in decision-making when financial performance and sustainability performance are presented in the same report. We conclude that this bias may be caused by a halo effect emanating from the assured financial information. With the mandatory assurance of financial information, the overall impression of an integrated report may have been that of assured information, even if the sustainability-related information in this report was actually non-assured. Thus, the incremental effect of the voluntary assurance of sustainability information on the perceived sustainability performance was muted. In contrast, in a separate reporting format this halo effect was absent, and the effect of the voluntary assurance of sustainability performance was stronger.

How far this bias might be problematic must be considered independently for the different information-processing stages. For the evaluation phase, we first have to note that the reported sustainability information was identical in all experimental conditions. Thus, that the difference in perceived sustainability performance is less pronounced in the case of integrated reporting seems to be a positive (side) effect of this reporting format at first sight. However, the reduced differences resulted from the fact that the integrated reporting format increased the perceived sustainability performance because non-assured information has likely been perceived as assured. Therefore, one could also argue that the integrated reporting format poses the risk of a too favorable assessment of a company’s sustainability performance. Future studies could delve deeper into this question. For the weighting stage, the interpretation is more straightforward. Here, the increased weighting of non-assured sustainability information in the integrated condition is obviously an unwanted effect if non-assured information has been perceived as assured.

Overall, the results should be useful for corporate practice, as well as standard-setters and reporting initiatives. This holds particularly true, given that our results indicate that the choice of reporting format and assurance services also have an impact on investment-related judgments and could trigger capital market effects. Regarding the presentation format effects, the feasibility of the objectives of integrated reporting advocated by the IIRC needs further scrutiny. The IIRC argues that the integrated reporting format is expected to better satisfy investors’ information needs and enhance the value relevance of sustainability information (Citation2013). However, in our experiment, the combination of financial and sustainability information in one report did not incrementally improve the (already high) level of sustainability acquisition. Furthermore, additional presentation format effects occurred only when this information was non-assured. Whereas previous studies emphasized the potential benefits of integrated reporting in terms of debiasing effects (e.g. Arnold et al., Citation2012), the present study illustrates that, in specific settings, there may also be drawbacks (i.e. a biasing effect) in this reporting format.

Our results and conclusions should be considered in light of several limitations related to the experimental method. Most importantly, our study material was necessarily limited regarding the amount of information (see also Lachmann et al., Citation2015). Thus, the reports (financial and sustainability) may not have contained all the information that investors in reality are confronted with when they make judgments. Furthermore, we provided identical assurance levels for sustainability and financial information (i.e. reasonable assurance) to ensure comparability and avoid weakening our manipulations. Although this is still not the most common assurance practice for sustainability information, this practice is regularly applied by large companies (KPMG, Citation2015). However, whether, for example, the level of assurance affects investors’ judgments could be the subject of future research (see also Cohen & Simnett, Citation2015). In our experiment, we also abstracted potential multi-period effects. As outlined above, some of the effects observed in our experiment may have been a temporary phenomenon caused by the relative novelty of sustainability and integrated reporting. Furthermore, we did not use eye-tracking devices in our experiment. Therefore, for example, we were unable to measure whether the participants truly read the specific information items, which would give more depth to the analysis of information acquisition. The same limitation also applies to the sequence of information processing, especially in the separate reporting condition. Although we were able to track whether a participant opened a report, we could not trace the order in which the reports were opened. It is reasonable to assume that professional investors (not specialized in SRI) likely opened the financial report first, but future research could also investigate whether investors who have preferences either for financial or for sustainability information (and thus view the financial statement first or last) differ between each other and compared to investors receiving integrated information. Finally, we conducted an online experiment that allowed us to reach a very distinctive set of professional participants (i.e. analysts), but at the expense of working within a laboratory environment.

Supplemental Data and Research Materials

Supplemental data for this article can be accessed on the Taylor & Francis website, doi: 10.1080/09638180.2016.1273787.

Supplemental material

Online Supplemental Materials

Download PDF (949.8 KB)

Acknowledgements

We thank the handling editor, Hervé Stolowy, for guiding us through the review process and two anonymous reviewers for valuable comments that improved our contribution. This paper has also benefited from feedback we received at the AOM Annual Meeting 2014 in Philadelphia, the AAA Annual Meeting 2015 in Chicago, the Financial Reporting and Business Communication Conference 2015 in Bristol, the AOM Annual Meeting 2015 in Vancouver, and the EAA Annual Conference 2016 in Maastricht. All remaining errors are, of course, our own.

Notes

1 Respective corporate reports have various titles, such as sustainability reports, corporate social responsibility (CSR) reports, or environmental, social, governance reports (CorporateRegister.com, Citation2013; Hahn & Kühnen, Citation2013). For the sake of clarity, we use the terms sustainability information and sustainability reporting throughout this paper.

2 The following arguments are also supported by the carry-over effect. A carry-over effect occurs when the evaluation of one object is not independent from the scores of another related object (e.g. Mashburn, Meyer, Allen, & Pianta, Citation2014). We thank one of the anonymous reviewers for bringing up this aspect.

3 See also Cox and Reid (Citation2002) on the issues of highly specialized samples and Hodge (Citation2003) and Haar, Starr, and MacMillan (Citation1988) for similar approaches.

4 Furthermore, integrated reporting according to the IIRC ideally goes beyond combining the different types of information and also takes into account the connectivity and interdependencies. This, however, is often not achieved in current reporting practice (see, for example, the results of a recent descriptive study at http://integratedreporting.de/, accessed December 5, 2016).

5 Maines and McDaniel (Citation2000) used a different procedure based on testing for differences in coefficients of several bivariate regressions, which is, however, methodologically difficult to achieve. Therefore, subsequent studies, such as Hales et al. (Citation2012) and Lachmann et al. (Citation2015), used other measures of information weighting.

6 This was complemented by asking participants what recommendation they would deem fair and appropriate on a five-point scale, ranging from ‘strong buy’ to ‘strong sell’. We used the results for robustness checks.

7 Specifically, χ2 tests indicate that differences in the ability to correctly recall the change in the company’s CO2 emissions (χ2 = 0.07, p > .1) and the percentage of women in senior management (χ2 = 0.00, p > .1) are not significant between the assured and non-assured conditions. There are no differences for the manipulation check on the tabulated reporting format because the acquisition rate was 100% in all treatments. Furthermore, and to address potential interaction effects for the binary variable acquisition, we conducted two logistic regressions (also see, Lachmann et al., Citation2015). However, the interaction terms are insignificant for the CO2-related question and the female-manager-related question (each p > .1).

8 As a robustness check, we also included in the separate condition participants who did not access the sustainability report. Prior research indicates that the influence of sustainability reporting on investors’ judgment and decision-making works, at least partly, at the subconscious level (e.g. Elliott, Jackson, Peecher, & White, Citation2014). Thus, there is a slight possibility that potential access to a sustainability report influences perceived sustainability performance. However, the results remained qualitatively identical.

9 Mirroring the basic idea in Maines and McDaniel (Citation2000), we also separately regressed participants’ investment-related judgments (i.e. our variable invest) on their perceived sustainability performance (susp) for each of the four experimental conditions. The coefficients on susp were supposed to represent the weighting of sustainability information. However, given the small sample sizes, the four confidence intervals of the coefficients on susp overlapped; therefore, further interpretation of differences in the coefficients was not appropriate.

10 We conducted an additional series of post hoc tests (i.e. Scheffé, Bonferroni, and Games-Howell). This indicated that the mean difference in the perceived sustainability performance, the standardized value of sustainability information weighting, and in the assessment of the firm’s investment attractiveness is statistically significant (p < .05) for all assured (integrated and separate) versus non-assured (integrated and separate) treatments.

11 These contrast weights are commonly applied to test the type of ordinal interaction that we predicted in H2 (e.g. Elliott, Krische, & Peecher, Citation2010; Lachmann et al., Citation2015). As a robustness check, we also used some alternative specifications with contrast weights of 3;−2;3;−4 and 2;0;1;−3 for the sequence of our experimental conditions integrated & assured; integrated & non-assured; separate & assured; separate & non-assured. The 3;−2;3;−4 sequence is a more pronounced version of our basic setup (2;−1;2; −3). The sequence 2;0;1;−3 is, for example, applied by Chen and Tan (Citation2013). The results (untabulated) remained qualitatively identical.

References

  • Adams, C. A. (2015). The International Integrated Reporting Council: A call to action. Critical Perspectives on Accounting, 27, 23–28. doi: 10.1016/j.cpa.2014.07.001
  • Alwert, K., Bornemann, M., & Will, M. (2009). Does intellectual capital reporting matter to financial analysts? Journal of Intellectual Capital, 10(3), 354–368. doi: 10.1108/14691930910977789
  • Archel, P., Fernández, M., & Larrinaga, C. (2008). The organizational and operational boundaries of triple bottom line reporting: A survey. Environmental Management, 41(1), 106–117. doi: 10.1007/s00267-007-9029-7
  • Arnold, M. C., Bassen, A., & Frank, R. (2012). Integrating sustainability reports into financial statements: An experimental study. SSRN Electronic Journal. Retrieved from https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2030891
  • Asch, S. E. (1946). Forming impressions of personality. The Journal of Abnormal and Social Psychology, 41(3), 258–290. doi: 10.1037/h0055756
  • Azam, Z., Warraich, K. M., & Awan, S. H. (2011). One report: Bringing change in corporate reporting through integration of financial and non-financial performance disclosure. International Journal of Accounting and Financial Reporting, 1(1), 50–71. doi: 10.5296/ijafr.v1i1.831
  • Ballou, B., Casey, R. J., Grenier, J. H., & Heitger, D. L. (2012). Exploring the strategic integration of sustainability initiatives: Opportunities for accounting research. Accounting Horizons, 26(2), 265–288. doi: 10.2308/acch-50088
  • Beckwith, N. E., & Lehmann, D. R. (1975). The importance of halo effects in multi-attribute attitude models. Journal of Marketing Research, 12(3), 265–275. doi: 10.2307/3151224
  • Berthelot, S., Coulmont, M., & Serret, V. (2012). Do investors value sustainability reports? A Canadian study. Corporate Social Responsibility and Environmental Management, 19(6), 355–363. doi: 10.1002/csr.285
  • Birkey, R. N., Michelon, G., Patten, D. M., & Sankara, J. (2016). Does assurance on CSR reporting enhance environmental reputation? An examination in the U.S. context. Accounting Forum, 40(3), 143–152. doi: 10.1016/j.accfor.2016.07.001
  • Boatwright, P., Kalra, A., & Zhang, W. (2008). Research note—should consumers use the halo to form product evaluations? Management Science, 54(1), 217–223. doi: 10.1287/mnsc.1070.0742
  • Brown, J., & Dillard, J. (2014). Integrated reporting: On the need for broadening out and opening up. Accounting, Auditing & Accountability Journal, 27(7), 1120–1156. doi: 10.1108/AAAJ-04-2013-1313
  • Brown-Liburd, H., & Zamora, V. L. (2015). The role of corporate social responsibility (CSR) assurance in investors’ judgments when managerial pay is explicitly tied to CSR performance. AUDITING: A Journal of Practice & Theory, 34(1), 75–96. doi: 10.2308/ajpt-50813
  • Buckless, F. A., & Ravenscroft, S. P. (1990). Contrast coding: A refinement of ANOVA in behavioral analysis. The Accounting Review, 65(4), 933–945.
  • Chen, W., & Tan, H.-T. (2013). Judgment effects of familiarity with an analyst’s name. Accounting, Organizations and Society, 38(3), 214–227. doi: 10.1016/j.aos.2013.02.001
  • Cheng, M. M., Green, W. J., & Ko, J. C. W. (2015). The impact of strategic relevance and assurance of sustainability indicators on investors’ decisions. AUDITING: A Journal of Practice & Theory, 34(1), 131–162. doi: 10.2308/ajpt-50738
  • Chernev, A., & Blair, S. (2015). Doing well by doing good: The benevolent halo of corporate social responsibility. Journal of Consumer Research, 41(6), 1412–1425. doi: 10.1086/680089
  • Cho, C. H., Phillips, J. R., Hageman, A. M., & Patten, D. M. (2009). Media richness, user trust, and perceptions of corporate social responsibility: An experimental investigation of visual web site disclosures. Accounting, Auditing & Accountability Journal, 22(6), 933–952. doi: 10.1108/09513570910980481
  • Churet, C., & Eccles, R. G. (2014). Integrated reporting, quality of management, and financial performance. Journal of Applied Corporate Finance, 26(1), 56–64.
  • Cianci, A. M., & Kaplan, S. (2008). The effects of management’s preannouncement strategies on investors’ judgments of the trustworthiness of management. Journal of Business Ethics, 79(4), 423–444. doi: 10.1007/s10551-007-9408-2
  • Clor-Proell, S. M., Proell, C. A., & Warfield, T. D. (2014). The effects of presentation salience and measurement subjectivity on nonprofessional investors’ fair value judgments. Contemporary Accounting Research, 31(1), 45–66. doi: 10.1111/1911-3846.12041
  • Cohen, J. R., & Simnett, R. (2015). CSR and assurance services: A research agenda. AUDITING: A Journal of Practice & Theory, 34(1), 59–74. doi: 10.2308/ajpt-50876
  • Connelly, B. L., Certo, S. T., Ireland, R. D., & Reutzel, C. R. (2010). Signaling theory: A review and assessment. Journal of Management, 37(1), 39–67. doi: 10.1177/0149206310388419
  • Coram, P. J., Monroe, G. S., & Woodliff, D. R. (2009). The value of assurance on voluntary nonfinancial disclosure: An experimental evaluation. AUDITING: A Journal of Practice & Theory, 28(1), 137–151. doi: 10.2308/aud.2009.28.1.137
  • CorporateRegister.com. (2013). CRPerspectives 2013 – global CR reporting trends and stakeholder views. Retrieved from http://www.corporateregister.com/search/report.cgi?num=67880-5LbsBickQXo
  • Cox, D. R., & Reid, N. (2002). The theory of the design of experiments. Boca Raton, FL: CRC Press.
  • CVS Health Corporation. (2015). Prescription for a better world – 2014 corporate social responsibility report. Woonsocket, RI: CVS Health Corporation. Retrieved from https://www.cvshealth.com/sites/default/files/2014%20CVS%20Health%20CSR.pdf
  • Dhaliwal, D. S., Li, O. Z., Tsang, A., & Yang, Y. G. (2011). Voluntary nonfinancial disclosure and the cost of equity capital: The initiation of corporate social responsibility reporting. The Accounting Review, 86(1), 59–100. doi: 10.2308/accr.00000005
  • Dhaliwal, D. S., Radhakrishnan, S., Tsang, A., & Yang, Y. G. (2012). Nonfinancial disclosure and analyst forecast accuracy: International evidence on corporate social responsibility disclosure. The Accounting Review, 87(3), 723–759. doi: 10.2308/accr-10218
  • Dilla, W. N., Janvrin, D. J., & Jeffrey, C. (2013). The impact of graphical displays of pro forma earnings information on professional and nonprofessional investors’ earnings judgments. Behavioral Research in Accounting, 25(1), 37–60. doi: 10.2308/bria-50289
  • DiMaggio, P. J., & Powell, W. W. (1983). The iron cage revisited: Institutional isomorphism and collective rationality in organizational fields. American Sociological Review, 48(2), 147–160. doi: 10.2307/2095101
  • Dunbar, A. E., & Weber, D. P. (2014). What influences accounting research? A citations-based analysis. Issues in Accounting Education, 29(1), 1–60. doi: 10.2308/iace-50603
  • Eccles, R. G., & Saltzman, D. (2011). Achieving sustainability through integrated reporting. Stanford Social Innovation review, (Summer), 56–61.
  • Elliott, W. B., Jackson, K. E., Peecher, M. E., & White, B. J. (2014). The unintended effect of corporate social responsibility performance on investors’ estimates of fundamental value. The Accounting Review, 89(1), 275–302. doi: 10.2308/accr-50577
  • Elliott, W. B., Krische, S. D., Peecher, M. E. (2010). Expected mispricing: The joint influence of accounting transparency and investor base. Journal of Accounting Research, 48(2), 343–381. doi: 10.1111/j.1475-679X.2010.00370.x
  • Erkens, M., Paugam, L., & Stolowy, H. (2015). Non-financial information: State of the art and research perspectives based on a bibliometric study. Comptabilité – Contrôle – Audit, 21(3), 15–92. doi: 10.3917/cca.213.0015
  • Ferreira, M. A., & Matos, P. (2008). The colors of investors’ money: The role of institutional investors around the world. Journal of Financial Economics, 88(3), 499–533. doi: 10.1016/j.jfineco.2007.07.003
  • Fifka, M. S. (2013). Corporate responsibility reporting and its determinants in comparative perspective – A review of the empirical literature and a meta-analysis. Business Strategy and the Environment, 22(1), 1–35. doi: 10.1002/bse.729
  • Flower, J. (2015). The International Integrated Reporting Council: A story of failure. Critical Perspectives on Accounting, 27, 1–17. doi: 10.1016/j.cpa.2014.07.002
  • Frías-Aceituno, J. V., Rodríguez-Ariza, L., & García-Sánchez, I. M. (2013a). Is integrated reporting determined by a country’s legal system? An exploratory study. Journal of Cleaner Production, 44, 45–55. doi: 10.1016/j.jclepro.2012.12.006
  • Frías-Aceituno, J. V., Rodríguez-Ariza, L., & García-Sánchez, I. M. (2013b). The role of the board in the dissemination of integrated corporate social reporting. Corporate Social Responsibility and Environmental Management, 20(4), 219–233. doi: 10.1002/csr.1294
  • Frias-Aceituno, J. V., Rodríguez-Ariza, L., & Garcia-Sánchez, I. M. (2014). Explanatory factors of integrated sustainability and financial reporting. Business Strategy and the Environment, 23(1), 56–72. doi: 10.1002/bse.1765
  • García-Sánchez, I.-M., Rodríguez-Ariza, L., & Frías-Aceituno, J.-V. (2013). The cultural system and integrated reporting. International Business Review, 22(5), 828–838. doi: 10.1016/j.ibusrev.2013.01.007
  • Ghosh, D., & Wu, A. (2012). The effect of positive and negative financial and nonfinancial performance measures on analysts’ recommendations. Behavioral Research in Accounting, 24(2), 47–64. doi: 10.2308/bria-10283
  • Gürtürk, A., & Hahn, R. (2016). An empirical assessment of assurance statements in sustainability reports: Smoke screens or enlightening information? Journal of Cleaner Production, 136, 30–41. doi: 10.1016/j.jclepro.2015.09.089
  • Haar, N. E., Starr, J., & MacMillan, I. C. (1988). Informal risk capital investors: Investment patterns on the East Coast of the U.S.A. Journal of Business Venturing, 3(1), 11–29. doi: 10.1016/0883-9026(88)90027-4
  • Hahn, R., & Kühnen, M. (2013). Determinants of sustainability reporting: a review of results, trends, theory, and opportunities in an expanding field of research. Journal of Cleaner Production, 59, 5–21. doi: 10.1016/j.jclepro.2013.07.005
  • Hales, J. W., Venkataraman, S., & Wilks, T. J. (2012). Accounting for lease renewal options: The informational effects of unit of account choices. The Accounting Review, 87(1), 173–197. doi: 10.2308/accr-10165
  • Healy, P. M., & Palepu, K. G. (2001). Information asymmetry, corporate disclosure, and the capital markets: A review of the empirical disclosure literature. Journal of Accounting and Economics, 31(1–3), 405–440. doi: 10.1016/S0165-4101(01)00018-0
  • Hewitt, M. (2009). Improving investors’ forecast accuracy when operating cash flows and accruals are differentially persistent. The Accounting Review, 84(6), 1913–1931. doi: 10.2308/accr.2009.84.6.1913
  • Hirshleifer, D., & Teoh, S. H. (2003). Limited attention, information disclosure, and financial reporting. Journal of Accounting and Economics, 36(1–3), 337–386. doi: 10.1016/j.jacceco.2003.10.002
  • Hodge, F. D. (2003). Investors’ perceptions of earnings quality, auditor independence, and the usefulness of audited financial information. Accounting Horizons, 17(s-1), 37–48. doi: 10.2308/acch.2003.17.s-1.37
  • Hodge, F. D., Hopkins, P. E., & Wood, D. A. (2010). The effects of financial statement information proximity and feedback on cash flow forecasts. Contemporary Accounting Research, 27(1), 101–133. doi: 10.1111/j.1911-3846.2010.01003.x
  • Hodge, F. D., Kennedy, J. J., & Maines, L. A. (2004). Does search-facilitating technology improve the transparency of financial reporting? The Accounting Review, 79(3), 687–703. doi: 10.2308/accr.2004.79.3.687
  • Hodge, K., Subramaniam, N., & Stewart, J. (2009). Assurance of sustainability reports: Impact on report users’ confidence and perceptions of information credibility. Australian Accounting Review, 19(3), 178–194. doi: 10.1111/j.1835-2561.2009.00056.x
  • Holm, C., & Rikhardsson, P. (2008). Experienced and novice investors: Does environmental information influence investment allocation decisions? European Accounting Review, 17(3), 537–557. doi: 10.1080/09638180802016627
  • Huang, X. B., & Watson, L. (2015). Corporate social responsibility research in accounting. Journal of Accounting Literature, 34(1), 1–16. doi: 10.1016/j.acclit.2015.03.001
  • IIRC. (2013). The international <IR> frameworks. Retrieved from http://www.theiirc.org/wp-content/uploads/2013/12/13-12-08-THE-INTERNATIONAL-IR-FRAMEWORK-2-1.pdf
  • Janvrin, D. J., Pinsker, R. E., & Mascha, M. F. (2013). XBRL-enabled, spreadsheet, or PDF? Factors influencing exclusive user choice of reporting technology. Journal of Information Systems, 27(2), 35–49. doi: 10.2308/isys-50569
  • Jensen, J. C., & Berg, N. (2012). Determinants of traditional sustainability reporting versus integrated reporting – an institutionalist approach. Business Strategy and the Environment, 21(5), 299–316. doi: 10.1002/bse.740
  • Junior, R., Best, P., & Cotter, J. (2014). Sustainability reporting and assurance: A historical analysis on a world-wide phenomenon. Journal of Business Ethics, 120(1), 1–11. doi: 10.1007/s10551-013-1637-y
  • Kent, P., & Monem, R. (2008). What drives TBL reporting: Good governance or threat to legitimacy? Australian Accounting Review, 18(4), 297–309. doi: 10.1111/j.1835-2561.2008.0036.x
  • Kim, S., Green, W., & Johnstone, K. M. (2016). Biased evidence processing by multidisciplinary greenhouse gas assurance teams. AUDITING: A Journal of Practice & Theory, 35(3), 119–139. doi: 10.2308/ajpt-51368
  • Kolk, A., & Perego, P. (2010). Determinants of the adoption of sustainability assurance statements: an international investigation. Business Strategy and the Environment, 19(3), 182–198.
  • KPMG. (2015). KPMG international survey of corporate social responsibility reporting 2015. Retrieved from https://www.kpmg.com/CN/en/IssuesAndInsights/ArticlesPublications/Documents/kpmg-survey-of-corporate-responsibility-reporting-2015-O-201511.pdf
  • van der Laan Smith, J., Adhikari, A., Tondkar, R. H., & Andrews, R. L. (2010). The impact of corporate social disclosure on investment behavior: A cross-national study. Journal of Accounting and Public Policy, 29(2), 177–192. doi: 10.1016/j.jaccpubpol.2009.10.009
  • Lachmann, M., Stefani, U., & Wöhrmann, A. (2015). Fair value accounting for liabilities: Presentation format of credit risk changes and individual information processing. Accounting, Organizations and Society, 41, 21–38. doi: 10.1016/j.aos.2014.08.001
  • Lozano, R., & Huisingh, D. (2011). Inter-linking issues and dimensions in sustainability reporting. Journal of Cleaner Production, 19(2–3), 99–107. doi: 10.1016/j.jclepro.2010.01.004
  • Lyon, T. P., & Montgomery, A. W. (2015). The means and end of greenwash. Organization & Environment, 28(2), 223–249. doi: 10.1177/1086026615575332
  • Maines, L. A., & McDaniel, L. S. (2000). Effects of comprehensive-income characteristics on nonprofessional investors’ judgments: The role of financial-statement presentation format. The Accounting Review, 75(2), 179–207. doi: 10.2308/accr.2000.75.2.179
  • Maniora, J. (2015). Is integrated reporting really the superior mechanism for the integration of ethics into the core business model? An empirical analysis. Journal of Business Ethics. doi: 10.1007/s10551-015-2874-z
  • Mashburn, A. J., Meyer, J. P., Allen, J. P., & Pianta, R. C. (2014). The effect of observation length and presentation order on the reliability and validity of an observational measure of teaching quality. Educational and Psychological Measurement, 74(3), 400–422. doi: 10.1177/0013164413515882
  • Müller, M. A., Riedl, E. J., & Sellhorn, T. (2015). Recognition versus disclosure of fair values. The Accounting Review, 90(6), 2411–2447. doi: 10.2308/accr-51044
  • Muradoglu, G., & Harvey, N. (2012). Behavioural finance: The role of psychological factors in financial decisions. Review of Behavioural Finance, 4(2), 68–80. doi: 10.1108/19405971211284862
  • Nisbett, R. E., & Wilson, T. D. (1977). The halo effect: Evidence for unconscious alteration of judgments. Journal of Personality and Social Psychology, 35(4), 250–256. doi: 10.1037/0022-3514.35.4.250
  • O’Donnell, E., & Schultz, J. J. (2005). The halo effect in business risk audits: Can strategic risk assessment bias auditor judgment about accounting details? The Accounting Review, 80(3), 921–939. doi: 10.2308/accr.2005.80.3.921
  • O'Dwyer, B. (2011). The case of sustainability assurance: Constructing a new assurance service. Contemporary Accounting Research, 28(4), 1230–1266. doi: 10.1111/j.1911-3846.2011.01108.x
  • Oppenheim, A. N. (2000). Questionnaire design, interviewing and attitude measurement. London: Continuum International Publishing Group.
  • Pflugrath, G., Roebuck, P., & Simnett, R. (2011). Impact of assurance and assurer’s professional affiliation on financial analysts’ assessment of credibility of corporate social responsibility information. AUDITING: A Journal of Practice & Theory, 30(3), 239–254. doi: 10.2308/ajpt-10047
  • Rangel, A., Camerer, C., & Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience, 9(7), 545–556. doi: 10.1038/nrn2357
  • Reimsbach, D., & Hahn, R. (2015). The effects of negative incidents in sustainability reporting on investors’ judgments – an experimental study of third-party versus self-disclosure in the realm of sustainable development. Business Strategy and the Environment, 24(4), 217–235. doi: 10.1002/bse.1816
  • Rikhardsson, P., & Holm, C. (2008). The effect of environmental information on investment allocation decisions – an experimental study. Business Strategy and the Environment, 17(6), 382–397. doi: 10.1002/bse.536
  • Russo, J. E. (1977). The value of unit price information. Journal of Marketing Research, 14(2), 193–201. doi: 10.2307/3150469
  • Samsung Electronics. (2015). Sustainability report 2015 – global harmony with people, society & environment. Seoul: Samsung Electronics. Retrieved from http://www.samsung.com/us/aboutsamsung/sustainability/sustainabilityreports/download/2015/SAMSUNG_SUSTAINABILITY_REPORT_2015_ENG.pdf
  • Serafeim, G. (2015). Integrated reporting and investor clientele. Journal of Applied Corporate Finance, 27(2), 34–51. doi: 10.1111/jacf.12116
  • Sierra-García, L., Zorio-Grima, A., & García-Benau, M. A. (2015). Stakeholder engagement, corporate social responsibility and integrated reporting: An exploratory study. Corporate Social Responsibility and Environmental Management, 22(5), 286–304. doi: 10.1002/csr.1345
  • Skouloudis, A., Evangelinos, K., & Kourmousis, F. (2010). Assessing non-financial reports according to the Global Reporting Initiative guidelines: Evidence from Greece. Journal of Cleaner Production, 18(5), 426–438. doi: 10.1016/j.jclepro.2009.11.015
  • Spence, M. (1973). Job market signaling. The Quarterly Journal of Economics, 87(3), 355–374. doi: 10.2307/1882010
  • Thorndike, E. L. (1920). A constant error in psychological ratings. Journal of Applied Psychology, 4(1), 25–29. doi: 10.1037/h0071663
  • de Villiers, C., Rinaldi, L., Unerman, J., & Guthrie, J. (2014). Integrated reporting: Insights, gaps and an agenda for future research. Accounting, Auditing & Accountability Journal, 27(7), 1042–1067. doi: 10.1108/AAAJ-06-2014-1736
  • Volkswagen AG. (2015). Sustainability report 2015. Wolfsburg: Volkswagen AG. Retrieved from http://www.volkswagenag.com/content/vwcorp/info_center/en/publications/2015/04/group-sustainability-report-2014.bin.html/binarystorageitem/file/Volkswagen_Sustainability_Report_2014.pdf
  • Wallace, R., & Mellor, C. J. (1988). Nonresponse bias in mail accounting surveys: A pedagogical note. The British Accounting Review, 20(2), 131–139. doi: 10.1016/0890-8389(88)90036-4
  • Wason, K. D., Polonsky, M. J., & Hyman, M. R. (2002). Designing vignette studies in marketing. Australasian Marketing Journal (AMJ), 10(3), 41–58. doi: 10.1016/S1441-3582(02)70157-2
  • Wickens, C. D., & Carswell, C. M. (1995). The proximity compatibility principle: Its psychological foundation and relevance to display design. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37(3), 473–494. doi: 10.1518/001872095779049408
  • Yongvanich, K., & Guthrie, J. (2006). An extended performance reporting framework for social and environmental accounting. Business Strategy and the Environment, 15(5), 309–321. doi: 10.1002/bse.541

Appendix A. Overview of provided information

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.