1,927
Views
7
CrossRef citations to date
0
Altmetric
Construction Management

A model of BIM application capability evaluation for Chinese construction enterprises based on interval grey clustering analysis

, , &
Pages 210-221 | Received 18 Dec 2019, Accepted 29 May 2020, Published online: 17 Jul 2020

ABSTRACT

Application of BIM plays a key role in the practices of architecture, engineering and construction. Evaluating and improving BIM application capability have important effects on increasing BIM performance and enhancing the benefits of BIM usages. To evaluate the BIM application capability of construction enterprises, this study proposed an evaluation model based on interval grey cluster analysis (IGCA). Firstly, the study constructed an assessment index system of BIM application capability from three dimensions, including technical, organization and management, and human aspect. Secondly, BIM application capability and its evaluation index were divided into four levels. Thirdly, in order to determine the index weights, the interval-entropy weight method was applied. Then IGCA was applied to identify the BIM application capability. Finally, a case study was conducted to explain the application of the proposed model and to verify the validity of the model. The results indicated that the evaluation model could provide a new way to evaluate and improve BIM application capabilities.

1. Introduction

In recent years, Building Information Modeling (BIM) has experienced a rapid development in China (Wu et al. Citation2017) and become more common application in construction projects (Lin and Yang Citation2018). As the second revolution in the Architecture, Engineering and Construction (AEC) industry, Building Information Modeling (BIM) has been considered to be the most promising recent developments (Lin, Lee, and Yang Citation2016) as well as the leading technology for use in AEC practices (GhaffarianHoseini et al. Citation2017). It has a critical role in enhancing the effectiveness of project delivery from the initial concept to completion and post-construction maintenance (Ding, Zhou, and Akinci Citation2014; Volk, Stengel, and Schultmann Citation2014), and also has a significant impact on the efficiency of generation of building information and sharing of this information among various stakeholders throughout the building lifecycle (Yilmaz, Akcamete-Gungo, and Demirors Citation2017).

According to a survey by China in 2019, 52.07% of construction enterprises were engaged with BIM on less than 10 projects, while only 7.03% of construction enterprises were engaged with BIM on more than 50 projects (Chen et al. Citation2019). Furthermore, there were still 18.09% of construction enterprises which have not established a BIM organization, not to mention continuous BIM usages. These imply that although BIM is in a stage of rapid development in China, the BIM application capability is as a whole insufficient. BIM application capability is the comprehensive one involving the management, technology and human in the process of introducing and applying BIM in the enterprise (Wang and Li Citation2018). The challenge is how to improve the BIM adoption rate and application capability of China. To address this challenge, an assessment schema for AEC organizations should be developed to gauge the effectiveness of BIM implementations in order to measure the performance of BIM utilizations and enable continuous BIM improvements (Yilmaz, Akcamete, and Demirors Citation2019). However, there is not enough emphasis on the issue in China. Only a few studies have focused on the evaluation of BIM application capability (Wang et al. Citation2017; Yu Citation2017; Wang and Li Citation2018).

In addition, in order to make a quantitative evaluation of BIM application capability, an appropriate evaluation method should be found. This study introduced interval grey clustering analysis (IGCA) for the evaluation of BIM application capability. Considering that there are few studies on BIM application capability evaluation, this study established an IGCA-based evaluation model of BIM application capability, which included evaluation index system, BIM application capability levels and quantitative assessment method. The model could provide theoretical and practical guidance for evaluating and improving BIM application capability of AEC enterprises.

2. Literature review

Successful BIM implementation requires a thorough understanding of the current situation of BIM operations as well as effective, advanced, and high-performing measurements (Wu et al. Citation2017). However, there is not enough emphasis on the issues in China. Wang et al. (Citation2017) and Yu (Citation2017) established the index system for BIM application capability evaluation and conducted the assessment based on the analytic hierarchy process (AHP). Wang and Li (Citation2018) utilized the factor analysis to construct an index system for enterprise BIM application capability evaluation, but there was no quantitative evaluation. In addition, the established index systems were not comprehensive, and the classification and hierarchy were confusing: divisions or sub-divisions with the same title comprised different measures. For instance, the measure “BIM related training” was classified under the organizational aspect in Wang et al. (Citation2017), while this measure was under the process aspect in Yu (Citation2017). These differences easily lead to confusions. In fact, this measure is generally classified under Human aspect (Succar Citation2010).

Considering that there are few studies on BIM application capability evaluation in China, the BIM maturity model can serve as a reference for the development of BIM application capability evaluation model due to the similarities and overlaps between the metrics of the two (Wang and Li Citation2018). Several models have been developed abroad to measure BIM maturity, such as NBIMS CMM (NIBS, Citation2007), BIM PM created by Indiana University Architect’s Office (IU Arhictect’s Office, Citation2009), BIM QuickScan from the Netherlands (Van Berlo and Hendriks Citation2012), VDC Scorecard developed by Stanford University Center for Integrated Facility Engineering (Kam et al. Citation2013) and BIM MM by (Succar Citation2010). NBIMS CMM was proposed by the National Institute of Building Science in 2007. The model evaluates BIM implementation in 11 areas using a 10-level scale (NIBS Citation2007; Giel Citation2014). It focuses on evaluating BIM maturity of construction projects. BIM PM was designed to assess BIM services performance in terms of 8 areas, 32 measures and 5 maturity levels (CIC Citation2012). Unlike NIBMS CMM, it focuses on assessing the BIM maturity of organizations. Although the two models are the bases for the following models, they are usually criticized because of limited measurement scope in technical aspects (Succar Citation2010). BIM MM was developed to assess BIM performance of organizations, projects, teams and individuals. It provides comprehensive explanations for each measure to minimize inconsistencies and expands the measuring scope to cover non-technical aspects of BIM (Giel and Issa Citation2013). BIM QuickScan was launched in 2011. It consists of 4 main areas and 44 measures, which provides insight into the strengths and weaknesses of BIM usage in an organization. VDC Scorecard was developed in 2012 by Stanford University. It measures the project performance against an industry benchmark, which includes 4 main areas, 10 divisions, and 74 measures (Kam et al. Citation2013). Although each model has a different number of measures clustered into different numbers of layers, the common concepts have been selected to define the metrics. In most models, their measures are classified into the common categories, which are process, stakeholder/personnel, standard, software, hardware, and data (Yilmaz, Akcamete, and Demirors Citation2019). Moreover, according to Chinese researches Wang and Li (Citation2018), BIM application capability is the comprehensive one involving the management, technology and human in the process of introducing and applying BIM in the enterprise. Therefore, based on the above research, we classified BIM application capability into three dimensions: technology, organization and management, and human aspect.

In terms of research methods of BIM application capability evaluation, most literatures utilized analytic hierarchy process (AHP) for evaluation (Wang et al. Citation2017; Yu Citation2017). Although AHP is a common method to solve multicriteria decision-making (MCDM) problems, the results obtained through it tend to be subjective. Moreover, capability assessment is affected by many factors, and most of these factors are qualitative measures, which makes it difficult to conduct quantitative evaluation when the information is uncertain and incomplete. Grey system theory is a method to handle uncertainties in small data samples with imprecise information (Wong and Hu Citation2013; Sun, Liang, and Wang Citation2019). Grey clustering analysis is one of the classic methods of grey evaluation methods. It is the combination of grey system theory and cluster analysis, and is widely utilized in many fields such as economics, military, biology, transportation and environmental quality assessment (Yuan and Liu Citation2012; Pei and Wang Citation2013; Xie, Liu, and Zhan Citation2013; Jian et al. Citation2014; Shen, Xu, and Wang Citation2008; Wang, Ning, and Chen Citation2012; Li, Zhang, and He Citation2012; Jia, Mi, and Zhang Citation2013). The traditional grey clustering analysis is generally based on the real number domain, which is not applicable when the sample value is an interval. Considering this problem, the researchers proposed interval grey clustering analysis (IGCA) (Zhou et al. Citation2013; Wang et al. Citation2015; Qian, Liu, and Xie Citation2016; Dang et al. Citation2017). However, the reported applications of this method in the construction industry are limited.

In summary, there is not enough emphasis on BIM application capability evaluation for enterprises in China. Only a few studies have focused on the issue. Moreover, previous studies have not found an appropriate method for BIM application capability evaluation. Therefore, based on five foreign maturity models and relevant domestic literatures, this paper firstly established an evaluation index system for BIM application capability, and then constructed an IGCA-based assessment model for BIM application capability evaluation. Lastly, the model validity and applicability were verified through case studies.

3. Methodology

Considering the methods for evaluation, there are many commonly employed methods such as fuzzy comprehensive evaluation (FCE), AHP, grey correlation analysis and TOPSIS (Li and Yu Citation2013; Wang et al. Citation2017; Yu Citation2017; Wu and Hu Citation2020). However, the results obtained through FCE and AHP tend to be subjective, and because of the difficulty in determining the reference sequence or the optimal vector, the grey correlation analysis and TOPSIS may not be applicable to this study. In addition, structural equation model (SEM), principal component analysis (PCA), factor analysis (FA) and BP neural network are also popular methods for evaluation (Gunduz, Birgonul, and Ozdemir Citation2017; Ma, Shang, and Jiao Citation2018; Li Citation2019; Liu, Zhan, and Tian Citation2019). However, these methods require large data samples to conduct evaluation, which are not applicable to research due to the difficulty to obtain multiple samples. As discussed previously, grey clustering analysis has the advantages of both grey system theory and clustering analysis, and can solve the multi–index evaluation problem with small samples and poor information. The evaluation results by this method are intuitive and reliable. According to grey clustering analysis, the whitenization values of the clustering object for different clustering indices are summarized according to a number of grey numbers to determine the grey categories (Fu and Zou Citation2018). Moreover, for the issue of capability evaluation, it is difficult to accurately quantify the relevant indices and classify the grey categories of the evaluation objects due to the complexity of the reality and the incomplete information. In most cases, data range may be given as intervals based on existing information. On this account, interval grey clustering analysis (IGCA) was chosen for evaluation.

3.1. Related theory of interval grey number

The interval grey number refers to the uncertain value in a certain interval or a general number set (Zhou et al. Citation2013). In this paper, the entropy weight method and grey clustering analysis with interval grey number were applied to develop an evaluation model of BIM application capability. For this purpose, the basic concepts and algorithms of interval grey number are introduced, and interval grey number ordering is also discussed.

3.1.1. Basic concepts and algorithms

Assume , + is the interval grey number defined on the domain of discourse Ω, and when Ω0,1, the interval grey number is called the standard grey number. μ=+ is the measurement of the range of . In the absence of the value distribution information of interval grey number , we note ˆ as the kernel of , where ˆ=(++)/2, and go as the degree of greyness of , where go=μ/μΩ (Guo et al. Citation2019; Liu, Fang, and Forrest Citation2010). For example, considering =2,8 is the interval grey number defined on the domain of discourse [0, 10], then the μ=82=6, μΩ=100=10, the ˆ=(2+8)/2=5, and the go=6/10=0.6.

Considering the interval grey number , +, it can alternatively be represented as ˆ(go) or r r=++r,0r1, where ˆ(go) is the simplified form and r is the standardized form of interval grey number (Wang et al. Citation2015; Qian, Liu, and Xie Citation2016). The two forms contain both the upper limit and lower limit information, and have the one-to-one correspondence with interval grey number, i.e. the two forms contain the same amount of information as the original interval grey number. Given an interval grey number , +, we can represent it in simplified form or standardized form. On the contrary, when the simplified form or standardized form is known, we can also get the original interval grey number via the previous definition. For example, continuing the example above, the simplified form of interval grey number =2,8 is =5(0.6), and the standardized form is r=2+82×r=2+6r,0r1.

The algorithm of interval grey numbers is the theoretical basis of grey system theory, which plays an important role in the application of interval grey numbers. The researches (Guo et al. Citation2019; Liu, Fang, and Forrest Citation2010; Li, Yin, and Yang Citation2017) have proposed the algorithm of interval grey numbers based on kernel and degree of greyness, which could avoid the problems caused by the original algorithm, such as the abnormal amplification of the degree of greyness. Assume there are two interval grey numbers 11, 1+ and 22, 2+, which are simply recorded as ˆ1(g1o)and ^2(g2o)[2,2+], then the algorithms of interval grey numbers are:

(1) ˆ1(g1o)+ˆ2(g2o)=(ˆ1+ˆ2)(g1og2o)(1)
(2) ˆ1(g1o)ˆ2(g2o)=(ˆ1ˆ2)(g1og2o)(2)
(3) ˆ1(g1o)׈2(g2o)=(ˆ1׈2)(g1og2o)(3)
(4) ˆ1(g1o)/ˆ2(g2o)=(ˆ1/ˆ2)(g1og2o)(4)

kˆ1(g1o)=(kˆ1)(g1o) (Suppose k is a real number)(5)

3.1.2. Interval grey number ordering

According to the ordering method based on precision and relative kernel (Liu, Fang, and Forrest Citation2010; Ma et al. Citation2017), the method for ranking interval grey numbers is as follows.

Suppose , + is the standard grey number. ˆ is the kernel of , and go is the degree of greyness of , then we note γ as the precision of , where γ=1/1+go, and δ as the relative kernel of , where δ()=γ()׈.

Considering the two standard grey numbers 1 and 2, then

If δ1>δ2, then 12;

If δ1<δ2, then 12;

If δ1=δ2, then

  1. If γ1>γ2, then 12;

  2. If γ1<γ2, then 12;

  3. If γ1=γ2, then 1=2.

For example, considering the interval grey number 1=0.3,0.6 and 2=0.4,0.9, which are represented as 1=0.450.3 and 2=0.650.5. Then the γ1=1/1+0.3=0.7692, γ2=1/1+0.5=\break0.6667; δ1=0.7692×0.45=0.3461,δ2=\break0.6667×0.65=0.4334. δ1<δ2, so 12.

When the degree of greyness is equal to zero, the interval grey number becomes a real number, then the comparison of the interval grey numbers is converted into the comparison between real numbers.

3.2. Entropy weight method with interval grey number

In multi-attribute decision-making, different weights need to be assigned to each attribute due to its different influence on the evaluation object. The methods for determining the weights include Delphi method, analytic hierarchy process, sequential scoring method, etc. However, the weights obtained through these methods are subjective and arbitrary. The entropy weight method was chosen because it is an objective weighting method which determines the index weight according to the variability of indices (Ma et al. Citation2017). Generally, the smaller the information entropy of an index is, the greater the variability of the index becomes, thus the more information it provides, and the greater its weight (Suchith Reddy, Rathish Kumar, and Anand Raj Citation2019; Dos Santos, Godoy, and Campos Citation2019). Entropy weight method could ensure the objectivity and accuracy of the index weights, so as to ensure the authenticity and reliability of the evaluation results. In this paper, the interval gray number is introduced into the entropy weight method to determine the weight of indices. The specific steps are as follows (Qian, Liu, and Xie Citation2016).

Step 1: Determination of the decision matrix

The evaluation value of the i-th expert on the j-th index is recorded as the interval grey numberijaij,biji=1,2,,m;j=1,2,,n, which can also be written as tij=aij+bijaij×rijrij0,1 according to the definition of the standard interval gray number, so the decision matrix can be expressed as T=tijm×n.

Step 2: Data standardization

In order to eliminate the influence of different dimensions between the indicators, the original data matrix should be normalized to P=(p˜ij)m×n. The standardization formula is as follows.

(6) p˜ij=tiji=1mtij(6)

Step 3: Calculation of the information entropy

(7) E˜j=1lnmi=1mp˜ijlnp˜ij(7)

where E˜jEj,Ej+. The smaller the information entropy of evaluation index is, the more effective information it provides, and the greater the weight of the index will be.

Step 4: Calculation of the index weights

(8) W˜j=1E˜jnj=1nE˜j(8)

where W˜jwj, wj+,

(9) wj=1Ej+nj=1nEj(9)
(10) wj+=1Ejnj=1nEj+(10)

After obtaining the grey entropy weight of index j,wˆj=wj+wj+2 is taken as the weight of index j according to the theory of interval grey number “kernel”, which is normalized to get the final weight vector w=w1,w2,,wn.

3.3. Evaluation method based on IGCA

The specific steps of the assessment are as follows.

Step 1: Construction of the interval grey number whitenization weight functions

The grey categories are classified according to the requirements of the project, and then the corresponding interval grey number whitenization weight functions of each gray category are determined. The whitenization weight function of index j on the k-th grey category is denoted as fjkj=1,2,,n;\breakk=1,2,s. fjk,,jk3,jk4, fjkjk1,\breakjk2,,jk4, fjkjk1,jk2,, are the lower limit measure whitenization weight function, the moderate measure whitenization weight function and the upper limit measure whitenization weight function, respectively.jk1,jk2,jk3andjk4 are, respectively, the first, second, third and fourth turning points of the whitenization weight function, where jkljkl,jkl+l=1,2,3,4. The three interval grey number whitenization weight functions are shown in .

Figure 1. Lower limit measure whitenization weight function

Figure 1. Lower limit measure whitenization weight function

Figure 2. Moderate measure whitenization weight function

Figure 2. Moderate measure whitenization weight function

Figure 3. Upper limit measure whitenization weight function

Figure 3. Upper limit measure whitenization weight function

Step 2: Calculation of whitenization weight values

The whitenization weight values are calculated according to the whitenization weight function determined in step 1. The turning points and index values are rewritten in simplified form before calculation. Considering the interval grey number j of index j,j=ˆj(gjo), gjo=μj/μΩj, andjk(l)=\breakˆjk(l)(gojk(l)), g ojkl=μjkl/μΩj. The calculation formula of the whitenization weight values for the index j on all grey categories can be represented as follows (Dang et al. Citation2017).

Lower limit measure whitenization weight function:

(11) fjk(j)=0j+0orjjk(4)+1(gjo)ˆj[0,ˆjk(3)]andj<010jj+jk(3)1(gjogojk(3))ˆj[0,ˆjk(3)]andj+>jk(3)(ˆjk(4)ˆjˆjk(4)ˆjk(3))(gjogojk(3)gojk(4))ˆj[ˆjk(3),ˆjk(4)]0(gjogojk(4))ˆj>ˆjk(4)andj<jk(4)+(11)

Moderate measure whitenization weight function:

(12) fjk(j)=0j+jk(1)orjjk(4)+0(gj0gojk(1))ˆj[ˆjk(1),ˆjk(4)]andj+>jk(1)(ˆjˆjk(1)ˆjk(2)ˆjk(1))(gj0gojk(1)gojk(2))ˆj[ˆjk(1),ˆjk(2)](ˆjk(4)ˆjˆjk(4)ˆjk(2))(gj0gojk(2)gojk(4))ˆj[ˆjk(2),ˆjk(4)]0(gj0gojk(4))ˆj[ˆjk(1),ˆjk(4)]andj<jk(4)+(12)

Upper limit measure whitenization weight function:

(13) fjk(j)=0j+jk(1)0(gjogojk(1))ˆjˆjk(1)andj+>jk(1)(ˆjˆjk(1)ˆjk(2)ˆjk(1))(gjogojk(1)gojk(2))ˆj[ˆjk(1),ˆjk(2)]1(gjogojk(2))ˆj>ˆjk(2)andj<jk(2)+1j>jk(2)+(13)

Step 3: Determination of grey clustering weight

The weight reflects the importance degree of different indexes to the evaluated objects. The entropy weight method based on interval grey number was applied to determine the index weight.

Step 4: Calculation of comprehensive clustering coefficients

After determining the whitenization weight values and clustering weight, the comprehensive clustering coefficients that represent the membership degree to a certain grey category of the clustering indexes are calculated by the following formula.

(14) σk=j=1nfjkj×wj(14)

Step 5: Determination of the grey category of the evaluation object

According to the principle of maximum membership, the grey category of the evaluation object can be determined by the following formula.

(15)  1ksmaxσk=σk(15)

Thus the grey category of the evaluation object is k.

4. Proposed model of BIM application capability evaluation

The proposed evaluation model was an approach for assessing the BIM application capabilities of enterprises. Assessments using the approach enable the organizers to understand current levels of BIM application capabilities. The assessment results could provide baseline for improvements in BIM usages. The evaluation model possessed a schema in which evaluation index system, application capability levels, and evaluation process were defined to facilitate BIM application capability assessments.

4.1. Construction of evaluation index system

Considering that related Chinese standards and engineering project management models are different from those of foreign countries, the five internationally recognized BIM maturity models, namely NBIMS CMM, BIM Proficiency Matric, BIM Maturity Matrix, BIM Quick Scan and VDC Scorecard, may not be completely suitable for domestic situations. Therefore, based on the five maturity models, this study combined the relevant domestic literature and Chinese BIM-related standards to develop the evaluation index system. The evaluation index system was confirmed by experts who have rich experience in BIM application and project management. The sources of each index are shown in , and the evaluation index system is shown in .

Table 1. Sources of evaluation indices for BIM application capabilities

Table 2. Index system for BIM application capability evaluation

4.2. Division of BIM application capability levels

It was necessary to decide how many application capability levels should be defined to cover the different levels of BIM utilization. Various multi-stage divisions of BIM maturity have been proposed in the literature. For example, six levels of BIM maturity for NBIMS CMM and BIM QuickScan; five levels of BIM maturity for BIM PM and BIM MM; four levels of BIM maturity for VDC Scorecard and Multi-functional BIM MM have been defined. However, it has been observed that four-stage divisions have been proposed and tested more frequently (King and Teo Citation1997). In addition, according to Yilmaz, Akcamete, and Demirors (Citation2019), four levels of BIM capability appear to be sufficient without omitting any significant type of BIM utilization. Therefore, we created four levels of BIM application capability starting from Level 0 to Level 3. To define the BIM capability levels, Multi-functional BIM MM (Liang et al. Citation2016) and BIM-CAREM (Yilmaz, Akcamete, and Demirors Citation2019) were followed, and the actual situation of BIM application in Chinese enterprises was also considered. BIM application capability levels are presented below. The level descriptions of indices are shown in .

  • BIM application capability level 0-Incomplete BIM: BIM is not implemented or partially implemented but there are no changes and resource commitments to support BIM.

  • BIM application capability level 1-Performed BIM: BIM is implemented to achieve the business process purpose and is used to perform base practices and produce standalone BIM outcomes. However, BIM has not been integrated into the business processes, and there is no significant BIM-based collaboration and data exchange between stakeholders and business processes.

  • BIM application capability level 2-Integrated BIM: The previously performed BIM is implemented using an integrated BIM supporting collaboration and data exchange between stakeholders and business processes.

  • BIM application capability level 3-Optimized BIM: The previously integrated BIM is used at organizational level and is continuously improved to achieve the strategies and goals of the organization.

Table 3. Level descriptions of indices

4.3. Evaluation process

The proposed approach to evaluate BIM application capabilities can be presented in three phases.

Phase I-In the first phase, a team of experts give their judgment on assessment indices score according to the BIM implementation. In this phase, the proposed index system will be explained to the experts.

Phase II–In the second phase, the decision matrix is constructed based on the scores given by experts. The interval-entropy weight method utilizes this matrix to estimate weights of the indices. The outputs of this phase will be the input (weights of the indices and decision matrix) of phase III.

Phase III-At last, in the third phase, the IGCA method (as described earlier) is used to evaluate the organization and determine the BIM application capability level of the organization.

5. Application of proposed approach

5.1. Case study

This paper took company A in China as an example. Company A is a construction enterprise founded in the 1940 s with many years of experience in construction engineering, municipal engineering, fire engineering and architectural design. It is the pioneer of BIM application in China and has been using BIM for about 10 years. At present, Company A has implemented BIM in the whole life cycle of the project, and has preliminarily established a BIM data platform including project data such as schedule, contract, cost, quality, drawings, etc., and has also realized the integration of BIM with standardization, informatization and cloud technology. We conducted our case study in company A based on the proposed evaluation model.

Step 1: Development of the decision matrix

Three experts were invited to deliver their judgments on index values based on the BIM implementation of company A, which were denoted in the interval grey numbers in the domain of [0,100]. These experts were selected on the basis of their rich experience in construction project management, and all of them have many years of BIM experience. The decision matrix was constructed based on the index values given by experts, which was as follows:

A(ij)=(58,60)(64,67)(56,59)(73,75)(63,66)(70,72)(81,84)(75,77)(79,82)(58,62)(56,60)(64,67)(78,80)(69,72)(74,76)(71,73)(64,67)(68,70)(80,82)(78,81)(84,86)(74,78)(84,86)(81,85)(81,83)(77,79)(87,90)(75,77)(71,74)(79,82)(56,58)(60,64)(58,60)(75,79)(82,85)(77,80)(67,70)(72,74)(76,79)

Step 2: Determine the index weights

According to the interval-entropy weight method introduced in Section 3.2, the index weights were calculated as follows.

Considering the first indicator (j = 1), the interval grey numbers were written in standardized form with t11=58+2r11, t21=64+3r21, t31=56+3r31. Then

p˜11=58+2r11178+2r11+3r21+3r31
p˜21=64+3r11178+2r11+3r21+3r31
p˜31=56+3r11178+2r11+3r21+3r31
E˜1=1ln3p˜11lnp˜11+p˜21lnp˜21+p˜31lnp˜31

Then we obtained E˜10.9972,0.9994 through MATLAB software. Similarly, the entropy values of all indices can be obtained. Then, according to the equations in step 4 of Section 3.2, the index weights were obtained as shown in .

Table 4. Calculation results of index weights

Step 3: Determine the BIM application capability level

According to the division of BIM application capability levels in the previous section, the grey category was divided into four. In this phase, we first determined the whitenization weight functions of indices according to the expert opinions, which were as follows.

f1=[,,(52,54),(62,65)],f2=[(52,54),(62,65),,(78,82)]
f3=[(62,65),(78,82),,(90,95)],f4=[(78,82),(90,95),]

Then we took the average of the index values given by the three experts in step 1 as the index scores, which were written in simplified form and denoted as ˆj (gjo). Then we calculated the whitenization weight values of indices according to EquationEquations (11Equation13).

Finally, based on the index weights obtained in step 2, we calculated the comprehensive clustering coefficients according to EquationEquation (14). Whitenization weight values and comprehensive clustering coefficients are shown in .

Table 5. Whitenization weight values and comprehensive clustering coefficients of indices

5.2. Results and discussion

According to EquationEquation (15) and the ordering method introduced in Section 3.1.2, the BIM application capability of the enterprise was found at level 2- Integrate BIM, which is consistent with the Chinese construction industry’s qualitative assessment on BIM application capability of company A. In addition, we fed the results back to the BIM managers and BIM engineers of the enterprise to discuss with them, all of the interviewees stated that the evaluation results were the same as their expected BIM application capability level. The judgment of the construction industry and the feedback from company A verified the effectiveness of the proposed evaluation model.

According to the index weights in , the key indices that affect the BIM application capability are C1-Richness and Accuracy of BIM Related Data and Information, C2-Model Based Calculations and Analysis, C4-Interoperability and coordination of BIM related data, C13-BIM Related Responsibilities and Roles, and C9-Completeness of BIM Business Processes. For Company A, the improvement of these indices could facilitate the improvement of BIM application capability. In addition, based on the evaluation results in , Company A could identify the performance of their BIM utilizations, and at the same time could determine the current level of each index in conjunction with the level description in , thus could enable continuous BIM improvements.

The IGCA-based assessment approach could determine the BIM application capability of the enterprise, which could also identify the key factors affecting BIM performance. It indicates that this approach provides a new idea for BIM application capability evaluation and realizes the conversion between qualitative concepts and quantitative values of capability evaluation, and also allows the index values to be given in the form of interval grey number, thus could facilitate scientific and reliable evaluation results.

6. Conclusion

Assessment of enterprise BIM application capability is crucial to the improvement of BIM performance and the development of BIM technology. This paper introduced interval grey clustering analysis to construct an evaluation model for BIM application capability. The model considers the problem that the index values are difficult to be accurately quantified under the incomplete and uncertain information, and employs the interval grey number to deal with the BIM application capability evaluation by defining the levels of capability in terms of intervals and taking the index values as interval data, which could make the evaluation more in line with the reality and the evaluation results more scientific and reliable.

The proposed evaluation model consists of three elements: the evaluation index system, the BIM application capability levels and the evaluation process. The index system includes three dimensions of technical, organization and management, and human aspect, which are constructed based on relevant literature analysis and expert opinions. Four capability levels are defined to map the evolution of each metric. In order to determine the index weights, the interval-entropy weight method was performed to assign the interval weight for each indicator. The IGCA method was then applied to evaluate BIM application capability. Finally, a case study was performed to verify the validity of the evaluation model. Based on the feedback of the interviewees on the evaluation results, it indicates that the proposed evaluation model could be used to effectively identify the BIM capability levels of enterprises. The evaluation model could provide a new way to evaluate BIM usages and enable continuous BIM improvements.

One limitation in this research should be noted. The assessment of the indices reflects the cognition of the personnel; thus, the results can be affected by the characteristics of the respondents. In the future research, we plan to expand the number of respondents to assign weight for each respondent to enhance the reliability of the assessment and conduct other cases to further validate the model.

Author contributions

Ailing Wang proposed innovation points, provided research platforms and research funds, guided and modified the manuscript. Mengqi Su did the data collection and analysis, and wrote the manuscript. Shaonan Sun guided and modified the manuscript. Yuqin Zhao provided the case information.

Acknowledgments

The authors would like to acknowledge the National Natural Science Foundations of China and Key R&D and promotion Special Projects of Henan Province, China for financially supporting this work, and express our appreciation to the experts for providing useful data, valuable information, and helpful comments during our research.

The authors would like to extend our sincere gratitude to our teacher, Danying Gao, for his instructive advice and useful suggestions on our thesis. We are deeply grateful of his help in the completion of this thesis.

Disclosure statement

No potential conflict of interest was reported by the authors.

Correction Statement

This article has been republished with minor changes. These changes do not impact the academic content of the article.

Additional information

Funding

This work was supported by the National Natural Science Foundation of China under Grant [number 51709115]; National Natural Science Foundation of China under Grant [number 71801195]; and Key R&D and promotion Special Projects of Henan Province under Grant [number 182102210066].

Notes on contributors

Ailing Wang

Ailing Wang is a professor at Zhengzhou University in China. Her research areas include engineering management, engineering cost management and BIM technology development and application.

Mengqi Su

Mengqi Su is a Master's degree candidate at the School of Management Engineering at Zhengzhou University in China. Her main research area is engineering project management.

Shaonan Sun

Shaonan Sun is a professor at North China University of Water Resources and Electric Power in China. He received a Ph.D degree from Hohai University in 2012. His research areas include BIM technology development and application, bidding and contract management and Construction management.

Yuqin Zhao

Yuqin Zhao is the project commerce manager at the Department of Business Contract at the First Company of China Eighth Engineering Division Ltd. His research interests include bidding and contract management and engineering cost management.

References

  • Chen, X. F., Q. Li, L. Y. Chen, et al. 2019. Analysis Report on BIM Application in Chinese Construction Enterprises. China: Beijing.
  • CIC. 2012. BIM Planning Guide for Facility Owners Pennsylvania State University. PA: University Park. http://bim.psu.edu
  • Dang, Y. G., Y. Feng, S. Ding and L. Wei. 2017. “Grey Clustering Model for Interval Grey Numbers Based on Kernel and Degree of Greyness.” Control and Decision 32 (10): 1844–1848.
  • Ding, L., Y. Zhou, and B. Akinci. 2014. “Building Information Modeling (BIM) Application Framework: The Process of Expanding from 3D to Computable nD.” Automation in Construction 46: 82–93. doi:https://doi.org/10.1016/j.autcon.2014.04.009.
  • Dos Santos, B. M., L. P. Godoy, and L. M. Campos. 2019. “Performance Evaluation of Green Suppliers Using entropy-TOPSIS-F.” Journal of Cleaner Production 207: 498–509. doi:https://doi.org/10.1016/j.jclepro.2018.09.235.
  • Fu, X. Q., and Z. H. Zou. 2018. “Water Quality Evaluation of the Yellow River Basin Based on Gray Clustering Method.” In IOP Conference Series-Earth and Environmental Science, Beijing: PEOPLES R CHINA.
  • GhaffarianHoseini, A., T. Zhang, O. Nwadigo, A. GhaffarianHoseini, N. Naismith, J. Tookey, K. Raahemifar. 2017. “Application of nD BIM Integrated Knowledge-based Building Management System (BIM-IKBMS) for Inspecting Post-construction Energy Efficiency”. Renewable and Sustainable Energy Reviews 72: 935–949. doi:https://doi.org/10.1016/j.rser.2016.12.061.
  • Giel, B. 2014. “MINIMUM BIM, 2nd Edition Proposed Revision NBIMS V3.” http://www.instantdownloaderpro.com
  • Giel, B., and R. R. Issa. 2013. “Synthesis of Existing BIM Maturity Toolsets to Evaluate Building Owners.” Computing in Civil Engineering 451–458. doi:https://doi.org/10.1061/9780784413029.057.
  • Gunduz, M., M. T. Birgonul, and M. Ozdemir. 2017. “Fuzzy Structural Equation Model to Assess Construction Site Safety Performance.” Journal of Construction Engineering and Management 143 (4): 04016112. doi:https://doi.org/10.1061/(ASCE)CO.1943-7862.0001259.
  • Guo, S. D., Y. Li, F. Y. Dong, B. J. Li and Y. J. Yang. 2019. “Multi-attribute Grey Target Decision-making Based on ‘Kernel’ and Double Degree of Greyness.” Journal of Grey System 31 (2): 27–36.
  • IU Arhictect’s Office. 2009. “BIM Proficiency Matrix.” http://www.iu.edu/~vpcpf/consultant-contractor/standards/bim-standards.shtml
  • Jia, T. B., C. M. Mi, and T. Zhang. 2013. “Organization Power Configuration Model Based on Grey Clustering.” Journal of Grey System 25 (2): 69–80.
  • Jian, L. R., H. H. Zhao, Y. Liu and J. J. Zhu. 2014. “Civil Aircraft Suppliers Selection Based on Grey Target and Grey Cluster Decision Method.” In IEEE International Conference on Systems Man and Cybernetics Conference Proceedings, San Diego, CA, 1691–1696).
  • Kam, C., D. Senaratna, Y. Xiao and B. McKinney. 2013. “The VDC Scorecard: Evaluation of AEC Projects and Industry Trends.” In CIFE 136 (31). Maharashtra, India.
  • King, W. R., and T. S. H. Teo. 1997. “Integration between Business Planning and Information Systems Planning: Validating a Stage Hypothesis.” Decision Sciences 28 (2): 279–308. doi:https://doi.org/10.1111/j.1540-5915.1997.tb01312.x.
  • Li, J., and W. Yu. 2013. “An Improved Grey Incidence Analysis Method Based on Topsis Thinking and Its Application on the Project Evaluation.” Mathematics in Practice and Theory 43 (8): 76–81.
  • Li, S. Z., Z. D. Zhang, and R. S. He. 2012. “Application of Grey Clustering Evaluations in Coal Railway Transportation.” Kybernetes 41 (5/6): 714–725. doi:https://doi.org/10.1108/03684921211243365.
  • Li, Y. 2019. “Evaluation of Urban Leisure Industry Development Based on Principal Component Analysis.” Statistics and Decision 35 (1): 62–66.
  • Li, Y. L., X. L. Yin, and J. Yang. 2017. “Multi-attribute Group Decision Making Model Based on Kernel and Degree of Greyness of Interval Grey Numbers.” Fire Control & Command Control 42 (3): 17–20.
  • Liang, C., W. Lu, S. Rowlinson, X. Zhang. 2016. “Development of a Multifunctional BIM Maturity Model.” Journal of Construction Engineering and Management 142 (11): 06016003. doi:https://doi.org/10.1061/(ASCE)CO.1943-7862.0001186.
  • Lin, Y. C., H. Y. Lee, and I. T. Yang. 2016. “Developing As-built BIM Model Process Management System for General Contractors: A Case Study.” Journal of Civil Engineering and Management 22 (5): 608–621. doi:https://doi.org/10.3846/13923730.2014.914081.
  • Lin, Y. C., and H. H. Yang. 2018. “A Framework for Collaboration Management of BIM Model Creation in Architectural Projects.” Journal of Asian Architecture and Building Engineering 17 (1): 39–46. doi:https://doi.org/10.3130/jaabe.17.39.
  • Liu, S. F., Z. G. Fang, and J. Forrest 2010. “On Algorithm Rules of Interval Grey Numbers Based on the ‘Kernel’ and the Degree of Greyness of Grey Numbers.” In IEEE International Conference on Systems Man and Cybernetics Conference Proceedings, Istanbul, Turkey, 756–760.
  • Liu, Z. D., Q. Q. Zhan, and G. L. Tian. 2019. “Research Review on Comprehensive Evaluation of Factor Analysis.” Statistics and Decision 35 (19): 68–73.
  • Ma, F., J. He, J. P. Ma and S. G. Xia. 2017. “Evaluation of Urban Green Transportation Planning Based on Central Point Triangle Whiten Weight Function and entropy-AHP.” Transportation Research Procedia 25: 3638–3648. doi:https://doi.org/10.1016/j.trpro.2017.05.328.
  • Ma, Q. T., G. F. Shang, and X. Y. Jiao. 2018. “Evaluation of Smart City Construction Level Based on BP Neural Network.” Mathematics in Practice and Theory 48 (14): 64–72.
  • National Institute of Building Sciences (NIBS). 2007. United States National Building Information Modeling Standard, Version 1, Part 1: Overview, Principles, and Methodologies.
  • Pei, L. L., and Z. X. Wang. 2013. “An Optimized Grey Cluster Model for Evaluating Quality of Labor Force.” Journal of Software 8 (10): 2489–2498. doi:https://doi.org/10.4304/jsw.8.10.2489-2494.
  • Qian, L. L., S. F. Liu, and N. M. Xie. 2016. “Grey Clustering Model Based on Entropy-weight and Grey Numbers.” Systems Engineering and Electronics 38 (2): 352–356.
  • Shanghai Housing and Urban-Rural Construction Management Committee. 2017. Shanghai Building Information Modeling Application Guide. China: Shanghai.
  • Shen, M. X., J. Xu, and S. Wang. 2008. “Grey Cluster Decision Making Way for the Threat Ordering of Aerial Targets.” Systems Engineering and Electronics 30 (9): 1721–1723.
  • Succar, B. 2010. “Building Information Modelling Maturity Matrix, Handbook of Research on Building Information Modeling and Construction Informatics: Concepts and Technologies.” IGI Global 65–103. doi:https://doi.org/10.4018/978-1-60566-928-1.ch400.
  • Suchith Reddy, A., P. Rathish Kumar, and P. Anand Raj. 2019. “Entropy- Based Fuzzy TOPSIS Framework for Selection of a Sustainable Building Material.” International Journal of Construction Management. doi:https://doi.org/10.1080/15623599.2019.1683695.
  • Sun, H., Y. Z. Liang, and Y. N. Wang. 2019. “Grey Clustering Evaluation for the Cooperation Efficiency of PPP Project: Taking Beijing Metro Line 4 as an Example.” Mathematical Problems in Engineering 2019: 1–13. doi:https://doi.org/10.1155/2019/8232731.
  • Van Berlo, L., and H. Hendriks. 2012. “BIM QuickScan: Benchmark of BIM Performance in the Netherlands.” In Proceedings of the 29th International Conference CIB W78, Beirut, 17–19.
  • Volk, R., J. Stengel, and F. Schultmann. 2014. “Building Information Modeling (BIM) for Existing Buildings-Literature Review and Future Needs.” Automation in Construction 38: 109–127. doi:https://doi.org/10.1016/j.autcon.2013.10.023.
  • Wang, J. J, Y. G. Dang, X. M. Li and J. Cui. 2015. “Grey Clusters Method with Fixed Weights Based on the Interval Grey Number.” Chinese Journal of Management Science 23 (10): 139–146.
  • Wang, J. K., H. S. Ning, and W. S. Chen. 2012. “Airport Bird-strike Risk Assessment Model with Grey Clustering Evaluation Method.” Chinese Journal of Electronics 21 (3): 409–413.
  • Wang, M. H., G. B. Wang, L. Peng, C. Xu and J. L. Song. 2017. “BIM Capability Assessment for Architecture Company and Empirical Research.” Journal of Engineering Management 31 (5): 153–158.
  • Wang, T. W., and X. D. Li. 2018. “Research on BIM Application Capability Evaluation Index System of Construction Enterprise.” Science and Technology Management Research 38 (6): 48–53.
  • Wong, H., and B. Q. Hu. 2013. “Application of Interval Clustering Approach to Water Quality Evaluation.” Journal of Hydrology 491: 1–12. doi:https://doi.org/10.1016/j.jhydrol.2013.03.009.
  • Wu, C., B. Xu, C. Mao, and X. Li. 2017. “Overview of BIM Maturity Measurement Tools.” Journal of Information Technology in Construction 22: 34–62. http://www.itcon.org/2017/3
  • Wu, X. L., and F. Hu. 2020. “Analysis of Ecological Carrying Capacity Using a Fuzzy Comprehensive Evaluation Method.” Ecological Indicators 113: 106243. doi:https://doi.org/10.1016/j.ecolind.2020.106243.
  • Xie, N. M., S. F. Liu, and H. B. Zhan. 2013. “On the Selection of International Cooperation Key-technology Projects Based on Grey Cluster Model.” In Proceedings of the IEEE International Conference on grey Systems and Intelligent services, Macau, Peoples R China, 366–370.
  • Yilmaz, G., A. Akcamete, and O. Demirors. 2019. “A Reference Model for BIM Capability Assessments.” Automation in Construction 101: 245–263. doi:https://doi.org/10.1016/j.autcon.2018.10.022.
  • Yilmaz, G., A. Akcamete-Gungo, and O. Demirors. 2017. “A Review on Capability and Maturity Models of Building Information Modelling.” In Lean and Computing in Construction Congress (LC3): Volume I-Proceedings of the Joint Conference on Computing in Construction (JC3), Heraklion, Greece, 627–636.
  • Yu, X. M. 2017. “Research on BIM Application Ability Evaluation System for Construction Enterprises.” Construction Technology 46 (12): 113–118.
  • Yuan, C. Q., and S. F. Liu. 2012. “Core of Grey Cluster and Its Application in Evaluation of Scientific and Technological Strength.” Journal of Grey System 24 (4): 327–336.
  • Zhou, W. J, Y. G. Dang, P. P. Xiong and H. S. Liu. 2013. “Grey Clustering Model for Interval Grey Number with Variable and Fixed Weight.” Systems Engineering-Theory & Practic 33 (10): 2590–2595.