1,055
Views
20
CrossRef citations to date
0
Altmetric
Research Paper

A new ChainMail approach for real-time soft tissue simulation

, , &
Pages 246-252 | Received 25 Jan 2016, Accepted 08 Apr 2016, Published online: 09 Jun 2016

ABSTRACT

This paper presents a new ChainMail method for real-time soft tissue simulation. This method enables the use of different material properties for chain elements to accommodate various materials. Based on the ChainMail bounding region, a new time-saving scheme is developed to improve computational efficiency for isotropic materials. The proposed method also conserves volume and strain energy. Experimental results demonstrate that the proposed ChainMail method can not only accommodate isotropic, anisotropic and heterogeneous materials but also model incompressibility and relaxation behaviors of soft tissues. Further, the proposed method can achieve real-time computational performance.

Introduction

Soft tissue simulation is a challenging research topic in the field of surgery simulation. Surgery simulation requires realistic and real-time modeling of tool-tissue interactions; however, it is difficult to meet both of these conflict requirements.Citation1 The literature on soft tissue deformation can be divided into 2 classes, with one focused on real-time capability such as mass-spring model (MSM) and the other focused on accurate deformation such as finite element method (FEM).Citation2, 3 The former is computationally efficient but does not allow accurate modeling of soft tissue material properties, whereas the latter is computationally extensive and formulations must be simplified to reduce runtime computation.Citation4 Various techniques have been reported to improve the computational performance of FEM. The matrix condensation reduces the computational time by confining the full computation of a volume mesh to the surface nodes; however, this simplification significantly reduces the simulation accuracy.Citation5 The pre-computation reduces the computational time based on a set of pre-computed spatial derivatives; however, it does not allow any changes on model topology.Citation6 The explicit total Lagrangian FEM reduces the computational load by eliminating iteratively solving a large system of equations; however, the solution is only stable under strictly small time steps due to the use of explicit time integration.Citation6-8 The GPU (Graphics Processing Unit) acceleration facilitates the computational performance of FEM; however, it relies on hardware and does not solve computational problem fundamentally.Citation9,10 In general, with most of the existing techniques in FEM, the improved computational performance is achieved by sacrificing the accuracy of FEM modeling.

ChainMail is a modeling method alternative to the above methods. The basic concept of this method is a chain element (mass point) enforces a bounding region for each of its neighboring chain elements to control their movements. The first ChainMail method, the 3D ChainMail, was proposed by Gibson for real-time soft tissue simulation.Citation11 This method has the significant advantage in computation and can handle topology change. It is also simple in implementation and stable in numerical iteration.Citation12 Although improvements on the ChainMail method have been studied, the method still lacks the capability of modeling soft tissues' incompressibility and relaxation behaviors due to the lack of volume and strain energy conservation.Citation13,14

This paper presents a new ChainMail method for real-time soft tissue simulation. The proposed ChainMail represents an alternative to the FEM for real-time soft tissue simulation. It can handle isotropic, anisotropic and heterogeneous materials by simply changing the material parameters of each chain element. A new time-saving scheme is developed for isotropic materials to improve the computational efficiency. The proposed ChainMail method also achieves the conservation of volume and strain energy for modeling the incompressibility and relaxation behaviors of soft tissues. Experiments and comparison analysis have been conducted to evaluate the performance of the proposed method.

Traditional ChainMail method

From the viewpoint of continuum mechanics, the ChainMail method is equivalent to a spring system. As shown in , a spring of length l0 at the rest state can be compressed to a minimum length of lmin and extended to a maximum length of lmax. Therefore, the movement of the spring is bounded within the minimum compression limit lmin and the maximum extension limit lmax.

Figure 1. The spring of rest length l0 with its minimum compression length lmin and maximum extension length lmax.

Figure 1. The spring of rest length l0 with its minimum compression length lmin and maximum extension length lmax.

Traditional ChainMail method, such as the 3D ChainMail and the Generalized ChainMail, employs ChainMail bounding regions (CBRs) to regulate the movements of chain elements in the object.Citation11,13As illustrated in , chain element Pj(xj,yj,zj) is moved to Pj*(xj,i*,yj,i*,zj,i*) while Pi(xi,yi,zi) is moved to Pi*(xi*,yi*,zi*). The CBRj,i for chain element Pj with respect to (w.r.t) the new position Pi* of chain element Pi in the Generalized ChainMail is given by Eq. (Equation1).

Figure 2. The CBRj,i, shown as the dashed bounding box, for chain element Pj w.r.t chain element Pi*.

Figure 2. The CBRj,i, shown as the dashed bounding box, for chain element Pj w.r.t chain element Pi*.
(1) CBRj,i={xj,i minxj,i*xj,i max;yj,iminyj,i*yj,i max;zj,i minzj,i*zj,i max}(1) where xj,i min and xj,i max are the minimum compression and maximum extension limits in the x axis, i.e.(2) xj,i min=xi*+(αminΔxj,iβ(Δyj,i+Δzj,i));xj,i max=xi*+(αmaxΔxj,i+β(Δyj,i+Δzj,i))(2) where αmin, αmax and β are material parameters, and Δxj,i, Δyj,i and Δzj,i are geometric distances between chain elements Pi and Pj w.r.t the x, y and z axes at the rest state, i.e., Δxj,i=|xjxi|. The limits in the other 2 directions (y and z) are expressed in a similar manner. As the 3 material parameters are constant throughout the entire volumetric object, the traditional ChainMail cannot model non-linear material properties such as anisotropy and inhomogeneity.

Proposed TSVE-ChainMail

A new ChainMail method named the TSVE-ChainMail, time-saving volume-energy conserved ChainMail, is presented. The TSVE-ChainMail can handle various material properties, improve computational efficiency for isotropic materials, and conserve objects' volume and strain energy.

New ChainMail bounding region

The limits xj,i min and xj,i max of the new CBRj,i in the proposed TSVE-ChainMail are defined as(3) xj,i min=xi*+(Δxj,iαi+αj2(Δxj,i+Δyj,i+Δzj,i))xj,i max=xi*+(Δxj,i+αi+αj2(Δxj,i+Δyj,i+Δzj,i))(3) where αi and αj are material parameters of chain elements Pi and Pj, and they are corresponded to the spring stiffness k. For isotropic materials (αi=αj=α), Eq. (Equation3) may be simplified to(4) xj,i min=xi*+((1α)Δxj,iα(Δyj,i+Δzj,i))xj,i max=xi*+((1+α)Δxj,i+α(Δyj,i+Δzj,i))(4)

Anisotropic and heterogeneous materials can be modeled by setting different parameters in different directions and regions respectively, which was unable to achieve with the traditional ChainMail.

Time saving scheme for isotropic materials

A time saving scheme (TSS) is developed for isotropic materials of constant material parameter α, where each chain element is considered only once in every iteration, leading to improved computational efficiency. Consider the 3 general cases of chain elements' movement illustrated in : Case (1) Following Pi's movement to Pi*, Pj and Pk are moved to Pj* and Pk* respectively (). Then Pj* and Pk* stay within their respective CBRs; Case (2) Following Pk's movement to Pk*, Pl is moved to Pl* (). Then Pj* and Pl* stay within their respective CBRs; Case (3) In addition to Pi, Pj, Pk and Pl's movements, Pn is moved to Pn* following Pi's movement to Pi*, whereas Pm is moved to Pm* following Pn's movement (). Then Pl* and Pm* stay within their respective CBRs.

Figure 3. The chain element Pi is moved to Pi* (blue arrow) while others follow its movement; the rest state is shown in black and the new positions are shown in red; the solid line indicates that the 2 elements are connected and one is moved directly w.r.t the other, whereas the dotted line indicates that the elements are connected but one is not moved w.r.t the other.

Figure 3. The chain element Pi is moved to Pi* (blue arrow) while others follow its movement; the rest state is shown in black and the new positions are shown in red; the solid line indicates that the 2 elements are connected and one is moved directly w.r.t the other, whereas the dotted line indicates that the elements are connected but one is not moved w.r.t the other.

[Proof of Case (1)] Case (1) will be verified if Pj*(xj,i*,yj,i*,zj,i*) stays within the CBRj,k w.r.t Pk*, and Pk* stays within the CBRk,j w.r.t Pj*. Since the exact positions of Pj* and Pk* are unknown, the maximum and minimum limits (2 limits), Pk,max*(xk,i max,yk,i max,zk,i max) and Pk,min*(xk,i min,yk,i min,zk,i min), are used for the verification of Case (1). Denote the CBRj,k at the 2 limits of Pk* by CBRj,k¯. Thus,(5) CBRj,k¯={xj,k min¯xj,i*xj,k max¯;yj,k min¯yj,i*yj,k max¯;zj,k min¯zj,i*zj,k max¯}(5)

Substituting xi*=xk,i min(1α)Δxk,i+α(Δyk,i+Δzk,i) into the lower limit xj,i*xj,i min=xi*+(1α)Δxj,iα(Δyj,i+Δzj,i) yields(6) xj,i*xk,i min(1α)Δxk,i+α(Δyk,i+Δzk,i)+(1α)Δxj,iα(Δyj,i+Δzj,i)(6)

Using the geometric distance Δxj,i=|xjxi|, Eq. (Equation6) may be simplified to(7) xj,i*xk,i min+(1α)Δxj,kα(Δyj,k+Δzj,k)=xj,k min¯(7)

A similar calculation can be made for xj,k max¯, yj,k min¯, yj,k max¯,zj,k min¯,zj,k max¯, and for CBRk,j. Therefore, it is demonstrated that Pj* stays within the CBRj,k w.r.t Pk*, and vice versa.

[Proof of Case (2)] Case (2) will be verified if Pl*(xl,k*,yl,k*,zl,k*) stays within the CBRl,j w.r.t Pj*, and Pj* stays within the CBRj,l w.r.t Pl*. Denote the CBRl,j at the 2 limits of Pj* by CBRl,j¯. Thus,(8) CBRl,j¯={xl,j min¯xl,k*xl,j max¯;yl,j min¯yl,k*yl,j max¯;zl,j min¯zl,k*zl,j max¯}(8)

Considering the lower limit xl,k*xl,k min=xk,i*+(1α)Δxl,kα(Δyl,k+Δzl,k). Substituting xk,i* by xk,i min=xj,k min¯(1α) Δxj,k+α(Δyj,k+Δzj,k) from Eq. (Equation7) yields(9) xl,k*xj,k min¯(1α)Δxj,k+α(Δyj,k+Δzj,k)+(1α)Δxl,kα(Δyl,k+Δzl,k)(9)

Using the geometric distance, Eq. (Equation9) may be simplified to(10) xl,k*xj,k min¯+(1α)Δxl,jα(Δyl,j+Δzl,j)(10)

Based on Eqs. (Equation1) and (Equation7), xj,i*xj,i min and  xj,i*xj,k min¯. At the lower limit of xj,i*, xj,k min¯=xj,i min,(11) xl,k*xj,i min+(1α)Δxl,jα(Δyl,j+Δzl,j)=xl,j min¯(11)

A similar calculation can be made for the other boundary limits, and for CBRj,l. Therefore, it is demonstrated that Pl* stays within the CBRl,j w.r.t Pj*, and vice versa.

[Proof of Case (3)] Case (3) will be verified if Pm*(xm,n*,ym,n*,zm,n*) stays within the CBRm,l w.r.t Pl*, and Pl* stays within the CBRl,m w.r.t Pm*. Denote the CBRl,m at the 2 limits of Pm* by CBRl,m¯. Thus,(12) CBRl,m¯={xl,m min¯xl,k*xl,m max¯;yl,m min¯yl,k*yl,m max¯;zl,m min¯zl,k*zl,m max¯}(12)

Substituting xj,i min=xm,j min¯(1α)Δxm,j+α(Δym,j+Δzm,j) in the lower limit given by Eq. (Equation11)(13) xl,k*xm,j min¯(1α)Δxm,j+α(Δym,j+Δzm,j)+(1α)Δxl,jα(Δyl,j+Δzl,j)(13)

Similar to xl,k*xl,j min¯ in Eq. (Equation11), xm,n*xm,j min¯. At lower limit of xm,n*, xm,j min¯=xm,n min. Thus,(14) xl,k*xm,n min+(1α)Δxl,mα(Δyl,m+Δzl,m)=xl,m min¯(14)

A similar calculation can be made for the other boundary limits, and for CBRm,l. Therefore, it is demonstrated that Pl* stays within the CBRl,m w.r.t Pm*, and vice versa. From the above, we can draw the following 3 remarks. For any 3 neighboring elements A, B and C,

[Remark 1] if A and B are moved w.r.t C, then A and B stay within their respective CBRs (Pi*, Pj* and Pk* in ).

[Remark 2] if only A is moved w.r.t C while B and C have been previously moved as per Remark 1, then A and B stay within their respective CBRs (Pj*, Pk* and Pl* in ).

[Remark 3] if A and C as well as B and C have been previously moved as per Remark 2, then A and B stay within their respective CBRs (Pj*, Pl* and Pm* in ).

The three remarks demonstrate that the chain elements always satisfy the CBRs w.r.t each other in isotropic materials. Hence, each chain element can be considered only once at each iteration, saving the computational time. It should be noted that boundary conditions can be enforced by specifying displacement values to chain elements at the boundary of the calculation domain.

Volume and strain energy conservation

Since most biological soft tissues are incompressible and there is a change in strain energy when a soft object is deformed by an external force, the conservation of volume and strain energy are introduced for accurate soft tissue simulation by adding an additional position adjustment ΔPi.Citation15 This position adjustment is derived based on the conditions of conservation of volume and energy.Citation16,17(15) ΔPi=wiC(P0,,Pn)j=14wj|PjC(P0,,Pn)|2PiC(P0,,Pn)(15) (16) C(P0,,Pn)=Cvolume(P0,P1,P2,P3)=16|(P1P0)·((P2P0)×(P3P0))|V0(16) (17) C(P0,,Pn)=Cenergy(P0,P1,P2,P3)=12i=03ki(PiPCli)2(17) where P0,P1,P2,P3 are the vertices of a tetrahedron, wi and wj are the inverse of masses of respective chain elements, V0 is the volume of the tetrahedron at rest state, PC is the barycenter of the tetrahedron, PiPC and li are the current and the rest length of PiPC, and ki is the stiffness of chain element Pi.

Implementation results and evaluations

A prototype surgery simulation system has been implemented with the proposed TSVE-ChainMail. Experiments have been conducted to evaluate the performance of the proposed method in terms of soft tissue material properties, computational time, volume conservation and strain energy conservation.

illustrates the deformation of isotropic, anisotropic and heterogeneous materials. The cubic model was deformed evenly for an isotropic material in , deformed more significantly in one direction than the others in , and deformed differently at different regions in .

Figure 4. Isotropic, anisotropic and heterogeneous deformations.

Figure 4. Isotropic, anisotropic and heterogeneous deformations.

The computational performance was evaluated on an Intel(R) Core(TM) i7-4700 [email protected] PC. Experiments were conducted under the same conditions to compare the timing performances with and without the use of TSS for isotropic materials. As illustrated in , the computational time with TSS was less than that without TSS for isotropic materials. A computational gain of 29.4% has been achieved for the real-time visual refresh rate (30Hz) in terms of the number of moving chain elements. The volume conservation has been achieved with the proposed ChainMail. As shown in , the proposed ChainMail conserved the object's volume considerably better than the traditional ChainMail, which had a significant volume loss after deformation. The volume change after deformation was 0.71% for the TSVE-ChainMail whereas it was 14.31% for the traditional ChainMail.

Figure 5. Computational time of the ChainMails with and without TSS for isotropic materials.

Figure 5. Computational time of the ChainMails with and without TSS for isotropic materials.

Figure 6. Comparison between the ChainMails in terms of volume conservation.

Figure 6. Comparison between the ChainMails in terms of volume conservation.

Interactive deformation of virtual human organs with force feedback has been achieved with the proposed method. illustrates the deformation process of a volumetric kidney model with a virtual probe. The strain energy conservation is presented in : the kidney model returned to its original state with the proposed ChainMail whereas the traditional ChainMail failed to do so. It was also noticed that a significant visual improvement has been achieved with the proposed method.

Figure 7. Comparison between the ChainMails in terms of strain energy conservation: the kidney model with the TSVE-ChainMail can return to its original state once the external force is released whereas the traditional ChainMail fails to do so.

Figure 7. Comparison between the ChainMails in terms of strain energy conservation: the kidney model with the TSVE-ChainMail can return to its original state once the external force is released whereas the traditional ChainMail fails to do so.

Conclusion

This paper presents a time-saving volume-energy conserved ChainMail method for real-time soft tissue simulation. This method allows different materials to be assigned to different chain elements to handle various material behaviors. A time-saving scheme is developed to improve computational efficiency for isotropic materials, and volume and strain energy conservation are proposed for realistic soft tissue deformation. Results demonstrate that the proposed method cannot only handle isotropic, anisotropic and heterogeneous materials but also model soft tissues' incompressibility and relaxation behaviors. The achieved performance is outperformed than that of the traditional ChainMail. Future research work will focus on extending the proposed method to model complex surgical operations.

Disclosure of Potential Conflicts of Interest

No potential conflicts of interest were disclosed.

References

  • Miller K. Computational Biomechanics for Patient-Specific Applications. Ann Biomed Eng 2016; 44:1-2; PMID:26620776; http://dx.doi.org/10.1007/s10439-015-1519-9.
  • Duan Y, Huang W, Chang H, Chen W, Zhou J, Teo SK, Su Y, Chui CK, Chang S. Volume Preserved Mass-Spring Model with Novel Constraints for Soft Tissue Deformation. IEEE J Biomed Health Inform 2016; 20:268-80; PMID:25398184; http://dx.doi.org/10.1109/JBHI.2014.2370059.
  • Freutel M, Schmidt H, Durselen L, Ignatius A, Galbusera F. Finite element modeling of soft tissues: Material models, tissue interaction and challenges. Clin Biomech 2014; 29:363-72; PMID:24529470; http://dx.doi.org/10.1016/j.clinbiomech.2014.01.006.
  • Yang C, Li S, Lan Y, Wang L, Hao A, Qin H. Coupling time-varying modal analysis and FEM for real-time cutting simulation of objects with multi-material sub-domains. Computer Aided Geometric Design 2016; 43:53-67; http://dx.doi.org/10.1016/j.cagd.2016.02.014.
  • Wu W, Heng PA. An improved scheme of an interactive finite element model for 3D soft-tissue cutting and deformation. The Visual Computer 2005; 21:707-16; http://dx.doi.org/10.1007/s00371-005-0310-6.
  • Miller K, Joldes G, Lance D, Wittek A. Total Lagrangian explicit dynamics finite element algorithm for computing soft tissue deformation. Communications in Numerical Methods in Engineering 2007; 23:121-34; http://dx.doi.org/10.1002/cnm.887.
  • Miller K, Wittek A, Joldes G, Horton A, Dutta-Roy T, Berger J, Morriss L. Modelling brain deformations for computer-integrated neurosurgery. International Journal for Numerical Methods in Biomedical Engineering 2010; 26:117-38; http://dx.doi.org/10.1002/cnm.1260.
  • Taylor ZA, Cheng M, Ourselin S. High-speed nonlinear finite element analysis for surgical simulation using graphics processing units. IEEE Trans Med Imaging 2008; 27:650-63; PMID:18450538; http://dx.doi.org/10.1109/TMI.2007.913112.
  • Faure F, Duriez C, Delingette H, Allard J, Gilles B, Marchesseau S, Talbot H, Courtecuisse H, Bousquet G, Peterlik I, et al. Sofa: A multi-model framework for interactive physical simulation. Soft Tissue Biomechanical Modeling for Computer Assisted Surgery. Springer, 2012:283-321.
  • Johnsen SF, Taylor ZA, Clarkson MJ, Hipwell J, Modat M, Eiben B, Han L, Hu Y, Mertzanidou T, Hawkes DJ, et al. NiftySim: A GPU-based nonlinear finite element package for simulation of soft tissue biomechanics. Int J Comput Assisted Radiol Surg 2015; 10:1077-95; PMID:25241111; http://dx.doi.org/10.1007/s11548-014-1118-5.
  • Frisken-Gibson SF. 3D ChainMail: a Fast Algorithm for Deforming Volumetric Objects. Proc Symposium on Interactive 3D graphics 1997:149-54.
  • Frisken-Gibson SF. Using linked volumes to model object collisions, deformation, cutting, carving, and joining. IEEE Transactions on Visualization and Computer Graphics 1999; 5:333-48; http://dx.doi.org/10.1109/2945.817350.
  • Li Y, Brodlie K. Soft Object Modelling with Generalised ChainMail - Extending the Boundaries of Web-based Graphics. Comput Graph Forum 2003; 22:717-27; http://dx.doi.org/10.1111/j.1467-8659.2003.00719.x.
  • Rodriguez A, Leon A, Arroyo G, Mantas JM. SP-ChainMail: a GPU-based sparse parallel ChainMail algorithm for deforming medical volumes. J Supercomput 2015; 71:3482-99; http://dx.doi.org/10.1007/s11227-015-1445-5.
  • Fung Y-C. Biomechanics: Mechanical Properties of Living Tissues. Springer-Verlag, 1993.
  • Bender J, Müller M, Otaduy MA, Teschner M, Macklin M. A Survey on Position-Based Simulation Methods in Computer Graphics. Comput Graph Forum 2014; 33:228-51; http://dx.doi.org/10.1111/cgf.12346.
  • Pan J, Bai J, Zhao X, Hao A, Qin H. Real-time haptic manipulation and cutting of hybrid soft tissue models by extended position-based dynamics. Computer Animation and Virtual Worlds 2015; 26:321-35; http://dx.doi.org/10.1002/cav.1655.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.