Emergence of informative higher scales in biological systems: a computational toolkit for optimal prediction and control

References

• Dolinski K , Troyanskaya OG. Implications of Big Data for cell biology. Mol Biol Cell. 2015;26(14):2575–2578.
   PubMed Web of Science ®Google Scholar
• Marx V. The big challenges of big data. Nature. 2013;498:255–260.
   PubMed Web of Science ®Google Scholar
• Altaf-Ul-Amin M , Afendi FM , Kiboi SK , et al. Systems biology in the context of big data and networks. Biomed Res Int. 2014;2014:1–11.
   Web of Science ®Google Scholar
• Bolouri H. Modeling genomic regulatory networks with big data. Trends Genet. 2014;30(5):182–191.
   PubMed Web of Science ®Google Scholar
• Zaitoun I , Downs KM , Rosa GJM , et al. Upregulation of imprinted genes in mice: an insight into the intensity of gene expression and the evolution of genomic imprinting. Epigenetics. 2010;5(2):149–158. .
   PubMed Web of Science ®Google Scholar
• Deisseroth K . Optogenetics. Nat Methods. 2011;8(1):26.
   PubMed Web of Science ®Google Scholar
• Sarasso S , Boly M , Napolitani M , et al. Consciousness and complexity during unresponsiveness induced by propofol, xenon, and ketamine. Curr Biol. 2015;25(23):3099–3105.
   PubMed Web of Science ®Google Scholar
• Grossman J , Mackenzie FJ . The randomized controlled trial: gold standard, or merely standard? Perspect Biol Med. 2005;48(4):516–534.
   PubMed Web of Science ®Google Scholar
• Adams DS , Levin M . Endogenous voltage gradients as mediators of cell-cell communication: strategies for investigating bioelectrical signals during pattern formation. Cell Tissue Res. 2013;352(1):95–122.
   PubMed Web of Science ®Google Scholar
• Levin M , Martyniuk CJ . The bioelectric code: an ancient computational medium for dynamic control of growth and form. Biosystems. 2018;164:76–93.
   PubMed Web of Science ®Google Scholar
• Rago C , Vogelstein B , Bunz F , et al. Genetic knockouts and knockins in human somatic cells. Nat Protoc. 2007;2(11):2734. .
   PubMed Web of Science ®Google Scholar
• Pearl J . Causality. Cambridge, England: Cambridge university press; 2009.
   Google Scholar
• Guelzim N , Bottani S , Bourgine P , et al. Topological and causal structure of the yeast transcriptional regulatory network. Nat Genet. 2002;31(1):60. .
   PubMed Web of Science ®Google Scholar
• Zitnik M , Feldman MW, Leskovec J. Evolution of resilience in protein interactomes across the tree of life. bioRxiv. 2019;454033.
   Google Scholar
• Cho H , Berger B , Peng J , et al. Reconstructing causal biological networks through active learning. PloS One. 2016;11(3):e0150611. .
   PubMed Web of Science ®Google Scholar
• Einstein A . Investigations on the theory of the Brownian Movement. Ann der Physik. 1905.
   Google Scholar
• Colquhoun D , Hawkes A . On the stochastic properties of single ion channels. Proc R Soc London. Ser B. Bio Sci. 1981;211(1183):205–235.
   PubMed Web of Science ®Google Scholar
• Başar E . Chaos in brain function: containing original chapters by E. Basar and TH Bullock and topical articles reprinted from the Springer series in brain dynamics. Germany: Springer Science & Business Media; 2012.
   Google Scholar
• Tononi G , Sporns O , Edelman GM , et al. Measures of degeneracy and redundancy in biological networks. Proc Nat Acad Sci. 1999;96(6):3257–3262.
   PubMed Web of Science ®Google Scholar
• Mueller S , Wang D , Fox M , et al. Individual variability in functional connectivity architecture of the human brain. Neuron. 2013;77(3):586–595.
   PubMed Web of Science ®Google Scholar
• Fasoli D , Cattani A , Panzeri S , et al. The complexity of dynamics in small neural circuits. PLoS Comput Biol. 2016;12(8):e1004992.
   PubMed Web of Science ®Google Scholar
• Okujeni S , Kandler S , Egert U , et al. Mesoscale architecture shapes initiation and richness of spontaneous network activity. J Neurosci. 2017;37(14):3972–3987.
   PubMed Web of Science ®Google Scholar
• Hoel EP , Albantakis L , Marshall W , et al. Can the macro beat the micro? Integrated information across spatiotemporal scales. Neurosci Conscious. 2016;2016(1):niw012.
   PubMedGoogle Scholar
• Cooper RP , Shallice T . Cognitive neuroscience: the troubled marriage of cognitive science and neuroscience. Top Cogn Sci. 2010;2(3):398–406.
   PubMed Web of Science ®Google Scholar
• Laubichler MD , Wagner GP . How molecular is molecular developmental biology? A reply to Alex Rosenberg’s reductionism redux: computing the embryo. Biol Philos. 2001;16(1):53–68.
   Web of Science ®Google Scholar
• Noble D . A theory of biological relativity: no privileged level of causation. Interface Focus. 2012;2(1):55–64.
   PubMed Web of Science ®Google Scholar
• Yuste R . From the neuron doctrine to neural networks. Nat Rev Neurosci. 2015;16(8):487–497.
   PubMed Web of Science ®Google Scholar
• Beloussov LV . The dynamic architecture of a developing organism: an interdisciplinary approach to the development of organisms [English]. Dordrecht, Netherlands: Kluwer Academic Publishers; 1998.
   Google Scholar
• Bizzarri M , Palombo A , Cucina A , et al. Theoretical aspects of systems biology. Prog Biophys Mol Biol. 2013;112(1–2):33–43.
   PubMed Web of Science ®Google Scholar
• Gilbert SF , Sarkar S . Embracing complexity: organicism for the 21st century. Dev Dyn. 2000;219(1):1–9.
   PubMed Web of Science ®Google Scholar
• Goodwin BC . How the leopard changed its spots: the evolution of complexity. New York: Charles Scribner’s Sons; 1994.
   Google Scholar
• Goodwin BC . The life of form. Emergent patterns of morphological transformation. Comptes rendus de l’Academie des sciences. Serie III, Sciences de la vie. 2000;323(1):15–21.
   PubMed Web of Science ®Google Scholar
• Kauffman S , Clayton P . On emergence, agency, and organization. Biol Philos. 2006;21(4):501–521.
   Web of Science ®Google Scholar
• Mossio M , Montévil M , Longo G , et al. Theoretical principles for biology: organization. Prog Biophys Mol Biol. 2016;122(1):24–35.
   PubMed Web of Science ®Google Scholar
• Soto AM , Sonnenschein C . Emergentism as a default: cancer as a problem of tissue organization. J Biosci. 2005;30(1):103–118.
   PubMed Web of Science ®Google Scholar
• Webster G , Goodwin BC . Form and transformation: generative and relational principles in biology. New York: Cambridge University Press; 1996.
   Google Scholar
• Anderson PW . More is different. Science. 1972;177(4047):393–396.
   PubMed Web of Science ®Google Scholar
• Ellis GF . Physics, complexity and causality. Nature. 2005;435(7043):743.
   PubMed Web of Science ®Google Scholar
• Kauffman SA . The origins of order: self-organization and selection in evolution. USA: OUP; 1993.
   Google Scholar
• Noble D . A theory of biological relativity: no privileged level of causation. Interface Focus. 2011;2(1):55–64.
   PubMed Web of Science ®Google Scholar
• Rozenblatt-Rosen O , Stubbington MJ , Regev A , et al. The human cell atlas: from vision to reality. Nat News. 2017;550(7677):451.
   PubMed Web of Science ®Google Scholar
• Clayton P , Davies P . The re-emergence of emergence. Oxford: Oxford University Press; 2006.
   Google Scholar
• Kim J . Mind in a physical world: an essay on the mind-body problem and mental causation. Cambridge, Massachusetts: MIT press; 2000.
   Google Scholar
• Herrera-Rincon C , Guay J, Levin M. Bioelectrical coordination of cell activity toward anatomical target states: an engineering perspective on regeneration. In: Gardiner DM , editor. Regenerative engineering and developmental biology: principles and applications. Boca Raton, FL: Taylor and Francis; 2017. p. 77–134.
   Google Scholar
• Chan CJ , Costanzo M , Ruiz-Herrero T , et al. Hydraulic control of mammalian embryo size and cell fate. Nature. 2019;571(7763):112–116.
   Web of Science ®Google Scholar
• Manicka S , Levin M . The cognitive lens: a primer on conceptual tools for analysing information processing in developmental and regenerative morphogenesis. Philos Trans R Soc Lond B Biol Sci. 2019;374(1774):20180369.
   PubMed Web of Science ®Google Scholar
• Hoel EP , Albantakis L , Tononi G , et al. Quantifying causal emergence shows that macro can beat micro. Proc Nat Acad Sci. 2013;110(49):19790–19795.
   PubMed Web of Science ®Google Scholar
• Klein B , Hoel E . The emergence of informative higher scales in complex networks. Complexity. 2020;2020:1–12.
   Web of Science ®Google Scholar
• Runge J , Nowack P , Kretschmer M , et al. Detecting and quantifying causal associations in large nonlinear time series datasets. Sci Adv. 2019;5(11):eaau4996.
   PubMed Web of Science ®Google Scholar
• Shannon CE . A mathematical theory of communication. Bell Syst Tech J. 1948;27(3):379–423.
   Google Scholar
• Bateson G . Steps to an ecology of mind: collected essays in anthropology, psychiatry, evolution, and epistemology. Chicago, IL: University of Chicago Press; 2000.
   Google Scholar
• Hoel E . When the map is better than the territory. Entropy. 2017;19(5):188.
   Web of Science ®Google Scholar
• Herrmann F , Groß A , Zhou D , et al. (2012). A boolean model of the cardiac gene regulatory network determining first and second heart field identity. PloS one. 2012;7(10):e46798.
   Google Scholar
• McInnes L , Healy J, Melville J. Umap: uniform manifold approximation and projection fordimension reduction. arXiv Preprint arXiv. 2018;1802:03426.
   Google Scholar
• Maaten LVD , Hinton G . Visualizing data using t-SNE. J Mach Learn Res. 2008;9(Nov):2579–2605.
   Google Scholar
• Griebenow R , Klein B, Hoel E. Finding the right scale of a network: efficient identification of causal emergence through spectral clustering. arXiv Preprint arXiv. 2019;1908:07565.
   Google Scholar
• Flach EH , Schnell S . Use and abuse of the quasi-steady-state approximation. IEE Proc Syst Biol. 2006;153(4):187–191.
   Google Scholar
• Ciliberto A , Capuani F , Tyson JJ , et al. Modeling networks of coupled enzymatic reactions using the total quasi-steady state approximation. PLoS Comput Biol. 2007;3(3):e45.
   PubMed Web of Science ®Google Scholar
• Balduzzi D , Tononi G . Integrated information in discrete dynamical systems: motivation and theoretical framework. PLoS Comput Biol. 2008;4(6):e1000091.
   PubMed Web of Science ®Google Scholar
• Helikar T , Bryan K, Sean M, et al. The cell collective: toward an open and collaborative approach to systems biology. BMC Syst Biol. 2012;6(1):96.
   PubMedGoogle Scholar
• Hoel E , Klein B, Swain A, et al. Evolution leads to emergence: an analysis of protein interactomes across the tree of life. bioRxiv. 2020.
   PubMedGoogle Scholar
• Shadmehr R , Smith MA , Krakauer JW , et al. Error correction, sensory prediction, and adaptation in motor control. Annu Rev Neurosci. 2010;33:89–108.
   PubMed Web of Science ®Google Scholar
• Pezzulo G , Levin M . Re-membering the body: applications of computational neuroscience to the top-down control of regeneration of limbs and other complex organs. Integr Biol (Camb). 2015;7(12):1487–1517.
   PubMed Web of Science ®Google Scholar
• Pezzulo G , Levin M . Top-down models in biology: explanation and control of complex living systems above the molecular level. J R Soc Interface. 2016;13(124):20160555.
   Web of Science ®Google Scholar
• Edelman GM , Gally JA . Degeneracy and complexity in biological systems. Proc Nat Acad Sci. 2001;98(24):13763–13768.
   PubMed Web of Science ®Google Scholar
• Longo G , Miquel PA, Sonnenschein C, et al. Is information a proper observable for biological organization? Prog Biophys Mol Biol. 2012;109(3):108–114.
   PubMed Web of Science ®Google Scholar
• Lizier JT . JIDT: an information-theoretic toolkit for studying the dynamics of complex systems. Front Rob AI. 2014;1(11). DOI:10.3389/frobt.2014.00011.
   Google Scholar
• Moore DG , Valentini G , Walker SI , et al. Inform: efficient information-theoretic analysis of collective behaviors. Front Rob AI. 2018;5(60). DOI:10.3389/frobt.2018.00060.
   PubMedGoogle Scholar
• Briscoe J , Small S . Morphogen rules: design principles of gradient-mediated embryo patterning. Development. 2015;142(23):3996–4009.
   PubMed Web of Science ®Google Scholar
• Moore D , Walker SI , Levin M , et al. Cancer as a disorder of patterning information: computational and biophysical perspectives on the cancer problem. Converg Sci Phys Oncol. 2017;3(4):043001.
   Web of Science ®Google Scholar
• Pietak A , Levin M . Exploring instructive physiological signaling with the Bioelectric Tissue Simulation Engine (BETSE). Front Bioeng Biotechnol. 2016;4. DOI:10.3389/fbioe.2016.00055.
   PubMed Web of Science ®Google Scholar
• Pietak A , Levin M . Bioelectric gene and reaction networks: computational modelling of genetic, biochemical and bioelectrical dynamics in pattern regulation. J R Soc Interface. 2017;14(134):20170425.
   PubMed Web of Science ®Google Scholar
• Lobo D , Levin M . Inferring regulatory networks from experimental morphological phenotypes: a computational method reverse-engineers planarian regeneration. PLoS Comput Biol. 2015;11(6):e1004295.
   PubMed Web of Science ®Google Scholar
• Pietak A , Bischof J , LaPalme J , et al. Neural control of body-plan axis in regenerating planaria. PLoS Comput Biol. 2019;15(4):e1006904.
   PubMed Web of Science ®Google Scholar
• Stuckemann T , Cleland JP , Werner S , et al. antagonistic self-organizing patterning systems control maintenance and regeneration of the anteroposterior axis in planarians. Dev Cell. 2017;40(3):248–263 e244.
   PubMed Web of Science ®Google Scholar
• Gammon K . Mathematical modelling: forecasting cancer. Nature. 2012;491(7425):S66–67.
   PubMed Web of Science ®Google Scholar
• Song Y , Wang Y , Tong C , et al. A unified model of the hierarchical and stochastic theories of gastric cancer. Br J Cancer. 2017;116(8):973–989.
   PubMed Web of Science ®Google Scholar
• Erson EZ , Cavusoglu MC . A software framework for multiscale and multilevel physiological model integration and simulation. Conf Proc Annu Int Conf IEEE Eng Med Biol Soc. IEEE Engineering in Medicine and Biology Society. Conference. 2008;2008:5449–5453.
   PubMedGoogle Scholar
• Hunter PJ , Crampin EJ , Nielsen PMF , et al. Bioinformatics, multiscale modeling and the IUPS Physiome Project. Brief Bioinform. 2008;9(4):333–343.
   PubMed Web of Science ®Google Scholar
• Noble D . Biophysics and systems biology. Philos Trans A Math Phys Eng Sci. 2010;368(1914):1125–1139.
   PubMed Web of Science ®Google Scholar
• Perret N , Longo G . Reductionist perspectives and the notion of information. Prog Biophys Mol Biol. 2016;122(1):11–15.
   PubMed Web of Science ®Google Scholar
• Marshall W , Albantakis L , Tononi G , et al. Black-boxing and cause-effect power. PLoS Comput Biol. 2018;14(4):e1006114.
   PubMed Web of Science ®Google Scholar
• Mayner WGP , Marshall W , Albantakis L , et al. PyPhi: A toolbox for integrated information theory. PLoS Comput Biol. 2018;14(7):e1006343.
   PubMed Web of Science ®Google Scholar