Abstract
Functional magnetic resonance imaging a neuroimaging technique which is used in brain disorders and dysfunction studies, has been improved in recent years by mapping the topology of the brain connections, named connectopic mapping. Based on the fact that healthy and unhealthy brain regions and functions differ slightly, studying the complex topology of the functional and structural networks in the human brain is too complicated considering the growth of evaluation measures. One of the applications of irregular graph deep learning is to analyze the human cognitive functions related to the gene expression and related distributed spatial patterns. Since a variety of brain solutions can be dynamically held in the neuronal networks of the brain with different activity patterns and functional connectivity, both node-centric and graph-centric tasks are involved in this application. In this study, we used an individual generative model and high order graph analysis for the region of interest recognition areas of the brain with abnormal connection during performing certain tasks and resting-state or decompose irregular observations. Accordingly, a high order framework of Variational Graph Autoencoder with a Gaussian distributer was proposed in the paper to analyze the functional data in brain imaging studies in which Generative Adversarial Network is employed for optimizing the latent space in the process of learning strong non-rigid graphs among large scale data. Furthermore, the possible modes of correlations were distinguished in abnormal brain connections. Our goal was to find the degree of correlation between the affected regions and their simultaneous occurrence over time. We can take advantage of this to diagnose brain diseases or show the ability of the nervous system to modify brain topology at all angles and brain plasticity according to input stimuli. In this study, we particularly focused on Alzheimer’s disease.
Acknowledgement
The authors gratefully acknowledge the assistance provided by the Medical Genetic Lab, Iranian Comprehensive Hemophilia Care Center (ICHCC).
Author contribution: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Research funding: None declared.
Employment or leadership: None declared.
Honorarium: None declared.
Conflict of interest statement: The authors declare no conflicts of interest regarding this article.
References
Agosta, F., Pievani, M., Geroldi, C., Copetti, M., Frisoni, G.B., and Filippi, M. (2012). Resting state fMRI in Alzheimer’s disease: beyond the default mode network. Neurobiol. Aging 33: 1564–1578, https://doi.org/10.1016/j.neurobiolaging.2011.06.007.Search in Google Scholar PubMed
Bi, X.A., Jiang, Q., Sun, Q., Shu, Q., and Liu, Y. (2018). Analysis of Alzheimer’s disease based on the random neural network cluster in fMRI. Front. Neuroinform. 12: 60, https://doi.org/10.3389/fninf.2018.00060.Search in Google Scholar PubMed PubMed Central
Bi, X., Shu, Q., Sun, Q., and Xu, Q. (2018). Random support vector machine cluster analysis of resting-state fMRI in Alzheimer’s disease. PLoS One 13: e0194479, https://doi.org/10.1371/journal.pone.0194479.Search in Google Scholar PubMed PubMed Central
Boscaini, D., Masci, J., Rodolà, E., and Bronstein, M. (2016). Learning shape correspondence with anisotropic convolutional neural networks. In: Advances in neural information processing systems, pp. 3189–3197.Search in Google Scholar
Bronstein, M.M., Bruna, J., LeCun, Y., Szlam, A., and Vandergheynst, P. (2017). Geometric deep learning: going beyond Euclidean data. IEEE Signal Process. Mag. 34: 8–42, https://doi.org/10.1109/MSP.2017.2693418.Search in Google Scholar
Bruna, J., Zaremba, W., Szlam, A., and Lecun, Y. (2014). Spectral networks and locally connected networks on graphs. In: International conference on learning representations (ICLR2014). CBLS.Search in Google Scholar
Calhoun, V.D., Miller, R., Pearlson, G., and Adali, T. (2014). The chronnectome: time-varying connectivity networks as the next Frontier in fMRI data discovery. Neuron 84: 262–274, https://doi.org/10.1016/j.neuron.2014.10.015.Search in Google Scholar PubMed PubMed Central
Challis, E., Hurley, P., Serra, L., Bozzali, M., Oliver, S., and Cercignani, M. (2015). Gaussian process classification of Alzheimer’s disease and mild cognitive impairment from resting-state fMRI. NeuroImage 112: 232–243, https://doi.org/10.1016/j.neuroimage.2015.02.037.Search in Google Scholar PubMed
Chen, S., Huang, L., Qiu, H., Nebel, M.B., Mostofsky, S.H., Pekar, J.J., Lindquist, M.A., Eloyan, A., and Caffo, B.S. (2017). Parallel group independent component analysis for massive fMRI data sets. PLoS One 12: e0173496, https://doi.org/10.1371/journal.pone.0173496.Search in Google Scholar PubMed PubMed Central
Choi, H. and Jin, K.H. (2018). Predicting cognitive decline with deep learning of brain metabolism and amyloid imaging. Behav. Brain Res. 344: 103–109, https://doi.org/10.1016/j.bbr.2018.02.017.Search in Google Scholar PubMed
Dai, Q., Li, Q., Tang, J., and Wang, D. (2018). Adversarial network embedding. In: AAAI, pp. 2167–2174.10.1609/aaai.v32i1.11865Search in Google Scholar
de Vos, F., Koini, M., Schouten, T.M., Seiler, S., van der Grond, J., Lechner, A., Schmidt, R., de Rooij, M., and Rombouts, S.A. (2018). A comprehensive analysis of resting state fMRI measures to classify individual patients with Alzheimer’s disease. NeuroImage 167: 62–72, https://doi.org/10.1016/j.neuroimage.2017.11.025.Search in Google Scholar PubMed
Defferrard, M., Bresson, X., and Vandergheynst, P. (2016).Convolutional neural networks on graphs with fast localized spectral filtering. In: NIPS, pp. 3844–3852.Search in Google Scholar
Gao, H., Wang, Z., and Ji, S. (2018). Large-scale learnable graph convolutional networks. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp. 1416–1424.10.1145/3219819.3219947Search in Google Scholar
Grover, A. and Leskovec, J. (2016). node2vec: scalable feature learning for networks. In: ACM SIGKDD international conference on knowledge discovery and data mining.10.1145/2939672.2939754Search in Google Scholar PubMed PubMed Central
Hamilton, W., Ying, Z., and Leskovec, J. (2017). Inductive representation learning on large graphs. In: Advances in neural information processing systems. pp. 1024–1034.Search in Google Scholar
Henaff, M., Bruna, J., and LeCun, Y. (2015). Deep convolutional networks on graph-structured data. https://arxiv.org/abs/1506.05163.Search in Google Scholar
Hojjati, S.H., Ebrahimzadeh, A., Khazaee, A., and Babajani-Feremi, A. (2017). Predicting conversion from MCI to AD using resting-state fMRI, graph theoretical approach and SVM. J. Neurosci. Methods 282: 69–80, https://doi.org/10.1016/j.jneumeth.2017.03.006.Search in Google Scholar PubMed
Hutchison, R.M., Womelsdorf, T., Allen, E.A., Bandettini, P.A., Calhoun, V.D., Corbetta, M., Della Penna, S., Duyn, J.H., Glover, G.H., Gonzalez-Castillo, J., et al. (2013). Dynamic functional connectivity: promise, issues, and interpretations. Neuroimage 80: 360–378, https://doi.org/10.1016/j.neuroimage.2013.05.079.Search in Google Scholar PubMed PubMed Central
Ioffe, S. and Szegedy, C. (2015). Batch normalization: accelerating deep network training by reducing internal covariate shift. In: JMLR, 2015.Search in Google Scholar
Johnson, D.D. (2017). Learning graphical state transitions. In: 5th International conference on learning representations. ICLR.Search in Google Scholar
Khazaee, A., Ebrahimzadeh, A., and Babajani-Feremi, A. (2017). Alzheimer’s disease neuroimaging initiative (2017) classification of patients with MCI and AD from healthy controls using directed graph measures of resting-state fMRI. Behav. Brain Res. 322: 339–350, https://doi.org/10.1016/j.bbr.2016.06.043.Search in Google Scholar PubMed
Kingma, D.P. and Ba, J. (2014). Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980.Search in Google Scholar
Kingma, D.P. and Welling, M. (2014). Auto-encoding variational Bayes. In: International conference for learning representations.Search in Google Scholar
Kipf, T.N. and Welling, M. (2016). Variational graph auto-encoders. In: NeurIPS workshop on Bayesian deep learning.Search in Google Scholar
Kipf, N. and Welling, M. (2017). Semi-supervised classification with graph convolutional networks. In: International conference on learning representations (ICLR).Search in Google Scholar
Klokov, R. and Lempitsky, V. (2017). Escape from cells: deep Kd-Networks for the recognition of 3D point cloud models. In: IEEE international conference on computer vision (ICCV).10.1109/ICCV.2017.99Search in Google Scholar
Lan, S., Holbrook, A., Elias, G.A., Fortin, N., Ombao, H., and Shahbaba, B. (2019). Flexible Bayesian dynamic modeling of correlation and covariance matrices. Bayesian Anal. Advance Publication. 1–30. https://doi.org/10.1214/19-BA1173.Search in Google Scholar
Larsen, A.B.L., Sønderby, S.K., Larochelle, H., and Winther, O. (2016). Autoencoding beyond pixels using a learned similarity metric. In: ICML.Search in Google Scholar
Le-Huu, D.K. and Paragios, N. (2017). Alternating direction graph matching. In: CVPR.10.1109/CVPR.2017.522Search in Google Scholar
Levie, R., Monti, F., Bresson, X., and Bronstein, M. (2019). Cayleynets: graph convolutional neural networks with complex rational spectral filters. IEEE Trans. Sig. Process. 67: 97–109, https://doi.org/10.1109/TSP.2018.2879624.Search in Google Scholar
Li, W., Zhao, Y., Chen, X., Xiao, Y., and Qin, Y. (2019). Detecting Alzheimer’s disease on small dataset: a knowledge transfer perspective. IEEE J. Biomed. Health Inform. 1234–1242. https://doi.org/10.1109/JBHI.2018.2839771.Search in Google Scholar PubMed
Liu, M., Cheng, D., Wang, K., and Wang, Y. (2018). Multi-modality cascaded convolutional neural networks for Alzheimer’s disease diagnosis. Neuroinformatics 16: 295–308. https://doi.org/10.1007/s12021-018-9370-4.Search in Google Scholar PubMed
Makhzani, A., Shlens, J., Jaitly, N., Goodfellow, I., and Frey, B. (2015). Adversarial autoencoders. arXiv preprint arXiv:1511.05644.Search in Google Scholar
Mirakhorli, J., and Amindavar, H. (2017). Semi-supervised hierarchical semantic object parsing. In: IEEE conference on signal processing and intelligent systems, https://doi.org/10.1109/ICSPIS.2017.8311588.Search in Google Scholar
Monti, F., Boscaini, D., Masci, J., Rodola, E., Svoboda, J., and Bronstein, M. (2017). Geometric deep learning on graphs and manifolds using mixture model cnns. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 5115–5124, https://doi.org/10.1109/CVPR.2017.576.Search in Google Scholar
Niepert, M., Ahmed, M., and Kutzkov, K. (2016). Learning convolutional neural networks for graphs. In: Proceedings of ICML, pp. 2014–2023.Search in Google Scholar
Pan, S., Hu, R., Long, G., Jiang, J.F., Yao, L., and Zhang, C. (2018). Adversarially regularized graph autoencoder for graph embedding. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp. 2609–2615, https://doi.org/10.24963/ijcai.2018/362.Search in Google Scholar
Payan, A. and Montana, G. (2015). Predicting Alzheimer’s disease: a neuroimaging study with 3D convolutional neural networks. CoRR, https://doi.org/1502.02506.Search in Google Scholar
Rolls, E.T., Joliot, M., and Tzourio-Mazoyer, N. (2015). Implementation of a new parcellation of the orbitofrontal cortex in the automated anatomical labeling Atlas. Neuroimage 122: 1–5, https://doi.org/10.1016/j.neuroimage.2015.07.075.Search in Google Scholar PubMed
Sarraf, S. and Tofghi, G. (2016). Classification of Alzheimer’s disease structural MRI data by deep learning convolutional neural networks. https://arxiv.org/abs/1603.08631.Search in Google Scholar
Seiler, C. and Holmes, S. (2017). Multivariate heteroscedasticity models for functional brain connectivity. Front Neurosci. 11: 696. https://doi.org/10.3389/fnins.2017.00696.Search in Google Scholar PubMed PubMed Central
Seiler, S., Schmidt, H., Lechner, A., Benke, T, Sanin, G., Ransmayr, G., Lehner, R., DalBianco, P., Uranues, M., Marksteiner, J., et al. (2012). Driving cessation and dementia: results of the prospective registry on dementia in Austria (PRODEM). PLoS One 7. https://doi.org/10.1371/journal.pone.0052710. 23300746.Search in Google Scholar PubMed PubMed Central
Simonovsky, M. and Komodakis, N. (2018). GraphVAE: towards generation of small graphs using variational autoencoders. In: International conference on artificial neural networks (ICANN), https://doi.org/10.1007/978-3-030-01418-6_41.Search in Google Scholar
Sinha, A., Bai, J., and Ramani, K. (2016). Deep learning 3D shape surfaces using geometry images. In: European conference on computer vision, pp. 223–240, https://doi.org/10.1007/978-3-319-46466-4_14.Search in Google Scholar
Sperling, R. (2011). The potential of functional MRI as a biomarker in early Alzheimer's disease. Neurobiol. Aging 32: 37–43. https://doi.org/10.1016/j.neurobiolaging.2011.09.009.Search in Google Scholar PubMed PubMed Central
Such, F.P., Sah, S., Dominguez, M.A., Pillai, S., Zhang, C., Michael, A., and Cahill, N.D., Ptucha, R. (2017). Robust spatial filtering with graph convolutional neural networks. IEEE J. Sel. Top. Sig. Process 11: 884–896, https://doi.org/10.1109/JSTSP.2017.2726981.Search in Google Scholar
Sun, J., Yan, S., Song, C., and Baosan, H. (2020). Dual-functional neural network for bilateral hippocampi segmentation and diagnosis of Alzheimer’s disease. Int. J. Comput. Assist. Radiol. Surg. 445–455. https://doi.org/10.1007/s11548-019-02106-w.31883064.Search in Google Scholar
Tong, T., Gao, Q., Guerrero, R., Ledig, C., Chen, L., and Rueckert, D. (2017). A novel grading biomarker for the prediction of conversion from mild cognitive impairment to Alzheimer’s disease. IEEE Trans. Biomed. Eng. 64: 155–165, https://doi.org/10.1109/TBME.2016.2549363.Search in Google Scholar PubMed
Verma, N., Boyer, E., and Verbeek, J. (2018). FeaStNet: feature-steered graph convolutions for 3D shape analysis. In: IEEE/CVF conference on computer vision and pattern recognition, Salt Lake City, UT, 2018, pp. 2598–2606, https://doi.org/10.1109/CVPR.2018.00275.Search in Google Scholar
Wang, F., Xue, N., Zhang, Y., Bai, X., and Xia, G.S. (2018). Adaptively transforming graph matching. In: Computer Vision – ECCV.10.1007/978-3-030-01270-0_38Search in Google Scholar
Wang, H., Wang, J., Wang, J., Zhao, M., Zhang, W., Zhang, F., Xie, X., and Guo, M. (2018). GraphGan: graph representation learning with generative adversarial nets. In: AAAI, pp. 2508–2515.10.1609/aaai.v32i1.11872Search in Google Scholar
Wang, W., Tang, M., and Jiao, P. (2018). A unified framework for link prediction based on non-negative matrix factorization with coupling multivariate information. PLoS One 13: e0208185, https://doi.org/10.1371/journal.pone.0208185.Search in Google Scholar PubMed PubMed Central
Wang, F., Xue, N., Zhang, Y., Xia, G., and Pelillo, M. (2019). A functional representation for graph matching. In: IEEE transactions on pattern analysis and machine intelligence. https://doi.org/10.1109/TPAMI.2019.2919308.Search in Google Scholar PubMed
Wu, J., Zhang, C., Xue, T., Freeman, B., and Tenenbaum, J. (2016). Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling. In: Advances in neural information processing systems. NIPS, pp. 82–90.Search in Google Scholar
Xu, J. and Durrett, G. (2018). Spherical latent spaces for stable variational autoencoders. arxiv:1808.10805.10.18653/v1/D18-1480Search in Google Scholar
Xu, D., Zhu, Y., Choy, C.B., and Fei-Fei, L. (2017). Scene graph generation by iterative message passing. In: IEEE conference on computer vision and pattern recognition (CVPR), https://doi.org/10.1109/CVPR.2017.330.Search in Google Scholar
Yan, J., Li, C., Li, Y., and Cao, G. (2018). Adaptive discrete hypergraph matching. IEEE Trans. Cybern. 48: 765–779, https://doi.org/10.1109/TCYB.2017.2655538.Search in Google Scholar PubMed
Young, J., Modat, M., Cardoso, M.J., Mendelson, A., Cash, D., and Ourselin, S. (2013). Accurate multimodal probabilistic prediction of conversion to Alzheimer’s disease in patients with mild cognitive impairment. NeuroImage Clin. 2: 735–745, https://doi.org/10.1016/j.nicl.2013.05.004.Search in Google Scholar PubMed PubMed Central
Yu, J.G., Xia, G.S., Samal, A., and Tian, J. (2016). Globally consistent correspondence of multiple feature sets using proximal gausseidel relaxation. Pattern Recogn. 51: 255–267, https://doi.org/10.1016/j.patcog.2015.09.029.Search in Google Scholar
Yu, W., Zheng, C., Cheng, W., Aggarwal, C.C., Song, D., Zong, B., Chen, H., and Wang, W. (2018). Learning deep network representations with adversarially regularized autoencoders. In: SIGKDD. 2663–2671.10.1145/3219819.3220000Search in Google Scholar
© 2020 Walter de Gruyter GmbH, Berlin/Boston
