{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T21:40:16Z","timestamp":1721252416148},"reference-count":44,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2021,8,27]],"date-time":"2021-08-27T00:00:00Z","timestamp":1630022400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Symmetric positive definite (SPD) data have become a hot topic in machine learning. Instead of a linear Euclidean space, SPD data generally lie on a nonlinear Riemannian manifold. To get over the problems caused by the high data dimensionality, dimensionality reduction (DR) is a key subject for SPD data, where bilinear transformation plays a vital role. Because linear operations are not supported in nonlinear spaces such as Riemannian manifolds, directly performing Euclidean DR methods on SPD matrices is inadequate and difficult in complex models and optimization. An SPD data DR method based on Riemannian manifold tangent spaces and global isometry (RMTSISOM-SPDDR) is proposed in this research. The main contributions are listed: (1) Any Riemannian manifold tangent space is a Hilbert space isomorphic to a Euclidean space. Particularly for SPD manifolds, tangent spaces consist of symmetric matrices, which can greatly preserve the form and attributes of original SPD data. For this reason, RMTSISOM-SPDDR transfers the bilinear transformation from manifolds to tangent spaces. (2) By log transformation, original SPD data are mapped to the tangent space at the identity matrix under the affine invariant Riemannian metric (AIRM). In this way, the geodesic distance between original data and the identity matrix is equal to the Euclidean distance between corresponding tangent vector and the origin. (3) The bilinear transformation is further determined by the isometric criterion guaranteeing the geodesic distance on high-dimensional SPD manifold as close as possible to the Euclidean distance in the tangent space of low-dimensional SPD manifold. Then, we use it for the DR of original SPD data. Experiments on five commonly used datasets show that RMTSISOM-SPDDR is superior to five advanced SPD data DR algorithms.<\/jats:p>","DOI":"10.3390\/e23091117","type":"journal-article","created":{"date-parts":[[2021,8,30]],"date-time":"2021-08-30T01:45:16Z","timestamp":1630287916000},"page":"1117","source":"Crossref","is-referenced-by-count":2,"title":["Dimensionality Reduction of SPD Data Based on Riemannian Manifold Tangent Spaces and Isometry"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-7321-2977","authenticated-orcid":false,"given":"Wenxu","family":"Gao","sequence":"first","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-Sen University, Guangzhou 510006, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-6553-1070","authenticated-orcid":false,"given":"Zhengming","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-Sen University, Guangzhou 510006, China"}]},{"given":"Weichao","family":"Gan","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-Sen University, Guangzhou 510006, China"}]},{"given":"Shuyu","family":"Liu","sequence":"additional","affiliation":[{"name":"Public Experimental Teaching Center, Sun Yat-sen University, Guangzhou 510006, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2420","DOI":"10.1109\/TIP.2018.2804218","article-title":"Local Deep-Feature Alignment for Unsupervised Dimension Reduction","volume":"27","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1109\/TCYB.2015.2402751","article-title":"A Local Structural Descriptor for Image Matching via Normalized Graph Laplacian Embedding","volume":"46","author":"Tang","year":"2015","journal-title":"IEEE Trans. Cybern."},{"key":"ref_3","first-page":"202","article-title":"Synchronized Submanifold Embedding for Person-Independent Pose Estimation and Beyond","volume":"18","author":"Yan","year":"2008","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1787","DOI":"10.1109\/TNNLS.2016.2545400","article-title":"MR-NTD: Manifold Regularization Nonnegative Tucker Decomposition for Tensor Data Dimension Reduction and Representation","volume":"28","author":"Li","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1109\/TPAMI.2013.164","article-title":"Simultaneous Tensor Decomposition and Completion Using Factor Priors","volume":"36","author":"Chen","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/TMM.2016.2608780","article-title":"PLTD: Patch-Based Low-Rank Tensor Decomposition for Hyperspectral Images","volume":"19","author":"Du","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_7","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). Imagenet Classification with Deep Convolutional Neural Networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Huang, Z., and Gool, L.V. (2017, January 4\u20139). A riemannian network for SPD matrix learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.10866"},{"key":"ref_10","unstructured":"Huang, Z., Wang, R., Shan, S., Li, X., and Chen, X. (2015, January 6\u20131). Log-euclidean metric learning on symmetric positive definite manifold with application to image set classification. Proceedings of the 32nd International Conference on International Conference on Machine Learning, Lille, France."},{"key":"ref_11","unstructured":"Hussein, M.E., Torki, M., Gowayyed, M.A., and El-Saban, M. (2013, January 3\u20139). Human action recognition using a temporal hierarchy of covariance descriptors on 3D joint locations. Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence, Beijing, China."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Faraki, M., Harandi, M., and Porikli, F. (2016, January 7\u201310). Image set classification by symmetric positive semi-definite matrices. Proceedings of the 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477621"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s41095-018-0119-7","article-title":"Component SPD matrices: A low-dimensional discriminative data descriptor for image set classification","volume":"4","author":"Chen","year":"2018","journal-title":"Comput. Vis. Media"},{"key":"ref_14","unstructured":"Tuzel, O., Porikli, F., and Meer, P. (2019, January 23\u201328). Region Covariance: A Fast Descriptor for Detection and Classification. Proceedings of the Transactions on Petri Nets and Other Models of Concurrency XV, Aachen, Germany."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1713","DOI":"10.1109\/TPAMI.2008.75","article-title":"Pedestrian Detection via Classification on Riemannian Manifolds","volume":"30","author":"Tuzel","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Harandi, M., Sanderson, C., Hartley, R., and Lovell, B.C. (2012). Sparse Coding and Dictionary Learning for Symmetric Positive Definite Matrices: A Kernel Approach. Transactions on Petri Nets and Other Models of Concurrency XV, Springer.","DOI":"10.1007\/978-3-642-33709-3_16"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Jayasumana, S., Hartley, R., Salzmann, M., Li, H., and Harandi, M. (2013, January 23\u201328). Kernel Methods on the Riemannian Manifold of Symmetric Positive Definite Matrices. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.17"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Harandi, M., Salzmann, M., and Hartley, R. (2014). From Manifold to Manifold: Geometry-Aware Dimensionality Reduction for SPD Matrices. Proceedings of the Transactions on Petri Nets and Other Models of Concurrency XV, Springer Science and Business Media LLC.","DOI":"10.1007\/978-3-319-10605-2_2"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1137\/050637996","article-title":"Geometric Means in a Novel Vector Space Structure on Symmetric Positive-Definite Matrices","volume":"29","author":"Arsigny","year":"2007","journal-title":"SIAM J. Matrix Anal. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ilea, I., Bombrun, L.B., Said, S., and Berthoumieu, Y. (2018, January 18\u201322). Covariance Matrices Encoding Based on the Log-Euclidean and Affine In-variant Riemannian Metrics. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00080"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, P., Wang, Q., Zuo, W., and Zhang, L. (2013). Log-Euclidean Kernels for Sparse Representation and Dictionary Learning. Proceedings of the 2013 IEEE International Conference on Computer Vision, Institute of Electrical and Electronics Engineers (IEEE).","DOI":"10.1109\/ICCV.2013.202"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yamin, A., Dayan, M., Squarcina, L., Brambilla, P., Murino, V., Diwadkar, V., and Sona, D. (2019). Comparison Of Brain Connectomes Using Geodesic Distance On Manifold: A Twins Study. Proceedings of the 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), Institute of Electrical and Electronics Engineers (IEEE).","DOI":"10.1109\/ISBI.2019.8759407"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1109\/TNNLS.2015.2435154","article-title":"Learning Discriminative Stein Kernel for SPD Matrices and Its Applications","volume":"27","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, R., Wu, X.-J., Chen, K.-X., and Kittler, J. (2018). Multiple Manifolds Metric Learning with Application to Image Set Classification. Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Institute of Electrical and Electronics Engineers (IEEE).","DOI":"10.1109\/ICPR.2018.8546030"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2827","DOI":"10.1109\/TPAMI.2017.2776154","article-title":"Cross Euclidean-to-Riemannian Metric Learning with Application to Face Recognition from Video","volume":"40","author":"Huang","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Vemulapalli, R., Pillai, J.K., and Chellappa, R. (2013). Kernel Learning for Extrinsic Classification of Manifold Features. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2013.233"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sanin, A., Sanderson, C., Harandi, M.T., and Lovell, B.C. (2013, January 15\u201317). Spatio-temporal covariance descriptors for action and gesture recogni-tion. Proceedings of the 2013 IEEE Workshop on Applications of Computer Vision (WACV), Washington, DC, USA.","DOI":"10.1109\/WACV.2013.6475006"},{"key":"ref_28","unstructured":"Vemulapalli, R., and Jacobs, D. (2015). Riemannian Metric Learning for Symmetric Positive Definite Matrices. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhou, L., Wang, L., Zhang, J., Shi, Y., and Gao, Y. (2017). Revisiting Metric Learning for SPD Matrix Based Visual Representation. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Institute of Electrical and Electronics Engineers (IEEE).","DOI":"10.1109\/CVPR.2017.752"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Dong, Z., Jia, S., Zhang, C., Pei, M., and Wu, Y. (2017, January 4\u20139). Deep manifold learning of symmetric positive definite matrices with application to face recognition. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11232"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wang, H., Banerjee, A., and Boley, D. (2011, January 21\u201324). Common component analysis for multiple covariance matrices. Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining\u2014KDD \u201911, San Diego, CA, USA.","DOI":"10.1145\/2020408.2020565"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1109\/TPAMI.2017.2655048","article-title":"Dimensionality Reduction on SPD Manifolds: The Emergence of Geometry-Aware Methods","volume":"40","author":"Harandi","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1007\/s11263-005-4939-z","article-title":"Unsupervised Learning of Image Manifolds by Semidefinite Programming","volume":"70","author":"Weinberger","year":"2006","journal-title":"Int. J. Comput. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"153881","DOI":"10.1109\/ACCESS.2020.3017234","article-title":"Probability Distribution-Based Dimensionality Reduction on Riemannian Manifold of SPD Matrices","volume":"8","author":"Ren","year":"2020","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"75","DOI":"10.2307\/3617970","article-title":"Multivariate analysis, by K. V. Mardia, J.T. Kent and J. M. Bibby. Pp 522. \u00a314\u00b760. 1979. ISBN 0 12 471252 5 (Academic Press)","volume":"65","author":"Grey","year":"1981","journal-title":"Math. Gaz."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3230","DOI":"10.1109\/TNNLS.2019.2939177","article-title":"A Robust Distance Measure for Similarity-Based Classification on the SPD Manifold","volume":"31","author":"Gao","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_37","first-page":"1","article-title":"Discriminant Analysis on Riemannian Manifold of Gaussian Distributions for Face Recognition with Image Sets","volume":"27","author":"Wang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1576","DOI":"10.1109\/TCSVT.2015.2392472","article-title":"Discriminative Analysis for Symmetric Positive Definite Matrices on Lie Groups","volume":"25","author":"Xu","year":"2015","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_39","unstructured":"M\u00fcller, M., R\u00f6der, T., Clausen, M., Eberhardt, B., Kr\u00fcger, B., and Weber, A. (2021, August 23). Documentation Mocap Database HDM05. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/summary?doi=10.1.1.71.7245."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1109\/CVPR.2005.279","article-title":"Probabilistic Kernels for the Classification of Auto-Regressive Visual Processes","volume":"Volume 841","author":"Chan","year":"2005","journal-title":"Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905)"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Harandi, M., Salzmann, M., and Baktashmotlagh, M. Beyond Gauss: Image-Set Matching on the Riemannian Manifold of PDFs. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV).","DOI":"10.1109\/ICCV.2015.468"},{"key":"ref_42","unstructured":"Li, Y., Wang, R., Shan, S., and Chen, X. (2015, January 4\u20138). Hierarchical hybrid statistic based video binary code and its application to face retrieval in TV-series. Proceedings of the 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Ljubljana, Slovenia."},{"key":"ref_43","unstructured":"Leibe, B., and Schiele, B. (2003, January 18\u201320). Analyzing appearance and contour based methods for object categorization. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, Wisconsin."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1059","DOI":"10.2307\/2311954","article-title":"Introduction to Differentiable Manifolds","volume":"71","author":"Munkres","year":"1964","journal-title":"Am. Math. Mon."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/9\/1117\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T21:19:37Z","timestamp":1721251177000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/9\/1117"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,27]]},"references-count":44,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["e23091117"],"URL":"https:\/\/doi.org\/10.3390\/e23091117","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,27]]}}}  <script>parent.window.postMessage('ixistenz.url:https://api.crossref.org/works/10.3390%2FE23091117', '*'); </script> <div id='browserdiffcontainer' style='position: fixed; right: 10px; top: 10vh; min-width: 60px;  border: 1px solid white; background: rgb(251, 189, 0);; opacity: 0.9; font-family: helvetica, arial, sans serif;  font-size: 12px; z-index: 20001; padding-bottom: 20px;'><div onclick="toggle('browserdiffcontainerlist'); return false;" style='background: rgb(151, 89, 0);; color: white; '><strong>&nbsp; <span class='glyphicon glyphicon-minus'></span> NODES</strong></div><div id='browserdiffcontainerlist' style='padding-left: 10px; padding-right: 5px; max-height: 50vh; overflow: auto; '><div><a href='#diffid884' style='color: white;' onClick="parent.window.postMessage('ixistenz.opendiff:884', '*');; return false;" style='text-decoration: none; '>Idea </a> <a style='color: white;' href='#diffid884'><sup>9</sup></a></div><div><a href='#diffid119' style='color: white;' onClick="parent.window.postMessage('ixistenz.opendiff:119', '*');; return false;" style='text-decoration: none; '>idea </a> <a style='color: white;' href='#diffid119'><sup>9</sup></a></div><div><a href='#diffid123' style='color: white;' onClick="parent.window.postMessage('ixistenz.opendiff:123', '*');; return false;" style='text-decoration: none; '>INTERN </a> <a style='color: white;' href='#diffid123'><sup>9</sup></a></div></div></div>
<script>
function toggle( divname ) {
  var x = document.getElementById( divname );
  if (x.style.display === 'none') {
    x.style.display = 'block';
  } else {
    x.style.display = 'none';
  }
} </script>