Analyzing Brain Morphology on the Bag-of-Features Manifold

Analyzing Brain Morphology on the Bag-of-Features Manifold

Chauvin, Laurent and Kumar, Kuldeep and Desrosiers, Christian and De Guise, Jacques and Wells, William and Toews, Matthew

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 2019

Abstract : We propose a novel distance measure between variable-sized sets of image features, i.e. the bag-of-features image representation, for quantifying brain morphology similarity based on local neuroanatomical structures. Our measure generalizes the Jaccard distance metric to account for probabilistic or soft set equivalence (SSE), via a novel adaptive kernel density framework accounting for probabilistic uncertainty in both feature appearance and geometry. The method is based on highly efficient keypoint feature indexing and is suitable for identifying pairwise relationships in arbitrarily large data sets. Experiments use the Human Connectome Project (HCP) dataset consisting of 1010 subjects, including pairs of siblings and twins, where neuroanatomy is modeled as a set of scale-invariant keypoints extracted from T1-weighted MRI data. The Jaccard distance based on (SSE) is shown to outperform standard hard set equivalence (HSE) in predicting the immediate family graph structure and genetic links such as racial origin and sex from MRI data, providing a useful tool for data-driven, high-throughput genome wide heritability analysis.