The cortical integration of auditory and visual features is crucial for efficient object recognition. Previous studies have shown that audiovisual (AV) integration is affected by where and when auditory and visual features occur. However, because relatively little is known about the impact of what is integrated, we here investigated the impact of semantic congruency and object familiarity on the neural correlates of AV integration. We used functional magnetic resonance imaging to identify regions involved in the integration of both (congruent and incongruent) familiar animal sounds and images and of arbitrary combinations of unfamiliar artificial sounds and object images. Unfamiliar object images and sounds were integrated in the inferior frontal cortex (IFC), possibly reflecting learning of novel AV associations. Integration of familiar, but semantically incongruent combinations also correlated with IFC activation and additionally involved the posterior superior temporal sulcus (pSTS). For highly familiar semantically congruent AV pairings, we again found AV integration effects in pSTS and additionally in superior temporal gyrus. These findings demonstrate that the neural correlates of objectrelated AV integration reflect both semantic congruency and familiarity of the integrated sounds and images.

No abstract

Context-Current behavioral measures poorly predict treatment outcome in social anxiety disorder (SAD). To our knowledge, this is the first study to examine neuroimaging-based treatment prediction in SAD.Objective-To measure brain activation in patients with SAD as a biomarker to predict subsequent response to cognitive behavioral therapy (CBT).Design-Functional magnetic resonance imaging (fMRI) data were collected prior to CBT intervention. Changes in clinical status were regressed on brain responses and tested for selectivity for social stimuli.

We asked whether brain connectomics can predict response to treatment for a neuropsychiatric disorder better than conventional clinical measures. Pre-treatment resting-state brain functional connectivity and diffusion-weighted structural connectivity were measured in 38 patients with social anxiety disorder (SAD) to predict subsequent treatment response to cognitive behavioral therapy (CBT). We used a priori bilateral anatomical amygdala seed-driven resting connectivity and probabilistic tractography of the right inferior longitudinal fasciculus together with a data-driven multivoxel pattern analysis of whole-brain resting-state connectivity before treatment to predict improvement in social anxiety after CBT. Each connectomic measure improved the prediction of individuals' treatment outcomes significantly better than a clinical measure of initial severity, and combining the multimodal connectomics yielded a fivefold improvement in predicting treatment response. Generalization of the findings was supported by leave-one-out cross-validation. After dividing patients into better or worse responders, logistic regression of connectomic predictors and initial severity combined with leave-one-out cross-validation yielded a categorical prediction of clinical improvement with 81% accuracy, 84% sensitivity and 78% specificity. Connectomics of the human brain, measured by widely available imaging methods, may provide brain-based biomarkers (neuromarkers) supporting precision medicine that better guide patients with neuropsychiatric diseases to optimal available treatments, and thus translate basic neuroimaging into medical practice.

Despite growing evidence for atypical amygdala function and structure in major depression, it remains uncertain as to whether these brain differences reflect the clinical state of depression or neurobiological traits that predispose individuals to major depression. We examined function and structure of the amygdala and associated areas in a group of unaffected children of depressed parents (at-risk group) and a group of children of parents without a history of major depression (control group). Compared to the control group, the at-risk group showed increased activation to fearful relative to neutral facial expressions in the amygdala and multiple cortical regions, and decreased activation to happy relative to neutral facial expressions in the anterior cingulate cortex and supramarginal gyrus. At-risk children also exhibited reduced amygdala volume. The extensive hyperactivation to negative facial expressions and hypoactivation to positive facial expressions in at-risk children are consistent with behavioral evidence that risk for major depression involves a bias to attend to negative information. These functional and structural brain differences between at-risk children and controls suggest that there are trait neurobiological underpinnings of risk for major depression.

Several regions in human temporal and frontal cortex are known to integrate visual and auditory object features. The processing of audio–visual (AV) associations in these regions has been found to be modulated by object familiarity. The aim of the present study was to explore training-induced plasticity in human cortical AV integration. We used functional magnetic resonance imaging to analyze the neural correlates of AV integration for unfamiliar artificial object sounds and images in naïve subjects (PRE training) and after a behavioral training session in which subjects acquired associations between some of these sounds and images (POST-training). In the PRE-training session, unfamiliar artificial object sounds and images were mainly integrated in right inferior frontal cortex (IFC). The POST-training results showed extended integration-related IFC activations bilaterally, and a recruitment of additional regions in bilateral superior temporal gyrus/sulcus and intraparietal sulcus. Furthermore, training-induced differential response patterns to mismatching compared with matching (i.e., associated) artificial AV stimuli were most pronounced in left IFC. These effects were accompanied by complementary training-induced congruency effects in right posterior middle temporal gyrus and fusiform gyrus. Together, these findings demonstrate that short-term cross-modal association learning was sufficient to induce plastic changes of both AV integration of object stimuli and mechanisms of AV congruency processing.

We aimed at testing the cortical representation of complex natural sounds within auditory cortex using human functional magnetic resonance imaging (fMRI). To this end, we employed 2 different paradigms in the same subjects: a block-design experiment was to provide a localization of areas involved in the processing of animal vocalizations, whereas an event-related fMRI adaptation experiment was to characterize the representation of animal vocalizations in the auditory cortex. During the first experiment, we presented subjects with recognizable and degraded animal vocalizations. We observed significantly stronger fMRI responses for animal vocalizations compared with the degraded stimuli along the bilateral superior temporal gyrus (STG). In the second experiment, we employed an event-related fMRI adaptation paradigm in which pairs of auditory stimuli were presented in 4 different conditions: 1) 2 identical animal vocalizations, 2) 2 different animal vocalizations, 3) an animal vocalization and its degraded control, and 4) an animal vocalization and a degraded control of a different sound. We observed significant fMRI adaptation effects within the left STG. Our data thus suggest that complex sounds such as animal vocalizations are represented in putatively nonprimary auditory cortex in the left STG. Their representation is probably based on their spectrotemporal dynamics rather than simple spectral features.

No abstract