Set-Inclusive Uncertainty Modeling for Robust Brain Tumor Segmentation

(* : Equal Contribution)

POSTECH

MICCAI 2026

:france: Strasbourg, France

Overall framework of Set-Inclusive Uncertainty Modeling.


Abstract

Multimodal MRI is essential for accurate brain tumor segmentation, but acquiring every modality at inference time is often impractical. Missing modalities introduce intrinsic uncertainty because complementary tumor evidence is no longer available. We propose a probabilistic representation framework that models incomplete modality configurations as Gaussian distributions: the mean captures task information, while the variance measures uncertainty from missing evidence. To make uncertainty reflect information deficiency, each partial configuration is aligned toward its full-modality counterpart and its variance is scaled by their discrepancy. We further introduce a set-inclusive strategy that exploits the hierarchy of modality subsets and enforces consistent uncertainty ordering between subsets and supersets. Experiments on BraTS 2018 and BraTS 2020 show robust performance across diverse missing-modality scenarios. Code and model checkpoint are available at https://github.com/atlas-sky/SIUM.

Quantitative Result

Tables: Dice similarity coefficient (DSC, %) on BraTS 2020 and BraTS 2018, together with an ablation study on BraTS 2020. The proposed method achieves the best average performance across whole tumor (WT), tumor core (TC), and enhancing tumor (ET) regions, and the ablation confirms the complementary benefit of uncertainty-aware alignment and uncertainty ordering.


Qualitative Results

Figures: Qualitative results on BraTS 2020 show that our model produces more accurate and consistent segmentations than RFNet and DC-Seg under different modality configurations. The uncertainty visualization shows high uncertainty within tumor regions when evidence is limited, which decreases as complementary modalities are incorporated.


Uncertainty Analysis.

Fig. 3. Visualization of input modalities and ground-truth mask, with trained uncertainty overlaid on T1. Uncertainty, initially higher within tumor regions, decreases as additional modalities are incorporated. (Sample: HG_BraTS20_Training_045)

Fig. 4. Variance magnitude (—) and summed test DSC across tumor subregions (---) for each modality configuration on BraTS 2020. • and ○ indicate observed and missing modalities (Flair, T1, T1c, T2). Higher uncertainty correlates with lower performance. The shaded regions highlight that a superset exhibits lower uncertainty than its subset.


Gradient Scaling Analysis.

Fig. 5. Effect of variance magnitude on gradient behavior under controlled scaling.


Conclusion

We address intrinsic uncertainty induced by missing MRI modalities through a probabilistic framework for incomplete multimodal brain tumor segmentation. By reducing reliance on unsupported cues and explicitly organizing uncertainty across modality subsets, the model yields more reliable predictions. Experiments on BraTS 2018 and BraTS 2020 demonstrate robustness across missing-modality scenarios, while theoretical and empirical analyses support the need for uncertainty modeling.


BibTeX

@inproceedings{baek2026setinclusive,
      title={Set-Inclusive Uncertainty Modeling for Robust Brain Tumor Segmentation},
      author={Baek, Seunghun and Park, Jihwan and Sim, Jaeyoon and Lee, Hoseok and Lee, Seungjoo and Kim, Won Hwa},
      booktitle={International Conference on Medical Image Computing and Computer-Assisted Intervention},
      year={2026}
    }