Sheng-Wei Chan詹盛惟
← All projects回到專題成果
Capstone report專題成果報告2026

Swin-TransKalman

A Kalman Style Decoder with Uncertainty Quantification for Abdominal Multi Organ SegmentationSwin TransKalman 具不確定性量化之卡爾曼濾波解碼器於腹部多器官分割

Sheng-Wei Chan詹盛惟 · Hsin-Jui Pan潘信瑞 · Chun-Po Shen沈群博

Tamkang University · Advisor: Prof. Jen-Shiun Chiang淡江大學電機工程學系 · 指導教授:江正雄教授

FLARE22SwinUNETR13 organs

Research highlight專題重點

Learn how much to trust each scale during feature fusion, and reuse the propagated state to flag regions more likely to contain segmentation errors.

在多尺度融合時學習各來源的採用比例,再利用傳遞狀態產生不確定度圖,協助辨識較容易分割錯誤的區域。

0.8755Mean DSC · 5 folds五折平均 DSC
0.9063Mean surface Dice (NSD)平均表面重疊係數 NSD
0.776Uncertainty AUROC不確定度錯誤辨識 AUROC

Project abstract專題摘要

Swin-TransKalman (Swin-TK) extends SwinUNETR by expressing coarse-to-fine decoding as prediction and update steps. A learned positive state and observation noise determine element-wise fusion gains, while the updated state is propagated through the decoder and read out as voxel-level uncertainty. Encoder gates, attention temperature, and a log-state bias further regulate feature updates. Five-fold internal cross-validation on 50 labeled FLARE22 training CT scans covers 13 abdominal organs, using 40 training and 10 validation cases per fold for 1,000 epochs. The complete Swin-TK configuration improves DSC from 0.8649 to 0.8755 and NSD from 0.8917 to 0.9063; it also includes deep supervision and an uncertainty loss. Uncertainty achieves an error-ranking AUROC of 0.776 ± 0.039, compared with 0.609 ± 0.041 for image gradients.

Swin-TransKalman(Swin-TK)以 SwinUNETR 為基礎,將由粗至細的解碼表述為預測與更新。模型利用可學習正值狀態與觀測雜訊形成逐元素融合增益,並持續傳遞更新狀態,最後讀出逐體素不確定度;編碼器另整合卡爾曼式閘門、注意力溫度與對數狀態偏置。於 FLARE22 的 50 例標註 CT 進行五折內部交叉驗證,每折 40 例訓練、10 例驗證、1,000 epochs,分割 13 類腹部器官。包含深監督與不確定度損失的完整配置,將 DSC 由 0.8649 提升至 0.8755,NSD 由 0.8917 提升至 0.9063;不確定度的錯誤排序 AUROC 為 0.776 ± 0.039,高於影像梯度的 0.609 ± 0.041。

Method方法設計

  1. Kalman-style feature fusion卡爾曼式特徵融合

    Use positive states and observation noise to form element-wise gains for combining decoder predictions with encoder skip features.

    利用正值狀態與觀測雜訊形成逐元素增益,融合解碼預測與編碼跳接特徵。

  2. Encoder information control編碼器資訊調節

    Integrate Kalman-style gates, attention-temperature control, and a log-state bias in the hierarchical encoder.

    在階層式編碼器中整合卡爾曼式閘門、注意力溫度調節與對數狀態偏置。

  3. Segmentation and uncertainty outputs分割與不確定度雙輸出

    Read out voxel-level uncertainty from the propagated state and evaluate its ability to rank erroneous voxels.

    由持續傳遞的狀態讀出逐體素不確定度,並評估其對錯誤體素的排序能力。

Swin-TK: hierarchical encoder with attention control, five decoder stages with feature and positive-state propagation, segmentation and uncertainty outputs
Swin-TK architecture · Redrawn from report Sections 3.1–3.4. The five decoder stages propagate features and a positive state P from coarse to fine scales; P also supports the uncertainty readout. Sizes illustrate a 96³ input patch.Swin-TK 架構圖:依報告第 3.1–3.4 節重新繪製。五層解碼器由粗至細傳遞特徵與正值狀態 P,並由 P 讀出不確定度;尺寸以 96³ 輸入區塊為例。 Architecture and equations · Report PDF pp. 18–24架構與公式:報告 PDF 第 18–24 頁 Original Figure 2查看原報告圖 2

Representative results代表成果

Five-fold internal cross-validation on 50 labeled FLARE22 training cases. Both models use 1,000 epochs; the complete Swin-TK configuration also adds deep supervision and an uncertainty loss.

FLARE22 的 50 例標註訓練資料、五折內部交叉驗證。兩模型皆訓練 1,000 epochs;完整 Swin-TK 另加入深監督與不確定度損失。

Metric指標SwinUNETRSwinUNETRSwin-TKSwin-TK
Mean DSC平均 DSC0.86490.8755
Mean NSD平均 NSD0.89170.9063
Parameters參數量62.2 M63.6 M

Report Table 10. DSC uses the main cross-validation summary; NSD uses the surface-evaluation pipeline. Improvements are +1.06 and +1.46 percentage points, respectively.

取自報告表 10。DSC 採主交叉驗證彙總,NSD 採表面評估流程;分別改善 1.06 與 1.46 個百分點。

View source tables →查看原始表格 →

The main DSC comparison improves in all five folds and in 39 of 50 cases. A supplemental fold-1 comparison without deep supervision in either model raises DSC from 0.8706 to 0.8769. The uncertainty AUROC measures error ranking; it is not evidence of probability calibration.

主 DSC 評估中,五折皆改善,50 例中有 39 例進步。第 1 折補充比較在兩模型皆未使用深監督時,DSC 仍由 0.8706 提升至 0.8769。不確定度 AUROC 衡量錯誤排序能力,不代表已完成機率校準。

Figure 14 · Development-stage illustration of CT, prediction, ground truth, and uncertainty. This example is not a representative sample of the five-fold AUROC evaluation.
Figure 14 · Development-stage illustration of CT, prediction, ground truth, and uncertainty. This example is not a representative sample of the five-fold AUROC evaluation.圖 14:開發階段的 CT、分割、標註與不確定度示例;此圖用於說明輸出形式,不作為五折 AUROC 評估的代表樣本。 Report PDF p. 42報告 PDF 第 42 頁

Interpretation & scope成果解讀與適用範圍

The main experiment compares complete configurations, so the gain cannot be assigned to one module alone. Single-fold ablation does not replace full module ablations, multi-seed training, or external validation. The uncertainty output has demonstrated ranking utility under this protocol, not calibrated error probabilities.

主實驗比較完整配置,增益不能全數歸於單一模組。單折消融尚不能取代完整模組消融、多種子訓練及外部驗證。不確定度輸出在目前流程下具錯誤排序能力,尚未驗證其機率校準。

Full report & evidence完整報告與對應證據

The summary and figures on this page are drawn from the project report. The full report is in Traditional Chinese; page links below use the PDF page number.

本頁摘要與圖表整理自專題報告。完整報告為繁體中文;下列連結使用 PDF 檔案頁碼。

Open complete report開啟完整專題報告 PDF · 47p

Image

Press Esc or use Close to return.按 Esc 或「關閉」返回頁面。