3D Medical Segmentation of Volumes

3D medical segmentation labels whole CT and MRI volumes at once so vessels and tumors stay connected across slices.

3D segmentation labels connected volumes across slices instead of per slice

Why Does This Exist?

Slice models flicker: tumor present on slice $45$ , gone on $46$ , back on $47$ . Vessels disconnect. 3D nets read $128^3$ patches with true spacing, so through-plane context connects anatomy. DICOM handling must orient volumes first; nnU-Net configures the patches.

Think of It Like This

Reading a novel versus random pages

Judging a plot from random pages misses arcs that span chapters. Reading whole chapters keeps characters connected. Skimming pages is faster but loses threads.

Slices are pages and patches are chapters. The analogy stops at memory: chapters need GPUs while pages fit anywhere.

How It Actually Works

Volumes resample to median spacing, often $1$ mm isotropic for brains and $0.8 \times 0.8 \times 2.5$ mm for abdomens. Patches near $128^3$ with batch $2$ train Dice plus cross-entropy. Inference slides with $50$ percent overlap and Gaussian blending. Anisotropic kernels $3 \times 3 \times 1$ respect thick slices.

Worked example

A $3$ cm liver tumor spans $12$ slices at $2.5$ mm. Slice models score Dice $0.81$ with two gaps. A $128^3$ 3D patch sees all $12$ at once and reaches $0.89$ with zero gaps. Memory is $128^3 \times 4$ bytes near $8$ MB per feature map times $30$ maps, which fits $24$ GB at batch $2$ .

Watch Out For

Thick slices stretched as isotropic cubes

Resampling $5$ mm slices to $1$ mm cubes invents four slices of blur that look like edema. The symptom is puffy masks on old scanners. Keep anisotropic spacing or acquire thin slices for 3D.

The Quick Version

3D models connect anatomy across slices that 2D flickers on.
Spacing-aware patches near $128^3$ balance context and memory.
Anisotropic kernels respect thick-slice reality.
Do not fake isotropic cubes from $5$ mm slices; blur masquerades as disease.
Sliding overlap plus blending removes patch seams.