Evaluation

Automatically obtained segmentations of each tissue are compared to the manually obtained reference standard. Examples of the reference standard are illustrated in the Reference section.
Please note that the submitted automatic segmentation of each tissue class needs to be labeled as described here.

Automatic segmentations are evaluated using the Dice coefficient (DC), mean surface distance (MSD) and a Hausdorff distance (HD). The results are ranked per set. This means that separate rankings are available for

  • axial scans acquired at 40 weeks corrected age
  • coronal scans acquired at 30 weeks corrected age
  • coronal scans acquired 40 weeks corrected age

For each set, three per tissue rankings can be generated. One based on the DC, one based on MSD, and another based on the HD. These are provided for the following tissues:

  1. cortical grey matter
  2. basal ganglia and thalami
  3. unmyelinated white matter
  4. myelinated white matter
  5. brainstem
  6. cerebellum
  7. ventricles
  8. cerebrospinal fluid in the extracerebral space
  9. unmyelinated + myelinated white matter
  10. cerebrospinal fluid in the extracerebral space + ventricles

Please note that next to tissue types defined by the reference standard, evaluation is also performed in unmyelinated and myelinated white matter together as one tissue type, and in cerebrospinal fluid in the extracerebral space and ventricles together as another tissue type.

The DC, MSD and the HD values of a tissue are computed as the average values obtained over the provided number of scans (patients) within a set. The number of patients in each set is five.