Home  Details  Download  Rules  Evaluation  Reference  Submit  Results  Organizers 

Evaluation

Automatically obtained segmentations of each tissue are compared to the manually obtained reference standard. Examples of the reference standard are illustrated in the Reference section.
Please note that the submitted automatic segmentation of each tissue class needs to be labeled as described here.

Automatic segmentations are evaluated using the Dice coefficient (DC), mean surface distance (MSD) and a Hausdorff distance (HD). The results are ranked per set. This means that separate rankings are available for For each set, three per tissue rankings can be generated. One based on the DC, one based on MSD, and another based on the HD. These are provided for the following tissues:
  1. cortical grey matter
  2. basal ganglia and thalami
  3. unmyelinated white matter
  4. myelinated white matter
  5. brainstem
  6. cerebellum
  7. ventricles
  8. cerebrospinal fluid in the extracerebral space
  9. unmyelinated + myelinated white matter
  10. cerebrospinal fluid in the extracerebral space + ventricles
Please note that next to tissue types defined by the reference standard, evaluation is also performed in unmyelinated and myelinated white matter together as one tissue type, and in cerebrospinal fluid in the extracerebral space and ventricles together as another tissue type.

The DC, MSD and the HD values of a tissue are computed as the average values obtained over the provided number of scans (patients) within a set. The number of patients in each set is five.



This website is copyright (c) 2012 Image Sciences Institute.