Home  Details  Download  Rules  Evaluation  Reference  Submit  Results  Organizers 

The NeoBrainS12 challenge

Goal of the NeoBrainS12

Neonatal brain tissue volumes are considered to be an indicator of long-term neurodevelopmental performance. Accurate brain tissue segmentation is a prerequisite for obtaining volume measurements.
The goal of NeoBrainS12 is to compare the performance of (semi-)automatic algorithms for neonatal brain tissue segmentation in T1- and T2-weighted MRI scans.
Thus far, a number of different algorithms have been presented but comparing their performance reliably is not feasible. The algorithms were evaluated on different sets of images, with differences concerning both the acquisition protocol and the composition of the patient population, and the algorithms were evaluated by different criteria. Since obtaining a reference standard for brain segmentations has proven extremely time-consuming and cumbersome, very few methods have been evaluated on complete scans; the performance of most methods was assessed on a (very) limited subset of scan sections. In addition, the published algorithms did not consistently segment the same tissue (sub-)types; for example, some algorithms distinguish between cortical and central grey matter, whereas others lump these structures into one segment. Reliable re-implementation of various algorithms for the purpose of comparison would be very difficult, if at all feasible.
In this study all methods are compared against the same reference standard. This provides an opportunity to compare the performance of different segmentation algorithms.


For the segmentation T1-weighted and T2-weighted MR images of the brain acquired with a 3T MRI scanner are provided. Three different image sets of pre-term born infants are available: Given T1- and T2-weighted sequences, the task is to segment
  1. cortical grey matter
  2. basal ganglia and thalami
  3. unmyelinated white matter
  4. myelinated white matter
  5. brainstem
  6. cerebellum
  7. ventricles
  8. cerebrospinal fluid in the extracerebral space
Manual segmentation protocol and segmentation examples are provided in the Reference section. To obtain training data, please go to the Reference section.

(Semi-)automatic segmentations are evaluated against a manually set reference standard in the complete scans.
Each team is free to decide which data set and how many tissue types to segment. Each tissue type needs to be segmented according to the definition provided here. The results are published on this web page. In addition, we ask you to submit a paper describing your method by mailing it to neobrains12@isi.uu.nl. Submitted papers are limited to maximum 8 pages (suggested length: 4 pages). Please let us know if the paper has been submitted for review elsewhere and therefore cannot appear online.

Please include the following in the submitted papers:

This website is copyright (c) 2012 Image Sciences Institute.