| Home About Rules Organizers Register Download Submit FAQ |
I have downloaded the data. How do I read it?
All data is stored in NRRD header format containing an ASCII readable header and a separate raw image data file. This format is ITK compatible. Full documentation is available at the NRRD webpage. An application that can read the data is SNAP. If you want to write your own code to read the data, note that in the header file you can find the dimensions of each file. In the raw file the values for each voxel are stored consecutively with index running first over x, then y, then z. The pixel type is short for the image data and unsigned char for the segmentations of the training data.
What do the entries in the result tables mean?
For each test case, five different performance measures are computed. These are the overlap error (OE) in percent, the relative volume difference (VD) of the lesion load, in percent, the lesion detection rate and two symmetric distance measures, all in millimeters. These are the mean absolute difference (AD), and the maximum distance (MD). Each error measure is translated to a score in the range from 0 (lowest possible score) to 100 (perfect result), by comparing them with typical scores of an independent human observer. Finally, the five scores are averaged to obtain one overall score per test case. These scores are averaged to obtain the score for a system. .
Why do I have to provide a pdf document and/or a description with every result I submit?
We believe that it is not too interesting to report here the results of systems whose working is unknown. Therefore we require that a description of each system is provided.
Can I change the pdf that describes my system?
Yes. Send the pdf and the submission number it applies to to Bram van Ginneken (bram@isi.uu.nl). If you have published a paper that reports results on the CAUSE07 database, we require you to notify us and the pdf of that paper may be the most appropriate document to describe that system.
Why can't I download the reference segmentation for the test data and perform the evaluation myself?
From our previous experiences with making data sets publicly available we have learned that if we would release the 'truth' for the test data, groups would perform slightly or vastly different types of evaluations. This may lead to incomparable results between papers that have used the same data. To avoid this, we decided on the current procedure, which makes sure that each system is evaluated in exactly the same way. If you would like to perform a different type of evaluation and the lack of a reference makes it impossible for you to do so, please contact the organizers.
I like to submit my method but I already know that's it's impossible for me to attend
the workshop. Can I still join the competition?
Please contact the organizers in this case.
I have lost the password of my registered team. What should I do?
Send an e-mail to Bram van Ginneken (bram@isi.uu.nl). A password reminder will be mailed to the e-mail address provided with the registered team.
What to do if I have further questions?
Send an e-mail to one of the organizers.
The content of this website is copyrighted © Martin Styner, Simon Warfield,Wiro Niessen, Theo van Walsum, Coert Metz, Michiel Schaap, Xiang Deng, Tobias Heimann, and Bram van Ginneken. This work is supported by the UNC Neurodevelopmental Disorders Research Center HD 03110 and NIH Roadmap for Medical Research, National Alliance for Medical Image Computing, Grant U54 EB005149-01.