Friedrich-Alexander-Universität Erlangen
Lehrstuhl für Mustererkennung
Martensstraße 3
91058 Erlangen

High-Resolution Fundus (HRF) Image Database

Segmentation Dataset

The public database contains at the moment 15 images of healthy patients, 15 images of patients with diabetic retinopathy and 15 images of glaucomatous patients. Binary gold standard vessel segmentation images are available for each image. Also the masks determining field of view (FOV) are provided for particular datasets. The gold standard data is generated by a group of experts working in the field of retinal image analysis and clinicians from the cooperated ophthalmology clinics. We intend to add further gold standard data to the existing images to help the evaluation of algorithms which localize the macula, optic disc, or differentiate between arteries and veins.

Initiates file downloadDownload the whole dataset (~73 Mb)

 

Input Data:

Initiates file downloadDownload input images of healthy eyes (~18 Mb)
Initiates file downloadDownload input images of glaucomatous eyes (~21 Mb)
Initiates file downloadDownload input images of eyes with diabetic retinopathy (~28 Mb)

 

Field of View (FOV) masks:

Initiates file downloadDownload the FOV mask images for the healthy eyes (~1 Mb)
Initiates file downloadDownload the FOV mask images for the glaucomatous eyes (~1 Mb) 
Initiates file downloadDownload the FOV mask images for the eyes with diabetic retinopathy (~1 Mb)

 

Vessel Segmentation Goldstandard:

Initiates file downloadDownload manually labeled images of healthy eyes (~2 Mb)
Initiates file downloadDownload manually labeled images of glaucomatous eyes (~2 Mb)
Initiates file downloadDownload manually labeled images of eyes with diabetic retinopathy (~2 Mb)

 

Optic Disk Goldstandard (Center Point and Radius):

Initiates file downloadDownload gold standard data of two experts for optic disk localization

 

Preliminary Version:

Opens internal link in current windowEarlier stages of the datasets are available here

Image Quality Assessment Dataset

We captured 18 image pairs of the same eye from 18 human subjects using a Canon CR-1 fundus camera with a field of view of 45° and different acquisition setting. For each pair, the first image has poor quality and thus the examination had to be repeated. Both images share approximately the same field of view, whereas small shifts were caused by eye movements between the acquisitions.

In the current version of our database, images of poor quality suffer from decreased sharpness (locally or globally), e.g. due to a defocused camera. Further quality features (e.g. image contrast or illumination conditions) may be considered in a future version. The available dataset was captured by Jan Odstrcilik. If you use it in your publications, please cite:

Thomas Köhler, Attila Budai, Martin Kraus, Jan Odstrcilik, Georg Michelson, Joachim Hornegger. Automatic No-Reference Quality Assessment for Retinal Fundus Images Using Vessel Segmentation, 26th IEEE Internatioal Symposium on Computer-Based Medical Systems 2013, Porto
(to appear)

 

Initiates file downloadDownload whole dataset

Initiates file downloadDownload images of good quality
Initiates file downloadDownload images of poor quality

Introduction

This database has been established by a collaborative research group to support comparative studies on automatic segmentation algorithms on retinal fundus images. The database will be iteratively extended and the webpage will be improved.
We would like to help researchers in the evaluation of segmentation algorithms. We encourage anyone working with segmentation algorithms who found our database useful to send us their evaluation results with a reference to a paper where it is described. This way we can extend our database of algorithms with the given results to keep it always up-to-date.

The database can be used freely for research purposes. We release it under Creative Commons 4.0 Attribution License. If you are using our database to evaluate your methods, please cite

Budai, Attila; Bock, Rüdiger; Maier, Andreas; Hornegger, Joachim; Michelson, Georg. Robust Vessel Segmentation in Fundus Images. International Journal of Biomedical Imaging, vol. 2013, 2013

Data

  • Segmentation Dataset

    The public database contains at the moment 15 images of healthy patients, 15 images of patients with diabetic retinopathy and 15 images of glaucomatous patients. Binary gold standard vessel segmentation images are available for each image. Also the masks determining field of view (FOV) are provided for particular datasets. The gold standard data is generated by a group of experts working in the field of retinal image analysis and clinicians from the cooperated ophthalmology clinics. We intend to add further gold standard data to the existing images to help the evaluation of algorithms which localize the macula, optic disc, or differentiate between arteries and veins.

    Initiates file downloadDownload the whole dataset (~73 Mb)

     

    Input Data:

    Initiates file downloadDownload input images of healthy eyes (~18 Mb)
    Initiates file downloadDownload input images of glaucomatous eyes (~21 Mb)
    Initiates file downloadDownload input images of eyes with diabetic retinopathy (~28 Mb)

     

    Field of View (FOV) masks:

    Initiates file downloadDownload the FOV mask images for the healthy eyes (~1 Mb)
    Initiates file downloadDownload the FOV mask images for the glaucomatous eyes (~1 Mb) 
    Initiates file downloadDownload the FOV mask images for the eyes with diabetic retinopathy (~1 Mb)

     

    Vessel Segmentation Goldstandard:

    Initiates file downloadDownload manually labeled images of healthy eyes (~2 Mb)
    Initiates file downloadDownload manually labeled images of glaucomatous eyes (~2 Mb)
    Initiates file downloadDownload manually labeled images of eyes with diabetic retinopathy (~2 Mb)

     

    Optic Disk Goldstandard (Center Point and Radius):

    Initiates file downloadDownload gold standard data of two experts for optic disk localization

     

    Preliminary Version:

    Opens internal link in current windowEarlier stages of the datasets are available here

    Image Quality Assessment Dataset

    We captured 18 image pairs of the same eye from 18 human subjects using a Canon CR-1 fundus camera with a field of view of 45° and different acquisition setting. For each pair, the first image has poor quality and thus the examination had to be repeated. Both images share approximately the same field of view, whereas small shifts were caused by eye movements between the acquisitions.

    In the current version of our database, images of poor quality suffer from decreased sharpness (locally or globally), e.g. due to a defocused camera. Further quality features (e.g. image contrast or illumination conditions) may be considered in a future version. The available dataset was captured by Jan Odstrcilik. If you use it in your publications, please cite:

    Thomas Köhler, Attila Budai, Martin Kraus, Jan Odstrcilik, Georg Michelson, Joachim Hornegger. Automatic No-Reference Quality Assessment for Retinal Fundus Images Using Vessel Segmentation, 26th IEEE Internatioal Symposium on Computer-Based Medical Systems 2013, Porto
    (to appear)

     

    Initiates file downloadDownload whole dataset

    Initiates file downloadDownload images of good quality
    Initiates file downloadDownload images of poor quality

Evaluation

A test version of an applet is available here to speed up the uploading and evaluation of images

Evaluation Results

Actual Content

Author
Dataset
Date
Sensitivity
Specificity
Accuracy
Calculation time*
Odstrcilik et. al.
[odstrcilik09]
Healthy images
2011-06-14
78.61% ± 3.92%
97.50% ± 0.65%
95.39% ± 0.61%
18 mins
Odstrcilik et. al.
[odstrcilik09]
Diabetic retinopathy images
2011-06-14
74.63% ± 5.66%
96.19% ± 0.77%
94.45% ± 0.84%
18 mins
Odstrcilik et. al.
[odstrcilik09]
Glaucomatous images
2011-06-14
79.00% ± 3.18%
96.38% ± 0.69%
94.97% ± 0.61%
18 mins

Preliminary Database

Author
Date
Sensitivity
Specificity
Accuracy
Calculation time*
Budai et. al.
[budai09]
2010-12-08
70.99% ± 4.00%
97.45% ± 0.44%
94.81% ± 0.60%
4 mins 40 secs
Odstrcilik et. al.
[odstrcilik09]
2010-12-08
81.65% ± 4.04%
96.09% ± 0.62%
94.48% ± 0.75%
18 mins
Blank result
(Everything is background)
2010-12-08
0.00% ± 0.00%
90.61% ± 0.93%
90.61% ± 0.93%
-

* Since the algorithms are tested on different hardwares using different programming languages and optimizations, the calculation times are rough approximations of the time needed to process a single image in average.

 

Contact

Responsible person for maintaining this homepage is:

Attila Budai

Responsible persons for the database are:

Attila Budai

Jan Odstrcilik

Acknowledgements

The database is provided by the Pattern Recognition Lab (CS5), the Department of Ophthalmology, Friedrich-Alexander University Erlangen-Nuremberg (Germany), and the Brno University of Technology, Faculty of Electrical Engineering and Comunnication, Department of Biomedical Engineering, Brno (Czech Republic).

This work has been supported by the national research center DAR (Data, Algorithms and Decision making) project no. 1M0572 coordinated by the Institute of Information Theory and Automation, Academy of Science, Czech Rep. and partly also by the institutional research frame no. MSM 0021630513; both grants sponsored by the Ministry of Education of the Czech Republic. The authors highly acknowledge the cooperation with the Eye Clinic Zlin, Czech Rep. (T. Kubena, M.D. and P. Cernosek, MSc), through which also the test set of images was provided.

Attila Budai is supported by the International Max Planck Research School for Optics and Imaging.

The authors gratefully acknowledge funding of the Erlangen Graduate School in Advanced Optical Technologies (SAOT) by the German National Science Foundation (DFG) in the framework of the excellence initiative.

 

References

budai09:
Attila Budai, Joachim Hornegger, Georg Michelson: Multiscale Approach for Blood Vessel Segmentation on Retinal Fundus Images. In Invest Ophthalmol Vis Sci 2009;50: E-Abstract 325, 2009.

odstrcilik09:
Jan Odstrcilik, Jiri Jan, Radim Kolar, and Jiri Gazarek. Improvement of vessel segmentation by matched filtering in colour retinal images. In IFMBE Proceedings of World Congress on Medical Physics and Biomedical Engineering, pages 327 - 330, 2009.

Budai11:
Attila Budai, Jan Odstricilik, Radim Kollar, Jiri Jan, Thomas Kubena, Georg Michelson: A Public Database for the Evaluation of Fundus Image Segmentation Algorithms
Poster at Fort Lauderdale Convention Center, The Association of Research in Vision and Ophthalmology (ARVO) Annual Meeting in Fort Lauderdale, FL, USA (02.05.2011)

odstrcilik13:
Jan Odstrcilik, Radim Kolar, Attila Budai, Joachim Hornegger, Jiri Jan, Jiri Gazarek, Tomas Kubena, Pavel Cernosek, Ondrej Svoboda, Elli Angelopoulou, „Retinal vessel segmentation by improved matched filtering: evaluation on a new high-resolution fundus image database,“ IET Image Processing, Volume 7, Issue 4, June 2013, pp.373-383.

DOI: 10.1049/iet-ipr.2012.0455, Print ISSN 1751-9659, Online ISSN 1751-9667