The CATARACTS challenge paper has been accepted for publication in Medical Image Analysis. This dataset has been published on IEEE dataport.
This page will list the results of all submissions, along with their descriptions. It will be updated continually during eight months (from April 1, 2017 to November 30, 2017).
Leaderboard¶
(*) As organizers, we do not participate in the challenge: results are given for reference only.
Detailed evaluation¶
* * | DResSys | LaTIM | CUMV | TROLIS | CatResNet | TUMCTNet | CDenseNet | RToolNet | ZIB-Res-TS | MIL+resnet | CRACKER | SurgiToolNet | AUGSQZNT | LCCV-Cataract | VGG fine-tuning |
biomarker | 0.9988 | 0.9847 | 0.9857 | 0.9026 | 0.9752 | 0.8511 | 0.9825 | 0.5797 | 0.9212 | 0.8018 | 0.8114 | 0.8690 | 0.9701 | 0.6983 | 0.5590 |
Charleux cannula | 0.9892 | 0.9836 | 0.9735 | 0.9448 | 0.9490 | 0.8366 | 0.8603 | 0.8771 | 0.7846 | 0.8166 | 0.7814 | 0.7257 | 0.6867 | 0.6724 | 0.5359 |
hydrodissection cannula | 0.9959 | 0.9873 | 0.9847 | 0.9840 | 0.9811 | 0.9570 | 0.9754 | 0.9717 | 0.9842 | 0.9704 | 0.9679 | 0.9091 | 0.9422 | 0.8743 | 0.9524 |
Rycroft cannula | 0.9980 | 0.9946 | 0.9951 | 0.9924 | 0.9810 | 0.9907 | 0.9891 | 0.9908 | 0.9956 | 0.9791 | 0.9682 | 0.9709 | 0.9432 | 0.8391 | 0.6078 |
viscoelastic cannula | 0.9865 | 0.9822 | 0.9776 | 0.9822 | 0.9423 | 0.9732 | 0.9349 | 0.9545 | 0.9506 | 0.9253 | 0.9120 | 0.9533 | 0.8248 | 0.7353 | 0.8588 |
cotton | 0.9999 | 0.9986 | 0.9890 | 0.9842 | 0.9816 | 0.9854 | 0.9503 | 0.9759 | 0.9821 | 0.9702 | 0.9869 | 0.7213 | 0.9220 | 0.8893 | 0.7044 |
capsulorhexis cystotome | 0.9999 | 0.9998 | 0.9987 | 0.9989 | 0.9976 | 0.9968 | 0.9966 | 0.9976 | 0.9933 | 0.9953 | 0.9911 | 0.9450 | 0.9832 | 0.9151 | 0.9609 |
Bonn forceps | 0.9972 | 0.9949 | 0.9893 | 0.9942 | 0.9852 | 0.9825 | 0.9454 | 0.9726 | 0.9794 | 0.9574 | 0.9529 | 0.8934 | 0.9300 | 0.8188 | 0.8234 |
capsulorhexis forceps | 0.9993 | 0.9981 | 0.9890 | 0.9845 | 0.9821 | 0.9879 | 0.9700 | 0.9888 | 0.9869 | 0.9759 | 0.9761 | 0.9779 | 0.9486 | 0.8774 | 0.8399 |
Troutman forceps | 0.9898 | 0.9974 | 0.9917 | 0.9689 | 0.9752 | 0.9803 | 0.9237 | 0.9656 | 0.9827 | 0.9108 | 0.9020 | 0.9017 | 0.8744 | 0.7963 | 0.4826 |
needle holder | 0.9945 | 0.9936 | 0.9846 | 0.9839 | 0.9500 | 0.9415 | 0.8859 | 0.9709 | 0.9395 | 0.8893 | 0.8853 | 0.9909 | 0.8990 | 0.6011 | 0.4929 |
irrigation/aspiration handpiece | 0.9988 | 0.9989 | 0.9977 | 0.9976 | 0.9950 | 0.9947 | 0.9926 | 0.9913 | 0.9968 | 0.9925 | 0.9915 | 0.9279 | 0.9745 | 0.9019 | 0.9486 |
phacoemulsifier handpiece | 0.9998 | 0.9998 | 0.9990 | 0.9993 | 0.9966 | 0.9969 | 0.9963 | 0.9971 | 0.9994 | 0.9966 | 0.9927 | 0.9526 | 0.9854 | 0.9006 | 0.9712 |
vitrectomy handpiece | 0.9993 | 0.9719 | 0.9943 | 0.9960 | 0.9852 | 0.9924 | 0.9550 | 0.9932 | 0.9726 | 0.9778 | 0.9804 | 0.9958 | 0.8552 | 0.9244 | 0.1725 |
implant injector | 0.9984 | 0.9939 | 0.9906 | 0.9935 | 0.9828 | 0.9852 | 0.9326 | 0.9644 | 0.9739 | 0.9486 | 0.9590 | 0.9172 | 0.9354 | 0.9108 | 0.8384 |
primary incision knife | 0.9999 | 0.9965 | 0.9972 | 0.9933 | 0.9858 | 0.9961 | 0.9779 | 0.9848 | 0.9939 | 0.9801 | 0.9824 | 0.9674 | 0.9471 | 0.9195 | 0.8060 |
secondary incision knife | 0.9997 | 0.9994 | 0.9995 | 0.9984 | 0.9984 | 0.9983 | 0.9911 | 0.9978 | 0.9995 | 0.9936 | 0.9889 | 0.9458 | 0.9632 | 0.9251 | 0.8917 |
micromanipulator | 0.9989 | 0.9978 | 0.9940 | 0.9980 | 0.9897 | 0.9967 | 0.9886 | 0.9912 | 0.9917 | 0.9784 | 0.9710 | 0.9923 | 0.9815 | 0.6452 | 0.8706 |
suture needle | 0.9987 | 0.9990 | 0.9861 | 0.9915 | 0.9320 | 0.9920 | 0.9420 | 0.9796 | 0.9920 | 0.9295 | 0.9284 | 0.7543 | 0.9383 | 0.7301 | 0.5810 |
Mendez ring | 1.0000 | 0.9980 | 0.9999 | 0.9994 | 0.9966 | 0.9959 | 0.9629 | 0.9814 | 0.6317 | 0.9979 | 0.9986 | 0.9999 | 0.7952 | 0.9886 | 0.5064 |
Vannas scissors | 0.9972 | 0.9842 | 0.9657 | 0.9182 | 0.9533 | 0.9705 | 0.9625 | 0.9673 | 0.9855 | 0.9893 | 0.9876 | 0.9925 | 0.6841 | 0.7579 | 0.4246 |