This page will list the results of all submissions, along with their descriptions. It will be updated continually during eight months (from April 1, 2017 to November 30, 2017).

Leaderboard

Rank Team Affiliation Score Last evaluation date Paper No. of submissions
1 DResSys D-Wave Systems Inc. 0.9971 November 30, 2017 4
* LaTIM Inserm 0.9931 November 30, 2017 *
2 CUMV The Chinese University of Hong Kong 0.9897 November 26, 2017 1
3 TROLIS Oxipit, UAB 0.9812 November 29, 2017 2
4 CatResNet Touch Surgery 0.9769 November 29, 2017 1
5 TUMCTNet Technical University of Munich 0.9715 November 30, 2017 6
6 CDenseNet Zhejiang University 0.9579 November 27, 2017 1
7 RToolNet Carl von Ossietzky Universität 0.9568 October 5, 2017 2
8 ZIB-Res-TS Zuse Institut Berlin 0.9541 November 30, 2017 1
9 MIL+resnet INESC TEC 0.9513 November 30, 2017 2
10 CRACKER INESC TEC 0.9484 November 30, 2017 1
11 SurgiToolNet Gachon University 0.9192 November 28, 2017 1
12 AUGSQZNT Epsilon 0.9040 November 30, 2017 1
13 LCCV-Cataract Georgia Institute of Technology 0.8248 November 29, 2017 1
14 VGG fine-tuning Konica Minolta, Inc. 0.7061 November 26, 2017 1

(*) As organizers, we do not participate in the challenge: results are given for reference only.

Detailed evaluation

  DResSys LaTIM CUMV TROLIS CatResNet TUMCTNet CDenseNet RToolNet ZIB-Res-TS MIL+resnet CRACKER SurgiToolNet AUGSQZNT LCCV-Cataract VGG fine-tuning
biomarker 0.9988 0.9847 0.9857 0.9026 0.9752 0.8511 0.9825 0.5797 0.9212 0.8018 0.8114 0.8690 0.9701 0.6983 0.5590
Charleux cannula 0.9892 0.9836 0.9735 0.9448 0.9490 0.8366 0.8603 0.8771 0.7846 0.8166 0.7814 0.7257 0.6867 0.6724 0.5359
hydrodissection cannula 0.9959 0.9873 0.9847 0.9840 0.9811 0.9570 0.9754 0.9717 0.9842 0.9704 0.9679 0.9091 0.9422 0.8743 0.9524
Rycroft cannula 0.9980 0.9946 0.9951 0.9924 0.9810 0.9907 0.9891 0.9908 0.9956 0.9791 0.9682 0.9709 0.9432 0.8391 0.6078
viscoelastic cannula 0.9865 0.9822 0.9776 0.9822 0.9423 0.9732 0.9349 0.9545 0.9506 0.9253 0.9120 0.9533 0.8248 0.7353 0.8588
cotton 0.9999 0.9986 0.9890 0.9842 0.9816 0.9854 0.9503 0.9759 0.9821 0.9702 0.9869 0.7213 0.9220 0.8893 0.7044
capsulorhexis cystotome 0.9999 0.9998 0.9987 0.9989 0.9976 0.9968 0.9966 0.9976 0.9933 0.9953 0.9911 0.9450 0.9832 0.9151 0.9609
Bonn forceps 0.9972 0.9949 0.9893 0.9942 0.9852 0.9825 0.9454 0.9726 0.9794 0.9574 0.9529 0.8934 0.9300 0.8188 0.8234
capsulorhexis forceps 0.9993 0.9981 0.9890 0.9845 0.9821 0.9879 0.9700 0.9888 0.9869 0.9759 0.9761 0.9779 0.9486 0.8774 0.8399
Troutman forceps 0.9898 0.9974 0.9917 0.9689 0.9752 0.9803 0.9237 0.9656 0.9827 0.9108 0.9020 0.9017 0.8744 0.7963 0.4826
needle holder 0.9945 0.9936 0.9846 0.9839 0.9500 0.9415 0.8859 0.9709 0.9395 0.8893 0.8853 0.9909 0.8990 0.6011 0.4929
irrigation/aspiration handpiece 0.9988 0.9989 0.9977 0.9976 0.9950 0.9947 0.9926 0.9913 0.9968 0.9925 0.9915 0.9279 0.9745 0.9019 0.9486
phacoemulsifier handpiece 0.9998 0.9998 0.9990 0.9993 0.9966 0.9969 0.9963 0.9971 0.9994 0.9966 0.9927 0.9526 0.9854 0.9006 0.9712
vitrectomy handpiece 0.9993 0.9719 0.9943 0.9960 0.9852 0.9924 0.9550 0.9932 0.9726 0.9778 0.9804 0.9958 0.8552 0.9244 0.1725
implant injector 0.9984 0.9939 0.9906 0.9935 0.9828 0.9852 0.9326 0.9644 0.9739 0.9486 0.9590 0.9172 0.9354 0.9108 0.8384
primary incision knife 0.9999 0.9965 0.9972 0.9933 0.9858 0.9961 0.9779 0.9848 0.9939 0.9801 0.9824 0.9674 0.9471 0.9195 0.8060
secondary incision knife 0.9997 0.9994 0.9995 0.9984 0.9984 0.9983 0.9911 0.9978 0.9995 0.9936 0.9889 0.9458 0.9632 0.9251 0.8917
micromanipulator 0.9989 0.9978 0.9940 0.9980 0.9897 0.9967 0.9886 0.9912 0.9917 0.9784 0.9710 0.9923 0.9815 0.6452 0.8706
suture needle 0.9987 0.9990 0.9861 0.9915 0.9320 0.9920 0.9420 0.9796 0.9920 0.9295 0.9284 0.7543 0.9383 0.7301 0.5810
Mendez ring 1.0000 0.9980 0.9999 0.9994 0.9966 0.9959 0.9629 0.9814 0.6317 0.9979 0.9986 0.9999 0.7952 0.9886 0.5064
Vannas scissors 0.9972 0.9842 0.9657 0.9182 0.9533 0.9705 0.9625 0.9673 0.9855 0.9893 0.9876 0.9925 0.6841 0.7579 0.4246