Information retrieval and multimedia content access has a long history of comparative evaluation and many of the advances in the area over the past decade can be attributed to the availability of open datasets that support comparative and repeatable experimentation. Sharing data and code to allow other researchers to replicate research results is needed in the multimedia modeling field and helps to improve the performance of systems and the reproducibility of published papers. MDRE at MMM2020 included four papers describing various aspects of the multimedia dataset generation process.
Andreas Leibetseder, Sabrina Kletz, Klaus Schoeffmann, Simon Keckstein and Jörg Keckstein.
Frank Hopfgartner, Cathal Gurrin and Hideo Joho
Graham Healy, Zhengwei Wang, Tomas Ward, Alan Smeaton and Cathal Gurrin