challengeR is a tool for analyzing and visualizing challenge results in the field of image analysis and beyond.

Challenges have become the de facto standard for benchmarking image analysis algorithms. While the number of challenges is steadily increasing, surprisingly little effort has been invested in ensuring high quality design, execution and reporting for these international competitions. Specifically, results analysis and visualization in the event of uncertainties have been given almost no attention in the literature.

Given these shortcomings, challengeR aims to catalyze fast and widespread adoption of comprehensive analysis & visualization of competition results. challengeR offers an intuitive way to gain important insights into the relative and absolute performance of algorithms, including ranking uncertainties, which cannot be revealed by commonly applied visualization techniques.