Everypixel Journal

Tag: pairwise comparison

  • Can an AI Judge Replace Human Image Evaluation?

    Can an AI Judge Replace Human Image Evaluation?

    We gave three AI judges 264 image pairs already scored by humans. The best panel got 18% wrong on the easiest comparisons. Here is why that happened. Three AI judges looked at 264 pairs of upscaled images that our human reviewers had already scored. On about 70% of those comparisons, the two strongest judges independently…