Can a Machine Score How Creative Your Photo Is? This Framework Says Yes — If You Buy Three Dimensions of Creativity

ML models trained on MTurk ratings predict image creativity via novelty, surprise, and arousal. Scores match human ratings statistically. The question is whether the psychological foundations hold up.

Imagine you're judging a chili cook-off, but instead of tasting each entry, you break every chili into three sub-scores — heat, complexity, aroma — then add those sub-scores into a final rating. If your decomposition is right, you can train someone (or something) to rate chili without ever tasting it holistically. That's what this paper does for image creativity. The claim: decompose perceived image creativity into three psychologically grounded dimensions — novelty, surprise, and arousal — train separate ML models to predict each dimension from image features, then combine those predictions into an overall creativity score that is statistically equivalent to direct human creativity ratings. The framework is straightforward. The authors run controlled Amazon Mechanical Turk experiments to collect human ratings on each of the three dimensions plus an overall creativity score. They then train supervised ML models (the paper is a 9-page summary and does not specify architectures in detail) to predict novelty, surprise, and arousal from image features. A final model takes those three predicted dimension scores and outputs a creativity estimate. The key result: estimated creativity scores are "statistically equivalent" to human ratings for the tested images. The psychological grounding is the load-bearing wall here. The authors identify novelty, surprise, and arousal from existing creativity research in psychology and validate that these three dimensions are what human raters actually use when assessing image creativity. This is the most defensible part of the work — they're not inventing dimensions from thin air but drawing on established theory. Whether three dimensions are sufficient, or whether they collapse into fewer latent factors for certain image types, remains an open question the paper doesn't fully resolve. The ladder question is tricky because there isn't a single dominant SOTA for "image creativity scoring" the way there is for, say, ImageNet classification. Prior work exists — computational aesthetics, novelty detection, affect prediction — but the authors frame this as a novel combination rather than a head-to-head competition. They don't benchmark against specific prior creativity estimation systems with named numbers and deltas, which limits how firmly we can place this on the ladder. Integrity is mixed. The MTurk experiments provide real human data, which is better than self-grading via simulation. But we don't know the image dataset size, the ML model architectures, the train/test split strategy, or whether the test images were held out before model selection. The paper is 9 pages with 1 figure — this is a summary or short paper, not a full methods disclosure. "Statistically equivalent" is doing a lot of work without seeing the confidence intervals, effect sizes, or the specific statistical tests used. No code release is mentioned. The milestone for this line of work is clear: move from lab-validated image sets to in-the-wild creative content at scale. If the creativity dimensions transfer to diverse domains (ads, art, UGC), this becomes a practical tool. If they don't — if novelty/surprise/arousal are context-dependent and collapse outside curated image sets — the framework stalls. The gap between curated MTurk experiments and real deployment is where most computational aesthetics work dies. The obvious experiment not run: testing on a substantially larger, more diverse image corpus with demographic variation in raters. The 9-page format and MTurk budget constraints suggest this is a compute/budget limitation rather than a strategic omission. A cross-cultural replication — does the novelty/surprise/arousal decomposition hold for non-WEIRD populations? — would be the real stress test.