Thumbnail selection algorithm areas of interest motorcycles

On a whim I decided to update my thumbnail algorithm. In short, the previous iteration would look for areas of sharp contrast from a few preconfigured areas of the image. Intuitively, this had the twofold benefit of finding high contrast areas (sometimes where the important stuff is) and finding sharp areas (as out-of-focus parts won't have sharp contrast). I decided to iterate on this and preserve the sharp contrast element of the equation, but added parameters to try to resolve some of the issues with the original algorithm.

Image histogram

Both new ingredients are based on creating a histogram of brightness values using luminance (greyscale that treats R/G/B as the human eye does).
Rather than use preconfigured sample locations, I wrote the interface to let the user define a number of circlular sampling areas spaced evenly across the image. Running the algorithm would give me:
( x,   y): [score] [values...]
(88,  76): [265]   midtone: 96 contrast: 96   sharpness: 73
(88, 152): [104]   midtone: 40 contrast: 40   sharpness: 24
(88, 228):  [88]   midtone: 48 contrast: 24   sharpness: 16
(88, 304): [102]   midtone: 64 contrast: 24   sharpness: 14
(88, 380):  [79]   midtone: 48 contrast: 24   sharpness:  7
(88, 456):  [86]   midtone: 48 contrast: 24   sharpness: 14

Taking the combined midtone/contrast/sharpness values, I normalized them using them to give the percentage thumbnailability compared to the rest of the image.

Thumbnail selection algorithm areas of interest dog weimaraner

It gets a little clearer and more aligned when I draw on the sampling circles.

Thumbnail selection algorithm areas of interest volleyball

Generating a thumbnail is fairly trivial from here, but still heuristic. I could take the point of highest interest and expand out if necessary, but that could fall into an adversarial case fairly easily. Rather, iterating over the entire grid is pretty straightforward, and I can take the maximum grouping that meets provided size constraints.

Thumbnail selection algorithm areas of interest Dying Light screenshot

And beyond the thumbnail application, the high/low interest region labeling could be used for cropping or culling datasets for other algorithms.

Thumbnail selection algorithm areas of interest Risk of Rain 2 screenshot

Video games break the heuristic, but not as easily as the last one. Text provides the sharp contrast that the code likes to hone in on. Creating a center left/right bias would help with this, but then I need to provide manual or automatic recognition that it's a screencap.

Thumbnail selection algorithm areas of interest rafting

Even photos don't always get the intended result.


Finally draft one of the Europe post set is complete. Two problems though:
This called for a bit of new code on the back end, assembling a custom set of posts in arbitrary order. Voila, post sets.


Franz Liszt

Okay so who doesn't love a good list?

List Description
Millennialisms A compilations of things that set gen-y apart (or as they would say, "a part") from others.
201x Decade in Review A retrospective on the decade that - well - happened.
J's Top Ten Video Games Top ten video games of all time (and some honorable mentions), courtesy J.
My Top Ten Video Games My take on the best of the best, and some nostalgia mentions.
The Final Speed Night A few years back, Connie, Erik, and myself did car/motorcycle movie nights and shared our thoughts on how they measure up to some agreed-upon criteria that only vaguely echoes actual quality. If you're looking for a full-throttle quiet night in the media room, check the top or bottom of our list.