Infopost | 2019.05.23

Thumbnail selection algorithm areas of interest motorcycles

On a whim I decided to update my thumbnail algorithm. In short, the previous iteration would look for areas of sharp contrast from a few preconfigured areas of the image. Intuitively, this had the twofold benefit of finding high contrast areas (sometimes where the important stuff is) and finding sharp areas (as out-of-focus parts won't have sharp contrast). I decided to iterate on this and preserve the sharp contrast element of the equation, but added parameters to try to resolve some of the issues with the original algorithm.

Image histogram

Both new ingredients are based on creating a histogram of brightness values using luminance (greyscale that treats R/G/B as the human eye does).
Rather than use preconfigured sample locations, I wrote the interface to let the user define a number of circlular sampling areas spaced evenly across the image. Running the algorithm would give me:

( x,   y): [score] [values...]
(88,  76): [265]   midtone: 96 contrast: 96   sharpness: 73
(88, 152): [104]   midtone: 40 contrast: 40   sharpness: 24
(88, 228):  [88]   midtone: 48 contrast: 24   sharpness: 16
(88, 304): [102]   midtone: 64 contrast: 24   sharpness: 14
(88, 380):  [79]   midtone: 48 contrast: 24   sharpness:  7
(88, 456):  [86]   midtone: 48 contrast: 24   sharpness: 14


Taking the combined midtone/contrast/sharpness values, I normalized them using them to give the percentage thumbnailability compared to the rest of the image.

Thumbnail selection algorithm areas of interest dog weimaraner

It gets a little clearer and more aligned when I draw on the sampling circles.

Thumbnail selection algorithm areas of interest volleyball

Generating a thumbnail is fairly trivial from here, but still heuristic. I could take the point of highest interest and expand out if necessary, but that could fall into an adversarial case fairly easily. Rather, iterating over the entire grid is pretty straightforward, and I can take the maximum grouping that meets provided size constraints.

Thumbnail selection algorithm areas of interest Dying Light screenshot

And beyond the thumbnail application, the high/low interest region labeling could be used for cropping or culling datasets for other algorithms.

Thumbnail selection algorithm areas of interest Risk of Rain 2 screenshot

Video games break the heuristic, but not as easily as the last one. Text provides the sharp contrast that the code likes to hone in on. Creating a center left/right bias would help with this, but then I need to provide manual or automatic recognition that it's a screencap.

Thumbnail selection algorithm areas of interest rafting

Even photos don't always get the intended result.



Metapost | 2019.05.18


Finally draft one of the Europe post set is complete. Two problems though:
This called for a bit of new code on the back end, assembling a custom set of posts in arbitrary order. Voila, post sets.



Listpost | 2019.05.01

Franz Liszt

Who doesn't love a good list?
List posts

Post
2023.11.12

Films about money, finance, and scams

The Big Short, Smartest Guys in the Room, Madoff... plus some stuff I haven't seen yet in case you want to do a movie night.

Post
2023.09.10

Travel

Travel galleries, stories, and information.

Post
2023.04.01

Electronic Entertainment Eulogy

Remembering the best, the worst, and the weirdest parts of E3.

Post
2021.04.01

Millennialisms

A compilation of things that set gen-y apart (or as they would say, "a part") from others.

Post
2019.12.31

201x decade in review

A retrospective on the decade that - well - happened.

Post
2017.12.27

J's top ten video games

J's top ten video games of all time (and some honorable mentions).

Post
2019.04.01

My top ten video games

My take on the best of the best, and some nostalgia mentions.

Post
2011.05.05

The final speed night

A few years back, Connie, Erik, and myself did car/motorcycle movie nights and shared our thoughts on how they measure up to some agreed-upon criteria that only vaguely echoes actual quality. If you're looking for a full-throttle quiet night in the media room, check the top or bottom of our list.
Galleries

Post
2023.10.31

Costumes

A collection of all the best costumes from over the years.

Favorite media

Post
2000.01.10

Favorite photos (2000-2009)

My favorite (original) photo content from the aughts.

Post
2010.01.10

Favorite photos (2010-2019)

My favorite (original) photo content from the teens.

Post
2020.01.10

Favorite photos (2020-2029)

My favorite (original) photo content from the twenties.

Post
2010.02.10

Favorite screens (2010-2019)

My favorite screenshots from the teens.

Post
2020.02.10

Favorite screens (2020-2029)

My favorite screenshots from the twenties.