A loose thought: when will human experts stop being the gold standard for ground truthing niche classification problems? That's already shifted in somewhat in domains like radiology but even there there's issues with classifying in the wild of lots of hospital with messy sensors. Is this something that will generalize in the coming years with AI?

from Pioneering Spirit (Blyg) ↗ · snapshot of v1

In some domains, plenty of it will be automated - a lot of it already is! AI broadly defined will precategorize everything easy - or things that are hard for humans but easy for machines - and the human will classify everything that is left.

I think of the old 50s sitcoms - the I Love Lucys etc - where e.g. Lucy gets a job on the candy inspection line and has to review every candy (eventually she falls behind and eats them, for comedic effect). Today a camera reviews them all as they pass at high speed.

But someone is setting the criteria, creating cutoffs, reviewing edge cases, etc.

Even "it has shifted in radiology" - when did the shift start? When AI started classifying? When easy access to imaging machines created false color images, or on a particular layer of a 3D scan.

(A special note - my first stub, let's see if I did it right.)