Discussion about this post

User's avatar
War Machine's avatar

Interesting article.

One point occurred to me towards the end - AI coding tasks often have ‘instant feedback’ as you say (whether or not the system works as intended). But sometimes the intrusion of objective reality is deferred - I.e. the problem many programmers have with AI is not that it tends to produce broken code, but that it produces code which is less scalable, secure, sensical down the line.

So people are engineering their own feedback loops to provide a the kind of objective checks you describe (how objective are they really then at this point?)

I think the picture is equally murky - quasi-objective measures of

success could also be established for written tasks, for instance how well it captures attention. E.g. a AI-powered Substack account could learn from the performance of its various articles.

Great piece, thanks for sharing

Freddie deBoer's avatar

No facet of this current schizophrenic fever dream over “AI” is more obvious to me than the systematic overrating of intelligence’s power in the world. The entire history of humanity is an object lesson in the limits of intelligence, in its ultimate powerlessness.

12 more comments...

No posts

Ready for more?