This is probably the best description of the central issue I've seen. I know even in my own work, which is a very narrow domain in software, I've found it troublesome to automate myself. Not because the code I write is unique or all that difficult, but because the starting conditions I begin with depend on a long history of knowledge that I've built up, an understanding of the business I'm part of, and an understanding of user behavior when they encounter what I've built.

In other words, I can form a prompt that often one-shots the code solution. The hard part is not the code, it's forming that prompt! The prompt often includes a recommendation on an approach that comes from experience, references to other code that has done something similar, and so on. I'm not going to stop trying to automate myself, but it's going to be a lot harder than anyone realized when LLMs first came out.