Mathematician endorses post's advice on verifiable LLM use
2 Sep 16 7:51 AM · 11d ago · 1 post · 1 source · development 2 of 2
A respondent praises the blog's implicit guidance: asking LLMs questions with objectively verifiable answers (e.g., code brevity, correctness) rather than open-ended design decisions.
Anonymous reader Self-taught programmer using LLMsMark Seemann Software engineer and economist
The whole story articlesposts the bright band is this development · numbered dots are the others · click one to jump
What people said 24 voices · best of 33 · verbatim
-
The part about "falsifiable questions" explains why AI code reviews are usually okay and AI-generated code is not. It's relatively easy to check if a bug described by LLM exists, but (as you already said) it's hard to verify behavior of a complex vibecoded program.
-
Finally a thread to traumadump my anxieties!I have been trying to learn programming unsuccessfully for many years (I still ocasionally get a burst of energy, try something, then eventually abandon it halfway). In the end, I just accept that I don't have the kind of thinking that makes this effort enjoyable and I cannot achieve anything good.But…
-
C
This is a thoughtful post: https:// blog.ploeh.dk/2026/09/16/on-le arning-programming-in-an-age-of-llms/ It's worth reading the whole things. It finishes with some great (implicit) advice: "I tend to ask them questions that yield verifiable answers. Can I make this Haskell expression more succinct? Any useful answer to such a question is a code…
-
I find reading the dialogue between a vibecoder and an experienced programmer interesting and useful. Particularly when both parties are of high quality like here. My first thought on this was … beware what you ask an AI to build, because *something* will be built, but it might not be the *right* thing. The statement that “programming may be a…
-
This is an issue that's very real for me right now because I'm in the middle of teaching my own kids programming, and we've been working on it for years at this point. I'm watching AI seemingly invalidate the premise behind learning all of it. It's been a pretty depressing change to be honest, because I love programming and watching this happen is…
-
I feel like people greatly over-estimate the effort it takes to just learn *some* programming. A decade ago, it felt normal that teenagers wrote phone apps and web apps and roblox games etc. etc. Teenagers! Kids! Who have screen addictions, in between their school work and fencing lessons! And now we're supposed to just assume that because AI…
-
A good question might be: what do I want to be ? A good prompter ? It's like someone who used to bee a good chef but is now good at ordering at uber eats. Even for a junior: being a good prompter may not be enough.We tend to think that we make a program, but (writing) the program also makes us what we are. It is what we do that defines what we…
-
It comes down to the complexity of specification and reusability. A bounded component providing specifiable behavior (even as traditionally difficult to get right as concurrent behavior) is a great candidate for agent synthesis because verification with the assistance of an agent is much cheaper than building it oneself and then still having to…
-
I suspect my opinion on this won't be very popular, but it's like driving a car. If you're going to learn how to drive four wheels, you should start by taking the motorcycle safety course and learn on two wheels first. We can discuss why later.Taking that concept to programming, I wouldn't start with a desktop or a web app. I would start with a…
-
one thing ive found fascinating recently was re-taking some of the best tutorials i've ever taken (catlike coding, libtcod roguelike, etc), and asking astra to just transpile them into other technologies, stacks, or languages. Including all the garden paths, false starts, and dead ends, because the tutorial author included those intentionally. I…
-
I answered this to myself - stop worrying about LLMs. It's pretty simple: due to Curry-Howard isomorphism, programming languages are just notations for some type of formal logic.Now ask yourself a question, what language do you want to maintain the programs in? Do you think natural language is going to be easier and more maintainable than formal…
-
I've been thinking about this in the context of learning new languages and tech. In pre-LLM days it was fun to sometimes try to implement a new idea in a new language or stack and build up an understanding by trial and error. You'd have to accept that it will be slower to get going than a familiar set of tools and maybe only trade out one old tool…
-
To me software engineering was often about: how do we structure the project so that the crappy code the other students/co-workers write don't break everything?Not because everyone writes bad code. They do, at-least the do first time you read their code. You only think someones code is decent when you spent 3 hours trying to refactor their PR, and…
-
> Now, if you can steer an LLM reasonably well, you can quickly build an MVP that goes well beyond your own understanding of the implementation.Pre-LLM, I'd distinguish between e.g. "I know Python" and "I know this codebase". So if I wrote a codebase in Python I'd be familiar with it, if someone else wrote a codebase in Python I'd be familiar with…
-
i might never know what it's like to learn programming after LLMs became powerful (I started programming in ~2002). But if someone forced me to give advice to such people, I'd say just start building things and stay curious.That means, use LLMs to build whole sites and then dig in where you are curious. Look at the code, ask your LLM how it works…
-
> Just five years ago, the only way to build a working project of moderate complexity was to learn the basic to intermediate concepts required to make an MVP.> Now, if you can steer an LLM reasonably well, you can quickly build an MVP that goes well beyond your own understanding of the implementation.Somewhat agree. Five years ago you could build…
-
> After months of refactoring I had an uncomfortable realization: I may have built a system that is above my own level of understanding. When everything works, that gap is almost invisible. When it doesn't, it becomes very real.> "Sometimes I genuinely don't know what to do next without asking another model. That made me wonder whether I spent a…
-
> Still, I doubt that it's possible to significantly speed up human learning. The bottleneck is hardly the teachers nor the materials, but how fast a human brain can absorb new knowledge.I completely agree with it. LLM might be able to 10x the number of PRs, and maybe that is actually is fine for the company because it doesn't care too much about…
-
I think there might be a take on learning with AI vs the pressure to develop fast. AI could be an amazing tool to learn. But who wants to learn when you had to deliver 3 days ago? The corp culture is kind of what is killing it. Not sure how things are going in universities tho. If you stop and use it to learn, take time, ask questions. I am sure…
-
(sorry pasting from 4 days ago but IMHO perfect fit)The same reasons we keep on teaching kids to read, write, do math, sketch, take photos, etc ... because it is fun, empowering and important.Most of them will never become professional actors, authors, mathematicians, artists, photographers, etc ... and yet they will rely on those skills, on their…
-
My earnest, non-sarcastic advice to anyone considering learning to code is to find something else that interests you.While there is possibly some time left before the software industry implodes, hobbyist software will also get steamrolled so I would in the strongest terms possible guide someone to find something that makes them happy and to pursue…
-
“I built a thing with AI and I don’t understand it. I want to make changes and fix things and have no ability to theorize why it fails or how to fix it.”Oh my. See, you have to be able to program it yourself before you can build it with an LLM. Otherwise you have no way of judging the output. AI isn’t going to make you a programmer.Learning to…
-
I am starting to see how many developers actually need to re-learn programming in the age of LLMs.A while back Claude went down in the middle of a somewhat frantic initial deployment of a product to production at a company where a friend of mine works. And suddenly nobody was able to do anything. Because nobody had actually read the code and had…
-
And building the correct structure for your problem/program is still a huge part of the job. If you completely delegate structure, you still get a clusterfuck.I have found working with LLM's is best when I provide as much structure and constraints as possible, and reduce the degrees of freedom that the LLM can exercise, so that it is forced to fit…
All 2 developments of Programmer explores risks of learning code with AI before… →
Hacker NewsMastodonNewswiresLobsters