Over the last couple of months Rahul Garg published a series of posts here on how to reduce the friction in AI-assisted programming. To make it easier to put these ideas into practice heвҖҷs now built an open-source framework to operationalize these patterns.
AI coding assistants jump straight to code, silently make design decisions, forget constraints mid-conversation, and produce output nobody reviewed against real engineering standards. Lattice fixes this with composable skills in three tiers вҖ“ atoms, molecules, refiners вҖ“ that embed battle-tested engineering disciplines (Clean Architecture, DDD, design-first methodology, secure coding, and more), plus a living context layer (the .lattice/ folder) that accumulates your projectвҖҷs standards, decisions, and review insights. The system gets smarter with use вҖ“ after a few feature cycles, atoms arenвҖҷt applying generic rules, theyвҖҷre applying your rules, informed by your history.
It can be installed as a Claude Code plugin or downloaded for use with any AI tool.
В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„
This is also a good point to note that the article by my colleagues Wei Zhang and Jessie Jie Xia on Structured-Prompt-Driven Development (SPDD) has generated an enormous amount of traffic, and quite a few questions. They have thus added a Q&A section to the article that answers a dozen of them.
В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„
Jessica Kerr (Jessitron) posted a merry tidbit of building a tool to work with conversation logs. She observes the double feedback loop involved.
There are (at least) two feedback loops running here. One is the development loop, with Claude doing what I ask and then me checking whether that is indeed what I want.[вҖҰ] Then thereвҖҷs a meta-level feedback loop, the вҖңis this working?вҖқ check when I feel resistance. Frustration, tedium, annoyanceвҖ“these feelings are a signal to me that maybe this work could be easier.
The double loop here is both changing the thing we are building but also changing the thing we are using to build the thing we are building.
As developers using software to build software, we have potential to mold our own work environment. With AI making software change superfast, changing our program to make debugging easier pays off immediately. Also, this is fun!
Indeed it is, and makes me think that agents are allowing us to (re)discover one of the Great Lost Joys of software development - that of molding my development environment to exactly fit the problem and my personal tastes. A while ago I wrote about this under the name Internal Reprogramability. It was a central feature of the Smalltalk and Lisp communities but was mostly lost as we got complex and polished IDEs (although the unix command line gives a hint of its appeal).
В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„
Ashley MacIsaac is a musician from Cape Breton, who plays folk-influenced music (I have a couple of his albums in my collection). Google generated an AI overview that asserted that had been convicted of crimes, including sexual assault and was on the national sex-offender registry. These were completely false, confusing him with another man with the same name. MacIsaac is suing Google for defamation:
вҖңThis was not a search engine just scanning through things and giving somebody elseвҖҷs story [вҖҰ] It was published by them. And to me, that is defamation. The guardrails were not there to prevent Google AI from publishing that content.вҖқ
MacIsaacвҖҷs point is that Google must take responsibility for what a tool it controls publishes. MacIsaac suffered genuine harm here, not just to his reputation, but he also had a concert canceled and the claims affect his performing.
вҖңI felt that tangible fear from something that was published by a media company,вҖқ he said in an interview with The Canadian Press. вҖңI feared for my own safety going on stage because of what I was labelled as. And I donвҖҷt know how long this will follow me.вҖқ
Too often tech companies try to dodge the consequences of their actions. There are genuine issues about the difficulties of monitoring whatвҖҷs published at scale, but thatвҖҷs a responsibility that they should face up to.
В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„
Stephen OвҖҷGrady (RedMonk) takes a serious look at how much the big tech companies are spending on AI build-outs. The sums involved are staggering, not just in absolute terms (over $100 Billion), but also compared to the revenues of the companies involved. Firms like Amazon, Alphabet, and Microsoft are spending over 50% of their revenues (not profits). Meta and Oracle hit or pass 75% of revenues.
That level of investment would have been unthinkable a decade ago. Today, the chart suggests itвҖҷs table stakes
There is a notable exception: Apple. Here they are clearly Thinking Different, eyeballing the chart they seem closer to 10% of revenues.
В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„
Most folks I talk to about agentic programming are using models in the cloud: Claude, Codex, and the like. Everyone agrees these are the most powerful models, the ones that triggered the November Inflection. But do we need to use the Most Powerful Models, particularly when we have to ship data to them, and pay handsomely for the privilege? Willem van den Ende considers an alternative, that local models are Good Enough.
Assumptions
- We are all figuring this out.
- Quality of a harness (coding agent + вҖңskillsвҖқ + extensions) can matter as least as much as the model
- Running open models and an open coding agent + custom extensions takes time, but pays off in understanding and a stable base where engineering effort compounds
- Open, local, models have (for me) crossed the point where they are good enough for daily work with a coding agent.
The post describes in detail his setup for local model work. It includes sandboxing with Nono, which is something to consider even if using a Cloud model - such powerful tools need a Zero Trust Architecture.
В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„
In case you havenвҖҷt noticed, those last two fragments resonate. Apple isnвҖҷt playing the cloud AI model game, they are saving a huge amount of money, and if local models end up being the future, theyвҖҷll be looking rather wise. Van den EndeвҖҷs post led me to a podcast by Nate B Jones that argues that Apple is replaying a fifty-year old strategy here. All those years ago anyone who used a computer bought time on a mainframe, the Apple II put far less capable compute into the home and small office. From there came spreadsheets, desktop publishing, and the modern home computer - things that werenвҖҷt possible using mainframes.
He sees the rise of John Ternus as CEO isnвҖҷt merely a switch to a known insider successor - but a bet that the future of AI is sophisticated hardware in the home, office, and pocket. If Open Source models are Good Enough, then why spend money sending tokens - containing your sensitive data - to the AI megacorps?
В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„В В В В В В В В В В В В В В В В вқ„
Talking of five decades in the past, it was in 1974 that Fred Brooks opened one of the most influential books in our profession with these paragraphs:
No scene from prehistory is quite so vivid as that of the mortal struggles of great beasts in the tar pits. In the mindвҖҷs eye one sees dinosaurs, mammoths, and sabertoothed tigers struggling against the grip of the tar. The fiercer the struggle, the more entangling the tar, and no beast is so strong or so skillful but that he ultimately sinks.
Large-system programming has over the past decade been such a tar pit, and many great and powerful beasts have thrashed violently in it. Most have emerged with running systems вҖ” few have met goals, schedules, and budgets. Large and small, massive or wiry, team after team has become entangled in the tar. No one thing seems to cause the difficulty вҖ” any particular paw can be pulled away. But the accumulation of simultaneous and interacting factors brings slower and slower motion. Everyone seems to have been surprised by the stickiness of the problem, and it is hard to discern the nature of it. But we must try to understand it if we are to solve it.
With the title of his recent post Kent Beck summons up that imagery as the Genie Tarpit. After explaining why skilled software development is about building both features and futures, he observes that these AI tools arenвҖҷt doing a good job of producing software with the kind of internal quality that is needed for a good future.
HereвҖҷs what IвҖҷve observed вҖ” genies naturally live down & to the left of muddling. The вҖңplausible deniabilityвҖқ task orientation of the genie leaves it claiming success even though the code doesnвҖҷt work at all. And complexity piles on complexity until even the genie canвҖҷt pretend to make progress any more.
ItвҖҷs still an open question whether, or to what extent, internal quality matters in the age of agentic programming. One view is, as Laura Tacho puts it, вҖңThe Venn Diagram of Developer Experience and Agent Experience is a circleвҖқ. Well organized elements, with good naming, help The Genie understand code, so are important if we can continue to go beyond small disposable systems. The other view is that such internal quality doesnвҖҷt matter, that the galaxy brain of LLMs will make sense of the biggest bowls of spaghetti. Maybe not now, but after a couple more inflections.
ThatвҖҷs the fundamental question. Can The Genie evade the tar pit, or will it struggle fruitlessly against the tarвҖҷs sticky grip?
Facts Only
The debate centers on the importance of internal code quality for Large Language Models (LLMs), known as The Genie, to avoid becoming mired in "spaghetti code."
Apple is facing challenges managing the release of a new AI model due to concerns about its effectiveness and potential unintended consequences.
There is ongoing debate regarding the role of AI in educational settings, with some advocating for increased use while others express reservations about the technology's readiness.
The European Union is in conflict with tech giants like Google and Apple over data privacy regulations.
The UK's Competition and Markets Authority (CMA) has introduced new guidelines to address concerns about the dominance of large tech companies.
Executive Summary
The article discusses recent advancements and concerns in the field of artificial intelligence (AI), specifically Large Language Models (LLMs). It highlights a debate about the importance of internal code quality for these models, known as The Genie, to avoid becoming mired in "spaghetti code." The piece also explores the potential implications of this debate for the future of AI development and its impact on human agency and dignity.
The article further delves into the challenge faced by Apple in managing the release of a new AI model due to concerns about its effectiveness and potential unintended consequences. It also touches upon the ongoing debate regarding the role of AI in educational settings, with some arguing for increased use while others express reservations about the technology's readiness.
In addition, the article discusses the struggle between the European Union and tech giants like Google and Apple over data privacy regulations, as well as the introduction of new guidelines by the UK's Competition and Markets Authority (CMA) to address concerns about the dominance of large tech companies.
Full Take
The article highlights a critical discussion about the internal code quality of Large Language Models (LLMs), known as The Genie, and its impact on avoiding "spaghetti code." This debate raises questions about the readiness of AI for widespread use, particularly in sensitive areas like education.
The challenge faced by Apple in managing the release of a new AI model underscores the need for careful consideration of potential unintended consequences. The ongoing EU-tech giant data privacy conflict reflects broader tensions between regulatory bodies and technology companies, with implications for user privacy and market competition.
The introduction of new guidelines by the UK's CMA to address concerns about tech company dominance signals a growing recognition of the need for regulation in the rapidly evolving AI landscape. The debate over the role of AI in education and its potential impact on human agency and dignity will continue to be a key focus as these technologies become more integrated into our lives.
