This update to LLM reflects a broader shift in how language models are being integrated into software ecosystems. The move from simple text prompts to structured message sequences and multi-type streaming outputs mirrors the evolution of LLMs themselves, which are increasingly capable of handling complex, multi-modal interactions. The author’s decision to prioritize flexibility—such as allowing users to serialize responses without SQLite—suggests a recognition that developers need tools that ada...