AI
Artificial intelligence explained simply: how it works, where it helps and how to use it well. Showing page 2 of 2 (15 total articles).
Why LLMs Run Out of VRAM: KV Cache Fragmentation and the PagedAttention Fix
LLMs often crash because their key‑value cache fragments. I’ll show why that happens and how PagedAttention solves the problem.
Why VRAM bandwidth determines token speed in local LLMs
VRAM bandwidth, not just size, caps how fast a local LLM can generate text. I explain the bottleneck and how to work around it.
Building Reliable AI Agents: Beyond Simple If-Statements
A guide to creating AI agents that work reliably, avoiding the trap of turning them into just if‑statement wrappers.
Understanding Chain‑of‑Thought Prompting and How to Keep LLM Reasoning Faithful
A friendly guide to chain‑of‑thought prompting and how to make LLM reasoning stay on track.
Why Better Vector Search Indexes Matter More Than More Training for LLMs
A solid vector search index can make your LLM feel smarter without any extra model training.
Understanding How Transformers Capture Meaning in Language Models
Explore how transformers turn words into meaning, using attention and embeddings, in a clear, beginner‑friendly guide.
Need help building a website?
Send me a message and let's talk.