How to run a cost‑predictable on‑device llm using llama.cpp on a midrange laptop

Quiet devices are the worst kind: they blend into your home network like wallflowers until something goes wrong. Over the last few years I’ve spent a lot of time hunting down “stealth” IoT gadgets — cameras that phone home on odd ports, smart bulbs that appear under generic hostnames, and devices that never show up in the router GUI. Below I’ll walk you through practical, free techniques and tools I use to find, fingerprint and monitor...

Read more...

I’ve spent years testing devices, pushing firmware images over flaky networks, and waking up to devices bricked by a half-applied update. Firmware updates are where the rubber meets the road for security, reliability and user trust — and they’re also where product teams make mistakes that turn manageable risks into expensive field failures. In this piece I’ll walk through why firmware updates fail in the real world and share concrete...

Read more...

I spend a lot of time working from coffee shops, libraries and coworking spaces, and one question keeps coming up from readers, founders and friends: how do you secure devices and data on an open Wi‑Fi network without turning every connection into a fortress that destroys usability? In this hands‑on guide I walk through the practical steps I use to protect myself and my team in shared spaces. No theoretical laundry list — just workable...

Read more...

When I moved several long-form writing workflows entirely offline, the single biggest friction point was reliable, accurate dictation that respected privacy and worked without an internet connection. Cloud ASR (automatic speech recognition) is great for accuracy, but for sensitive notes, interviews, or fieldwork where connectivity is spotty, on-device speech recognition is the only realistic option. I spent months evaluating and integrating...

Read more...

I started this practical privacy audit because I got tired of vague privacy promises from big tech and wanted something I could apply to my own phone in under an hour. If you carry a smartphone from Google, Apple or Microsoft, you’re handing that company a lot of signals about your life—even when you think you’ve turned everything off. Below I walk through what these companies actually collect, how to find the evidence on your device and...

Read more...

I run inference APIs for models of different sizes — from tiny classification services to multi-GPU transformer endpoints — and one problem always comes up: how do I keep latency predictable without blowing the budget? Autoscaling is the obvious answer, but naïve autoscaling that only looks at CPU or request rate often leads to oscillation, over-provisioning, or surprise bills. In this guide I’ll walk you through a practical, cost-aware...

Read more...

I test product-market fit (PMF) the hard way: not by running expensive cohort studies or waiting for months of traction, but by getting prototypes and ideas in front of real people fast. Over the years I’ve leaned on guerrilla usability sessions — short, focused interviews and hands-on trials in informal settings — combined with a small set of actionable metrics. This combo tells you whether people understand, value and will pay for what...

Read more...

I often get the same questions from founders early in their journey: how much equity should I give away at pre-seed, how do I structure tech milestones so investors trust us, and how can I avoid giving up the wrong kind of control too early? Over the years — testing product hypotheses, building prototypes and negotiating term sheets — I’ve developed a practical framework that balances founder incentives, investor protection and the...

Read more...

I’ve been testing smart home gear for years, and door locks are the one device that makes me pause: they protect your physical space and they're now tied into cloud services, voice assistants and mobile apps. Integrating a consumer smart lock with Alexa or Google Home can be convenient — unlocking your door with voice or automating guest access — but it also raises real security and privacy questions. In this piece I walk through the...

Read more...

I read a lot of pitch decks. Over the years I’ve developed a short list of signals that separate persuasive AI product pitches from noise. When investors, partners, or product teams ask me how to tell whether an AI startup is pointing to real market fit—or just polishing a clever demo—I reach for the same mental checklist. Below I share that checklist, the reasoning behind each item, red flags I’ve repeatedly seen, and practical tests...

Read more...