Posts tagged: inference
Programming the NPU — ONNX Runtime, CoreML, DirectML, and Deploying to Apple ANE and XDNA 2
How to actually program NPUs — the software stacks, runtime compilers, quantization pipelines, and practical gotchas for Apple ANE, AMD XDNA 2, Qualcomm Hexagon, and Intel AI Boost.
Will LLM Tokens Become Like Bandwidth — Abundant and Cheap?
Mapping the submarine cable story to LLM inference — competition, open-source, and whether tokens will ever be "unlimited" like bandwidth.
The Future Stack — UI, Inference, Database
What if the traditional backend (REST APIs, business logic, middleware) gets absorbed by inference, leaving only UI, an LLM, and a database?
Self-Hosting DeepSeek V4 for Uncensored Local Inference
A practical guide to running DeepSeek V4 locally — model weights, hardware requirements, deployment options, and what you get vs the censored API.