Open Source & Self-Hostable✓ verified
Changing model or provider is normally an application rewrite; a translating proxy turns it into a routing rule you can measure both sides of.
NVIDIA·2026-09-02
Open Source & Self-Hostable
Inference in the browser is the cheapest deployment there is — no server and no per-token bill — and fast GPU operations across mismatched devices have been the missing floor under it.
Hugging Face·2026-09-01
Open Source & Self-Hostable
A 49B-active open-weight model with a million-token window makes long-document work a self-hosting decision rather than a closed-API one.
Tencent·2026-08-28
Open Source & Self-Hostable
One misplaced system message was busting the cache on every request — worth checking how your own prompt is assembled before blaming the model for being slow.
Ollama·2026-08-21
Open Source & Self-Hostable
Packagers and anyone shipping llama.cpp inside a product finally have a version to pin that does not move with every commit.
llama.cpp·2026-08-21
Open Source & Self-Hostable
Time-to-first-token is what a local model feels like, so halving it changes whether self-hosting is pleasant enough to use for real work.
Ollama·2026-08-19
Open Source & Self-Hostable✓ verified
A closed compiler is a single point of vendor failure for anything built on it; Apache 2.0 on the compiler is what moves Mojo from an interesting runtime to something a team can commit a GPU codebase to.
Modular·2026-08-18
Open Source & Self-Hostable✓ verified
A 27B open-weights model at frontier-index parity is the size that actually fits on hardware you own — the point where running it yourself stops being a downgrade.
Artificial Analysis·2026-08-17
Open Source & Self-Hostable
The gap between "open weights exist" and "I can run them" is a bandwidth-scheduling problem, and this is the clearest published attempt to close it on consumer hardware.
arXiv·2026-08-17
Open Source & Self-Hostable
Anyone pinning llama.cpp in a Dockerfile, systemd unit or run script has a flag rename to make before the next bump — silent, and it fails at start-up rather than at build.
llama.cpp·2026-08-15
Open Source & Self-Hostable✓ verified
A 30B Apache-2.0 model that runs agentic work on your own hardware puts a real floor under what you have to pay a frontier API for — and llama.cpp already ships tool-call handling for it.
Hugging Face·2026-08-10
Open Source & Self-Hostable✓ verified
Tool-calling agents that run entirely on a device change the privacy and cost math for shipping AI features — no per-token bill and no data leaving the machine.
Liquid AI·2026-08-04
Open Source & Self-Hostable
An application company open-sourcing frontier-grade training kernels signals how far serious model infrastructure has spread beyond the big labs.
Cursor·2026-08-04
Open Source & Self-Hostable✓ verified
Self-hosted inference of the newest hot open-weights family just got materially faster on consumer hardware — worth re-benchmarking your local stack.
llama.cpp·2026-08-02
Open Source & Self-Hostable
The cheapest hedge against memory prices is needing less memory - this is the same squeeze that is moving chip stocks, showing up as an engineering constraint on the laptop you already own.
GitHub (drumih/turbo-fieldfare)·2026-07-29
Open Source & Self-Hostable✓ verified
Open weights at frontier scale are only useful if you read the licence first: the revenue threshold is what decides whether self-hosting K3 is a free build or a contract negotiation.
Moonshot AI·2026-07-27
Open Source & Self-Hostable✓ verified
Whatever Debian settles on becomes the reference text other maintainer-run projects copy — and every one of the four options requires contributors to disclose, which turns provenance from an ethics debate into a workflow requirement.
Debian Project·2026-07-24