Following opens with early access — sign up for early access to register your interest; it does not switch following on today. Everything you follow will land on one page, in your account menu.

1. Open Source & Self-Hostable

   Ant Group releases the weights of its 560B-parameter Ling-3.1-flash model

   Another very large open-weight MoE model is now self-hostable, and the four-GPU mixed-precision setup brings it within reach of a single server.

   TechNode·2026-10-16
2. Open Source & Self-Hostable

   NVIDIA's Nemotron 3.5 Super, a 120B open vision-language model, is now runnable in Ollama

   A 24 GB-class agentic model with a 1M-token context is a practical option for teams that need to keep agent workloads on their own hardware.

   Ollama / NVIDIA·2026-10-15
3. Open Source & Self-Hostable

   NVIDIA adds a 64GB DGX Spark as the 128GB model's price jumps to $6,950

   Local-inference hardware just got a cheaper entry point and a more expensive top tier, so anyone budgeting for desk-side AI boxes should re-price now.

   ServeTheHome·2026-10-03
4. Open Source & Self-Hostable

   Moonshot's Kimi K3 enters OpenAI's enterprise Codex channel and billing

   Enterprises can use a leading Chinese open model inside an existing OpenAI contract without a new supplier agreement, which changes vendor-risk reviews.

   TechNode·2026-09-30
5. Open Source & Self-Hostable

   Ant Group's Ling 3.1 Flash, a 560B-parameter MoE model, launched with a free trial and promised open weights

   Another large Chinese MoE you can trial free now, and possibly self-host later if the open-weights promise is kept.

   Vercel·2026-09-30
6. Open Source & Self-Hostable✓ verified

   NVIDIA opened a proxy that lets one application speak both the OpenAI and Anthropic APIs

   Changing model or provider is normally an application rewrite; a translating proxy turns it into a routing rule you can measure both sides of.

   NVIDIA·2026-09-02
7. Open Source & Self-Hostable

   Hugging Face published 200-plus WebGPU kernels so models can run in the browser

   Inference in the browser is the cheapest deployment there is — no server and no per-token bill — and fast GPU operations across mismatched devices have been the missing floor under it.

   Hugging Face·2026-09-01
8. Open Source & Self-Hostable

   Tencent open-sourced Hy4 preview - 770B total parameters, 49B active, a 1M-token context

   A 49B-active open-weight model with a million-token window makes long-document work a self-hosting decision rather than a closed-API one.

   Tencent·2026-08-28
9. Open Source & Self-Hostable

   Ollama's 0.33 preview lets you switch local models on and off inside Claude's desktop app

   One misplaced system message was busting the cache on every request — worth checking how your own prompt is assembled before blaming the model for being slow.

   Ollama·2026-08-21
10. Open Source & Self-Hostable

    llama.cpp starts a stable release channel with v0.2.0

    Packagers and anyone shipping llama.cpp inside a product finally have a version to pin that does not move with every commit.

    llama.cpp·2026-08-21
11. Open Source & Self-Hostable

    Ollama halves time-to-first-token by caching resolved model metadata

    Time-to-first-token is what a local model feels like, so halving it changes whether self-hosting is pleasant enough to use for real work.

    Ollama·2026-08-19
12. Open Source & Self-Hostable✓ verified

    Modular opens the Mojo compiler under Apache 2.0, a week after Mojo 1.0

    A closed compiler is a single point of vendor failure for anything built on it; Apache 2.0 on the compiler is what moves Mojo from an interesting runtime to something a team can commit a GPU codebase to.

    Modular·2026-08-18
13. Open Source & Self-Hostable✓ verified

    Qwen 3.8 27B scores 52 on the Artificial Analysis Intelligence Index, level with models far larger

    A 27B open-weights model at frontier-index parity is the size that actually fits on hardware you own — the point where running it yourself stops being a downgrade.

    Artificial Analysis·2026-08-17
14. Open Source & Self-Hostable

    FreeToken serves a 753B open-weight model from a single workstation GPU

    The gap between "open weights exist" and "I can run them" is a bandwidth-scheduling problem, and this is the clearest published attempt to close it on consumer hardware.

    arXiv·2026-08-17
15. Open Source & Self-Hostable

    llama.cpp folds --mmap, --no-mmap, --mlock and --direct-io into one --load-mode flag

    Anyone pinning llama.cpp in a Dockerfile, systemd unit or run script has a flag rename to make before the next bump — silent, and it fails at start-up rather than at build.

    llama.cpp·2026-08-15
16. Open Source & Self-Hostable✓ verified

    Meta releases Muse Glimmer, a 30B Apache-2.0 multimodal model built for local agentic use

    A 30B Apache-2.0 model that runs agentic work on your own hardware puts a real floor under what you have to pay a frontier API for — and llama.cpp already ships tool-call handling for it.

    Hugging Face·2026-08-10
17. Open Source & Self-Hostable✓ verified

    Liquid AI releases LFM2.5-2.6B, an open-weights on-device model built for local agents

    Tool-calling agents that run entirely on a device change the privacy and cost math for shipping AI features — no per-token bill and no data leaving the machine.

    Liquid AI·2026-08-04
18. Open Source & Self-Hostable

    Cursor open-sources Mixture-of-Kittens, a deterministic MoE training megakernel for NVL72 racks

    An application company open-sourcing frontier-grade training kernels signals how far serious model infrastructure has spread beyond the big labs.

    Cursor·2026-08-04
19. Open Source & Self-Hostable✓ verified

    llama.cpp merges multi-token prediction for DeepSeek V4 — local decode roughly 50% faster

    Self-hosted inference of the newest hot open-weights family just got materially faster on consumer hardware — worth re-benchmarking your local stack.

    llama.cpp·2026-08-02
20. Open Source & Self-Hostable

    A 26-billion-parameter model running in about 2 GB of RAM on an 8 GB MacBook

    The cheapest hedge against memory prices is needing less memory - this is the same squeeze that is moving chip stocks, showing up as an engineering constraint on the laptop you already own.

    GitHub (drumih/turbo-fieldfare)·2026-07-29
21. Open Source & Self-Hostable✓ verified

    Moonshot puts the Kimi K3 weights on Hugging Face — under a licence that bills large model-as-a-service resellers

    Open weights at frontier scale are only useful if you read the licence first: the revenue threshold is what decides whether self-hosting K3 is a free build or a contract negotiation.

    Moonshot AI·2026-07-27
22. Open Source & Self-Hostable✓ verified

    Debian puts LLM-assisted contributions to a project-wide vote — four proposals from outright ban to accept-with-responsibility

    Whatever Debian settles on becomes the reference text other maintainer-run projects copy — and every one of the four options requires contributors to disclose, which turns provenance from an ethics debate into a workflow requirement.

    Debian Project·2026-07-24