The M6 Mac mini starts at $899 with up to 4x faster on-device AI than M4, 64GB unified memory on M5 Pro, and Thunderbolt clustering for larger local models. Apple is finally naming the use case developers already bought it for.
Bonsai 27B compresses Qwen3.6-27B to binary weights at 3.9 GB with Apache 2.0 licensing. That is the first time a 27B-class multimodal agent fits inside a phone memory budget.
Muse Glimmer ships Apache 2.0 weights tuned for local tool loops, failure recovery, and multimodal agents. Here is what matters if you build on-device AI instead of renting frontier APIs.
Google's open-weight DiffusionGemma denoises 256-token blocks in about 12 passes, reaching roughly 1,500 output tokens per second on a single H100 at batch size 1. Here is where that speed matters, what you trade away, and how to serve it with vLLM.
Alibaba's Qwen3.8-27B fits on a single RTX 4090 with Unsloth's Dynamic GGUF quants. Day-zero fine-tuning support makes local agent stacks practical.
Google’s Gemma 4 12B is multimodal with a 256K context window. Unsloth’s Dynamic GGUFs squeeze a usable 4-bit build into roughly 8GB of memory without throwing quality off a cliff.
Unsloth shipped dynamic NVFP4 Qwen3.6 checkpoints on July 10 that beat NVIDIA's own NVFP4 on throughput while holding benchmark accuracy. Here is the backend choice that makes or breaks the speedup.
Krea AI open-sourced Krea 2, a 12.9B-parameter diffusion transformer trained from scratch. Turbo runs in 8 steps on GGUF quants that fit 12GB VRAM. Raw is the fine-tune base; Turbo is what you ship.