5:09Open-weight AI just hit 2.8 trillion parameters…
Kimmy K3 Release and Capabilities Kimmy K3, an open-source AI model from Chinese lab Moonshot, boasts 2.8 trillion parameters. It is a multimodal Mixture of Experts model with a 1 million token context window. Optimized for long-horizon reasoning and coding, it features 896 experts, with 16 activating per token. K3's scaling is 2.5 times more efficient than K2. Performance and Benchmarks K3's "Trust Me Bro" benchmark performance rivals or beats Claude Fable and GPT 5.6 Soul. It ranks #1 on the front-end code arena (1679 ELO) and top 3 on the Artificial Analysis Intelligence Index. However, some benchmarks used Moonshot's proprietary harness, potentially inflating its coding performance. Moonshot admits K3 trails Fable and GPT 5.6 Soul overall, particularly on tasks like "humanity's last exam". Artificial Analysis reported a 51% hallucination rate for K3. K3 tends to output more tokens than necessary, potentially increasing costs. While impressive for an open model in UI design and data visualization, it's still considered slightly behind Fable and GPT Soul. Accessibility and Infrastructure The model weights are open-source, allowing for theoretical self-hosting. Running K3 requires data center-caliber GPUs, not typical consumer gaming GPUs. K3's high demand led to GPU shortages and sold-out paid plans upon release. Geopolitical Context and Open Source Debate China's Communist Party is advocating for free and open AI, contrasting with US calls for regulation. There are calls in the US to ban Chinese AI models, with discussions of entity listing Chinese AI labs. OpenAI's Dean believes open weights are "decelerationist," a sentiment compared to historical arguments against Linux. The release of powerful open models like K3 and Alibaba's Quen 3.8 (2.4 trillion parameters) challenges the dominance of closed, frontier models.







































