Kimi K3, unpacked: 896 experts and the trade-offs behind them

Su Jianlin, a Kimi researcher and the author of rotary position embeddings, has published a short paper titled Notes on the MoE and Attention of K3. It concentrates on the trade-offs Moonshot made in expert architecture, training stability, load balancing and attention design. K3 carries 2.8 trillion total parameters and 896 routed experts. The model … Read more

ByteDance refuses the distillation shortcut, and pays for it in the rankings

The Information reported this week that at a Seed all-hands two weeks ago, Zhang Yiming spoke up in a way he rarely does and ruled out using distillation to catch the frontier large language models. His position was blunt: ByteDance should be willing to sacrifice some short-term interest for the sake of the long-term goal. … Read more

OpenRouter, the token router Google backed, is for sale

OpenRouter, the leading large-model API aggregator, is reported to be seeking a buyer and talking to several technology giants. The twist: just two months earlier it closed a 113 million dollar Series B led by Google’s CapitalG, with Nvidia, Snowflake, Databricks and ServiceNow alongside, at a 1.3 billion dollar post-money valuation, processing over 100 trillion … Read more

Google ships robot models, Ant LingBo already works a pharmacy

On 30 July Google DeepMind released Gemini Robotics 2, a family spanning a vision-language-action model, a reasoning model and an on-device model, and for the first time delivering whole-body control of a humanoid. Google’s play is simple to state: own the robot brain layer. In the phone era it sold few handsets but reached most … Read more

China’s dexterous-hand ‘new four’ move from demo to volume

One year ago China’s dexterous-hand field was a pile of demos. Capital was thin, most makers were still validating designs, and annual output sat in the hundreds or low thousands, good for trade shows but not for factories or whole robots. That phase is over. Money moved first. Full-year dexterous-hand funding reached 16.88 billion yuan … Read more