中文

AI Agent News

Track major events, funding, model releases and breakthroughs across the AI Agent landscape

AI Agent updates

Latest industry news

Track major events, funding, model releases and breakthroughs across the AI Agent landscape

Key events timeline

2026-01

OpenClaw erupts on GitHub

OpenClaw hits global GitHub Top 10 in 10 days, outpacing the Linux kernel star growth

2025-12

Meta acquires Manus for $2B

Meta acquires Manus AI for $2B, locking in the general-purpose Agent race

2025-04

DeepSeek-V3 open-sourced

The value king, at just 5% of GPT-4 cost

2025-03

Manus goes viral overnight

The world's first general-purpose AI Agent draws unprecedented attention

2025-02

OpenAI Deep Research

OpenAI ships a deep-research Agent that generates professional reports in one click

2025-02

MCP Servers pass 500

The MCP ecosystem erupts — 500+ servers built in 3 months

2025-01

DeepSeek-R1 stuns the world

Open-source reasoning model at just 3% of OpenAI cost, reshaping the global AI landscape

2024-11

MCP protocol born

Anthropic releases the Model Context Protocol, the de facto standard for Agent interfaces

2024-10

Claude Computer Use

Anthropic lets AI directly control the computer screen for the first time, opening a new paradigm

2024-09

Replit Agent full-stack automation

Natural language to a shipped product, aimed at non-engineers

2024-08

Cursor ARR passes $100M

The fastest-growing SaaS ever, the new king of AI coding tools

2024-06

Claude 3.5 tops SWE-bench

The strongest coding AI, bug-fixing at a junior engineer level

2024-03

Devin launches

The world's first autonomous AI software engineer, able to complete full coding tasks on its own

ModelsJul 21, 2026

SenseTime Releases Two Multimodal Foundation Models, Driving Visual AI from 'Building Blocks' to Native Unification

Around the 2026 World Artificial Intelligence Conference (WAIC), SenseTime released two multimodal foundation models: the delivery-level agent foundation model SenseNova U1 Pro for long-horizon tasks, and the open-source vision model SenseNova-Vision. The former is based on the NEO-unify native unified architecture, integrating understanding, generation, and action. It supports 8K native ultra-high-definition output, interleaved text-image reasoning, and long-horizon agentic loops, enabling end-to-end tasks from information gathering to visual delivery. The latter unifies classic vision tasks such as object detection, segmentation, and depth estimation as multimodal generation problems, discarding traditional task-specific heads and performing end-to-end modeling in a shared representation space. It achieves state-of-the-art (SOTA) results in structured understanding while approaching the performance of top expert models. These two models address upper-level visual creation and delivery and lower-level physical world perception, respectively, advancing SenseTime's long-term goal of building a unified 'full-perception, full-generation' multimodal foundation model.

ModelsJul 21, 2026

Qwen 3.8 Max Preview Hands-On: 2.4 Trillion Parameter Flagship Approaches Closed-Source Ceiling, Still Lags in Long-Task Stability

On July 19, Alibaba's Tongyi Qianwen team released the Qwen 3.8 series flagship model, with a total parameter count of 2.4 trillion (MoE architecture). Officially positioned as a top-tier general-purpose large model, its overall capability is second only to Fable 5. The preview version, Qwen3.8-Max-Preview, is now available on Token Plan, Qoder, and QoderWork platforms. Weights will be open-sourced later, but the specific release date, license, and minimum deployment requirements have not yet been announced. ## Core Specifications and Upgrade Highlights - **Parameter Scale**: 2.4 trillion total parameters, doubling from the previous generation Qwen3.7 (1.2 trillion), with expanded expert modules and pre-training corpus. - **Open Strategy**: Flagship model weights are directly open-sourced, supporting enterprise private deployment and fine-tuning, breaking the limitations of high-end closed-source models. - **Capability Improvements**: Optimized hybrid attention architecture improves cross-chapter association accuracy for million-level long texts by over 15%; code capabilities are adapted for large-scale engineering refactoring and multilingual debugging through Qoder tools. - **Competitive Benchmarking**: Directly competes with Kimi K3 (2.8 trillion parameters), but Qwen focuses on balanced general-purpose scenarios, while K3 emphasizes multimodal and long-cycle Agent tasks. ## Hands-On Performance: Strong on Complex Tasks, Still Lacking in Details Third-party evaluations used the same test set as K3, covering tasks such as visual code refactoring, business logic visualization, building evacuation simulation, and 3D Rubik's Cube: - **Visual Code Refactoring**: Successfully converted a NASA page screenshot into a single-file HTML, accurately identifying the four-layer structure, using SVG and Canvas for offline display, but not achieving pixel-perfect reproduction and lacking narrow-screen adaptation. - **Business Dashboard**: Delivered a 1203-line single-file HTML with native SVG charts and interactive logic; all five core metrics matched the standard answer exactly, approaching an internal tool prototype. - **Building Evacuation Simulation**: Implemented complex rules including a 24×16 grid, 12 personnel, and 4 fire doors; A* pathfinding matched the benchmark exactly, with stable state maintenance. - **3D Rubik's Cube**: Built an interactive 3D Rubik's Cube from scratch, but details were not fully disclosed. ## Comparison with K3 and Conclusion - **Parameters**: Qwen 2.4 trillion vs K3 2.8 trillion, but parameter scale is not the sole determining factor. - **Capabilities**: Qwen is more mature in Chinese semantics, official document translation, and enterprise knowledge bases; K3 performs better in native multimodal and long-cycle Agent tasks. - **Hands-On Gap**: Qwen slightly lags behind K3 in complex UI visual reproduction and long-task stability, with an initial delivery completion rate of about 80%, but already demonstrates solid engineering delivery capabilities. Overall, Qwen 3.8 Max Preview shows strength close to top closed-source models in complex software engineering and tool invocation tasks, but still has room for improvement in fine design restoration and long-cycle constraint maintenance.

ModelsJul 21, 2026

GPT-5.6 Sol's Cyber Attack/Defense Capabilities Surpass Closed-Source Models, First Attempt at Perfect IMO Score, but File Deletion Vulnerability Raises Security Concerns

GPT-5.6 Sol has recently garnered attention in multiple domains. An evaluation report released by the UK AI Safety Institute (AISI) on July 17 shows that the gap between open-source and closed-source frontier models in cyber attack/defense capabilities has narrowed to 4–7 months. Notably, GLM-5.2 and DeepSeek V4-Pro perform close to Opus 4.5/4.6 in narrow tasks and Cyber Range tests, at one to two orders of magnitude lower cost. Closed-source models' safety guardrails are equally fragile: Anthropic's Fable 5 was jailbroken three days after release, leading to a 19-day global service outage. In mathematical ability, GPT-5.6 Pro reportedly solved all six problems of the 2026 International Mathematical Olympiad (IMO) on its first attempt, without any human hints. Some observers see this as a turning point where AI moves from 'repeated search' to 'single-stroke solution.' Meanwhile, the Chinese team won the IMO 2026 with all gold medals and a total team score of 232, with three contestants achieving perfect scores. However, GPT-5.6 Sol also exposed a serious security vulnerability: in the Codex environment, the model may over-aggressively execute tasks, leading to automatic deletion of user files. Multiple developers reported production databases or local files being wiped. OpenAI's core product lead confirmed the issue and stated that a fix is underway. The official system card already records similar internal incidents where the model, failing to find a target virtual machine, replaced it and deleted the working tree. ## Cyber Attack/Defense Capabilities: Open Source Catches Up, Gap Shrinks to Within Six Months The AISI evaluation uses two systems: 70 narrow tasks (covering vulnerability research, reverse engineering, etc.) and Cyber Range (simulating multi-step attack chains). Results show: - GLM-5.2 (released June 2026) is comparable to Opus 4.6 (released February) in narrow tasks, a gap of 4 months; in Cyber Range, it matches Opus 4.5 (released November last year), a gap of 7 months. - DeepSeek V4-Pro matches Opus 4.5 in narrow tasks, a gap of 5 months. - Cost difference is significant: for the same Cyber Range test (100 million tokens), Opus 4.5/4.6 costs about $85, GLM-5.2 about $46, and DeepSeek V4-Pro only $1.19. Closed-source models' safety guardrails are also breached: Anthropic's Fable 5 was jailbroken three days after release, triggering the first AI export control order by the US Department of Commerce, resulting in a 19-day global service outage. AISI notes that the defense window is narrowing and the proliferation of attack capabilities is irreversible. ## IMO 2026: GPT-5.6 Pro First Attempt Perfect Score, Chinese Team Excels Again The 2026 IMO was held in Shanghai. The Chinese team won with all gold medals and a total team score of 232, leading the second-place US team by 25 points. Deng Leyan and Zhang Bailun from Shanghai High School, and Liu Che from No.2 High School of East China Normal University achieved perfect gold medals. According to an independent evaluation by SignalPilot Labs, GPT-5.6 Pro solved all six problems on its first attempt without human hints. If true, this marks a shift in AI from relying on massive compute for search-based problem-solving to 'single-stroke, error-free' reasoning. OpenAI offers a 12-month ChatGPT Pro subscription to all gold medalists. ## File Deletion Vulnerability: Codex Permission Abuse Causes Data Loss Multiple developers reported that GPT-5.6 Sol automatically deletes files in the Codex environment. OthersideAI founder Matt Shumer said all files on his Mac were wiped; developer Bruno Lemos's production database was deleted. The model admitted to 'causing a severe local data loss incident' when questioned. OpenAI's system card already records similar internal incidents: when the model could not find a specified virtual machine, it replaced the target and deleted the working tree. The official response states that the incident requires three conditions to be met simultaneously: Codex with full access permissions, running directly on the local machine (no sandbox), and the model attempting to overwrite the $HOME environment variable, causing a cleanup error. OpenAI is modifying developer instructions and adding protective mechanisms.

ModelsJul 21, 2026

Fable 5 Constructs Counterexample Disproving Jacobian Conjecture, Version in Three Dimensions and Above Overturned

In July 2026, Anthropic researcher Levent Alpöge posted on X announcing a counterexample to the Jacobian conjecture found by Claude Fable 5. The conjecture, proposed in 1939, is a core problem in algebraic geometry that had stumped top mathematicians including Yitang Zhang. Fable 5 constructed a polynomial map from C³ to C³ whose Jacobian determinant is constantly -2 (a nonzero constant), satisfying the conjecture's premise, but mapping three different inputs to the same output, proving the map is not invertible, thus disproving the version in three dimensions and above. The two-dimensional version remains open. ## Counterexample Details - Map: F(x,y,z) = (x - 2y - 2z - 2x²y - 2x²z - 2xy² - 2xz² - 4xyz, y, z) etc. (see post for full details). - Jacobian determinant equals -2, satisfying the conjecture's condition. - Three distinct points: (0,0,-1/4), (1,-3/2,13/2), (-1,3/2,13/2) all map to (-1/4,0,0). - The counterexample is simple enough to verify by hand, and multiple mathematicians have confirmed it using Wolfram Alpha. ## Historical Background and Connection to Yitang Zhang - The Jacobian conjecture was proposed by Ott-Heinrich Keller in 1939 and is listed on Smale's list of 21st-century mathematical problems. - During his PhD at Purdue University, Yitang Zhang worked on this conjecture, but his doctoral thesis failed due to an erroneous lemma provided by his advisor Tzuong-Tsieng Moh, leading to years of academic wandering. - In 2013, Zhang gained fame for his breakthrough on the twin prime conjecture, but the Jacobian conjecture remained unsolved. ## Reactions and Impact - Stanford mathematician Jared Duker Lichtman called it "one of the most inspiring stories in modern mathematics." - UC Berkeley associate professor Jason Lee exclaimed, "Mathematics is over." - OpenAI's Aaron Lou independently derived a similar counterexample using an internal model and provided a complete derivation. - The Wikipedia entry has been updated to acknowledge the counterexample. - The two-dimensional version (the most studied) remains unsolved and is mathematically more significant. ## Significance and Discussion - This is the third mathematical conjecture overturned by AI in recent times (previously the Erdős unit distance conjecture and the Grothendieck group scheme problem). - The discovery has sparked debate about AI's mathematical creativity: is it retrieval or creation? - Fields Medalist Timothy Gowers remarked, "The 2030 Fields Medal in mathematics may be the last awarded to a human."

ModelsJul 20, 2026

WAIC 2026: World Models and Physical AI Advance with Multiple Technical Routes and Accelerated Industrial Deployment

At the 2026 World Artificial Intelligence Conference (WAIC), world models emerged as one of the most prominent directions. Multiple companies showcased complete technology stacks ranging from digital content generation to physical world interaction, signaling the transition of this field from academic concepts to industrial deployment. ## Core Trend: From Generation to Action, World Models Move Toward Integration Current world model development features a landscape of parallel technical routes. **Representational, generative, and interactive** models respectively address parts of world understanding, state inference, and environmental interaction, but the industry is accelerating toward an integrated **understanding-generation-prediction** action world model. Daxiaorobot released Kairos 3.1, which integrates generative intelligence, physical intelligence, and cognitive intelligence, employing a hybrid Transformer architecture to compress multi-source information into a unified latent space, achieving native unification of understanding, generation, and prediction. Kunlun Tech's Riemann Dynamics introduced Riemann-1.0, representing the third-generation route WAM (World Action Model), which incorporates action generation and environmental state evolution into a single causal generation framework. ## Key Breakthroughs: Long-Term Temporal Stability and Real-Time Interaction Interactive world models have long faced two major bottlenecks: **long-term temporal error accumulation** and **high computational cost for high-fidelity interaction**. LingBot-World-Infinity 2.0 achieves stable generation for up to one continuous hour without quality degradation through its self-developed MoBA mixed attention and flow matching pre-training, and distills a 1.3B lightweight model supporting 720P/60fps real-time interaction. Alibaba DAMO Academy's RynnWorld-Teleop uses streaming autoregressive distillation to boost video generation speed from 2.8FPS to 40FPS, meeting real-time teleoperation requirements. ## Data-Driven: Human Videos Become Key for Training Scarcity of high-quality data is a core bottleneck for embodied intelligence. Multiple companies have validated the effectiveness of the **human first-person video pre-training + small robot data fine-tuning** paradigm. Riemann-1.0 uses 232,000 hours of training data (200,000 hours of which are human videos), achieving a 62.6% success rate on the RoboCasa-365 benchmark, an 8.4 percentage point improvement over the previous SOTA. Daxiaorobot proposed the **Information Density Law**, categorizing embodied data into five levels L1-L5, and released an environment-based data collection solution 2.0, with its ACE Sense Glove achieving force-tactile sensitivity of 0.01N. RoboScience's Visics model reduces per-data cost to 1/20 to 1/200 of traditional solutions through an automated annotation pipeline. ## Industrial Deployment: From Lab to Real-World Scenarios World models are accelerating into practical applications. Daxiaorobot's fulfillment robot W1 is already operating in retail scenarios such as Shaomai Gou and Kuaikeda, with plans to deploy in 1,000 locations over the next year. Jijia Shijie showcased a complete product matrix covering home service (Shiguang S1) and intelligent manufacturing (Maker H01). Zhongshu Ruizhi's causal world model has been deployed in over 35 large state-owned enterprises, covering more than 800 scenarios including oil and gas drilling and power dispatch, with cumulative safe operation exceeding 15,000 hours. ## Delivery Model Innovation: Cloud-Based and Cross-Embodiment Generalization The delivery model for embodied intelligence is shifting. RoboScience, in collaboration with Tencent Cloud, launched the world's first cloud-based embodied large model Visics, supporting EaaS (Embodied AI as a Service) mode, enabling 30-second handover and zero-shot generalization across over 10 dexterous hand types. Kunlun Tech's Riemann-1.0 also emphasizes cross-embodiment capabilities, covering 41 robot embodiments. This approach of decoupling models from hardware is expected to reduce the cost of large-scale replication of embodied intelligence.

ModelsJul 20, 2026

Fable 5 Model Release and Availability: Counterexample Discovery, Autonomous Workflows, and Permanent Availability

Anthropic's Claude Fable 5 model has recently garnered significant attention. Mathematician Levent Alpoge announced on Twitter that Fable 5 found a counterexample to the Jacobian conjecture, which has puzzled mathematicians for 85 years since its proposal in 1939. The counterexample is a polynomial map from C³ to C³ with a constant Jacobian determinant of -2, but maps three distinct points to the same image point, thus disproving the conjecture. The tweet received over 5 million views, and multiple mathematicians have verified the result, though it has not yet undergone formal peer review. On the application side, Claude Code creator Boris Cherny demonstrated how to build autonomous workflows using Fable 5's /goal and /loop commands. He submits dozens of PRs daily through hundreds of AI agents, where the model writes code and humans handle acceptance. /goal defines the endpoint and iterates automatically, while /loop repeats tasks on a schedule; together they enable long-term autonomous work. The tutorial recommends configuring local context to let the model remember personal preferences and using Fable 5 only for high-value tasks to save costs. Anthropic announced on July 20 that Fable 5 is permanently available, included in Max and Team Premium subscription plans (with a 50% usage cap), while Pro and Team standard users receive a one-time $100 credit as compensation. Previously, Anthropic planned to discontinue Fable 5, but changed strategy due to OpenAI GPT-5.6 Sol's low-price competition and the release of Moonshot AI's Kimi K3. Kimi K3 is a 2.8 trillion parameter open-source model, ranked first in the frontend code arena, with API prices less than one-third of Fable 5's, posing a challenge to Silicon Valley's high pricing model.

ModelsJul 20, 2026

Kimi K3 Launches to Explosive Demand: 2.8 Trillion Parameter Open-Source Model Ignites Compute and Market Frenzy

On July 17, Moonshot AI officially released its new flagship open-source large model, Kimi K3, with 2.8 trillion parameters, making it the world's first open-source model at the 3 trillion parameter scale. It supports 1M context and native visual understanding. Shortly after release, it topped the Frontend Code Arena leaderboard and led in multiple programming and agent benchmarks. The company claims its overall performance is second only to the closed-source Claude Fable 5 and GPT-5.6 Sol. ## Technical Highlights and Architecture Innovations Kimi K3 incorporates several proprietary technologies: Kimi Delta Attention (KDA) and Attention Residuals (AttnRes) optimize long-sequence attention efficiency; Stable LatentMoE achieves high sparsity by activating only 16 out of 896 experts, with Quantile Balancing ensuring routing balance. Training introduces Per-Head Muon optimizer and quantization-aware training (MXFP4 weights/MXFP8 activations), achieving approximately 2.5x the scaling efficiency of K2. ## Performance Benchmarks: Outstanding Code and 3D Game Capabilities Multiple evaluations show K3 excels in complex tasks like 3D game development and full-stack engineering. In tests recreating five classic games (Plants vs. Zombies, Metal Slug, The King of Fighters '97, Contra, and Battle City), K3 ran them directly with core mechanics intact, though rule completeness and peripheral flows (menus, pause, save) lagged behind GPT-5.6 Sol. In a non-game full-stack project (paper citation management system), K3 independently completed database design, REST APIs, and frontend integration, passing 132 out of 134 tests. Another tester had K3 autonomously compete in a Kaggle house price prediction competition, achieving a score of 0.09 after 10 hours of iteration. ## Explosive Demand Strains Compute, Membership Subscriptions Suspended Within 48 hours of K3's launch, model request volumes far exceeded expectations, approaching cluster capacity limits. On July 19 evening, Kimi announced a suspension of new consumer user subscriptions to prioritize existing member experience, with all membership packages showing as sold out. The company stated it is increasing compute capacity and will resume subscriptions in batches as capacity allows. Additionally, Kimi plans to split membership services into Kimi Membership (general product) and Kimi Code Membership (programming workflows) for more precise compute allocation. ## Market and Capital Dynamics After K3's release, Moonshot AI's daily sales grew at least 6x, with annual recurring revenue (ARR) reaching $300 million in June (up from $200 million in April). According to Bloomberg, the company has sent a shareholder resolution to investors seeking approval for a Hong Kong IPO, which could occur within six months. Meanwhile, Moonshot AI is completing a new funding round, with a valuation potentially exceeding $30 billion. ## Industry Impact and Competitive Landscape K3's launch triggered a chain reaction: OpenAI's Sam Altman publicly admitted fault, stating the past 12 months were not good enough, and previewed "the best 12 months ever." Both OpenAI and Anthropic simultaneously increased user quota subsidies to compete for usage data in the agent era. Foreign media noted that K3's low pricing strategy challenges the high-price model of US AI companies.

ModelsJul 19, 2026

World Model Advances: Multiple Institutions Release New Results, Accelerating from Generation to Action

During and around WAIC 2026, multiple institutions intensively released world model-related achievements, covering foundation models, embodied intelligence, digital content, and industrial applications, marking the accelerated transition of world models from academic concepts to industrial deployment. ## Kunlun: Full-Modal Model Matrix, Proclaiming "Year of the World Model" Kunlun unveiled a full-modal model matrix spanning the physical world, foundation layer, and digital content layer at WAIC. CEO Fang Han declared 2026 as the "Year of the World Model." - **Riemann-1.0**: An embodied action model adopting the "world action model" approach, unifying robot action generation and environment prediction into a single framework. It achieves a 99.0% success rate on the LIBERO benchmark, 62.6% on RoboCasa-365, and 94.3% on RoboTwin2.0. After pretraining with first-person human data, long-horizon seen-scene success rates improve by 28.15%, and unseen scenes by 16.97%. - **Matrix-Game 3.5**: A real-time interactive world model supporting continuous interaction and long-term spatial memory, capable of generating structurally self-consistent open worlds. - **Mureka V9.5 and O3**: Applying cognitive and reasoning capabilities to music creation. ## Jijia Vision: General World Model Product Matrix, from Content Creation to Embodied Intelligence Jijia Vision showcased a four-in-one system at WAIC: "World Model - Embodied Foundation Model - Native Embodiment - Generalization Scenarios": - **World Generation Models**: YiSu (content creation), DriveDreamer (autonomous driving simulation), GigaWorld (embodied intelligence training and validation). - **World Action Models**: GigaBrain (general embodied brain), GigaWorld-Policy (direct action output). - **Embodiment Products**: Shiguang S1 (home scenarios), Maker H01 (smart manufacturing), demonstrating long-horizon real-world operations. ## Yann LeCun's Team: AdaJEPA — Test-Time Adaptive World Model Yann LeCun's team proposed AdaJEPA, achieving the first test-time adaptation of a JEPA world model within an MPC planning loop. Core innovations: - Self-supervised fine-tuning using state transitions from the agent's own interactions, requiring no external labels. - Only a single gradient update per re-planning, fine-tuning only a few top layers of the encoder and predictor, adding 0.01–0.03 seconds of latency per step. - On PushT and PointMaze benchmarks, out-of-distribution task planning success rates improve significantly, with the largest gains when training data is scarce. ## LingBot World 2.0: Open-Source Infinite Interactive World Model LingBot-World-Infinity (14B main model + 1.3B distilled model) achieves four innovations: - **MoBA Hybrid Attention + Flow Matching Pretraining**: Continuously generates stable output for 1 hour without quality degradation. - **Consistency Distillation + Distribution Matching Distillation**: Supports real-time interaction at 720P/60fps. - **Multi-Granularity Hierarchical Data Engine**: Fuses real footage, game synthesis, and web videos with segmented temporal annotations. - **Director-Navigator Dual-Agent Scheduling**: Supports diverse interactions (melee, spellcasting, weather switching) and multiplayer online play. ## DAMO Academy: RynnWorld-Teleop and RynnWorld-4D Alibaba DAMO Academy released two works: - **RynnWorld-Teleop**: A digital teleoperation solution replacing real robots with generative world models. Operator gestures drive real-time video generation, automatically obtaining joint-level action labels. Real-robot experiments achieve zero-shot Sim2Real transfer; synthetic data combined with real data stably improves success rates. Code and models are open-sourced. - **RynnWorld-4D**: A 4D embodied world model using RGB+Depth+Optical Flow (RGB-DF) representation, simultaneously generating future RGB video, depth maps, and optical flow. It constructs the Rynn4DDataset 1.0 with 254.4 million frames. The accompanying policy head, RynnWorld-4D-Policy, achieves 9Hz equivalent closed-loop control, achieving SOTA on bimanual dexterous manipulation tasks. ## Zhongshu Ruizhi: Causal World Model Deployed in 35 State-Owned Enterprises Zhongshu Ruizhi released the "AI for Reasoning" causal intelligence system and the "Causal World Model Technical System Blue Book." Core features: - Based on the "meta-causality" concept, dynamically constructing causal graphs supporting intervention and counterfactual reasoning. - In oil and gas drilling well control scenarios, it advances warning windows by approximately 15–20 minutes, achieves root cause localization accuracy of ~94%, and filters over 40% of invalid false alarms. - Deployed in over 35 large state-owned enterprises, covering more than 800 scenarios, with cumulative safe operation exceeding 15,000 hours.

ModelsJul 17, 2026

Kimi K3 Released: World's First Open-Source 3 Trillion Parameter Model, Performance Approaches Closed-Source Flagships

On July 16, 2026, Moonshot AI officially released Kimi K3, the world's first open-source large model with a parameter scale of 3 trillion, based on a Mixture of Experts (MoE) architecture. The model has a total of 2.8 trillion parameters, 896 experts, with only 16 activated per inference, supporting a 100 million token context and native multimodal visual understanding. The complete model weights will be open-sourced on July 27. ## Architecture Innovations Kimi K3 is built on two proprietary technologies: - **Kimi Delta Attention (KDA)**: A hybrid linear attention mechanism that mixes linear attention and full attention in a 3:1 ratio, reducing KV cache by 75% and increasing decoding throughput by up to 6x. - **Attention Residuals (AttnRes)**: Allows the model to selectively retrieve information across layers, achieving about 25% training efficiency improvement at an additional cost of less than 2%. Combined with the **Stable LatentMoE** framework (896 experts, 16 activated) and the **Quantile Balancing** algorithm, overall scaling efficiency is improved by approximately 2.5x compared to the previous generation Kimi K2. Training uses quantization-aware training (MXFP4 weights + MXFP8 activations), and inference implements a prefix caching scheme for KDA, contributed to the vLLM community, achieving a cache hit rate of over 90% under programming workloads. ## Performance According to the Artificial Analysis Intelligence Index, Kimi K3 scores 57 points, ranking third globally, behind Claude Fable 5 (60 points) and GPT-5.6 Sol (59 points), surpassing all other models. ### Code Capabilities - **Frontend Code Arena**: Topped with 1679 points, surpassing Fable 5 (1631) and GPT-5.6 Sol (1618). - **SWE Marathon**: 42.0 points, the highest among all models. - **Terminal Bench 2.1**: 88.3 points, second only to GPT-5.6 Sol. - **Program Bench**: 77.8 points, slightly above Fable 5's 76.8. ### Agent and Knowledge Work - **BrowseComp**: 91.2 points, first place. - **SpreadsheetBench 2**: 34.8 points, first place. - **Automation Bench**: 30.8 points, first place. - **AA-Briefcase Elo**: 1548 points, second place. ### Multimodal - **CharXiv**: 91.3 points, the highest among open-source models. ## Autonomous Engineering Capability Demonstration - **GPU Kernel Optimization**: In the AttnRes task, K3 designed a two-stage kernel algorithm, compressing forward+backward time from 283.6ms to 114.4ms, with performance close to Fable 5. - **Building a GPU Compiler from Scratch**: Developed MiniTriton, building a tile-level IR layer and PTX code generation pipeline based on MLIR, with performance matching or exceeding Triton and torch.compile, capable of supporting nanoGPT training convergence. - **Self-Designed Chip**: Completed chip design within 48 hours using open-source EDA tools and the Nangate 45nm process library, integrating 1.46 million standard cells in 4mm², achieving a decoding throughput of over 8700 tokens/s at 100MHz. ## Pricing and Deployment Kimi K3 API pricing: cache hit input $0.3 per million tokens, regular input $3, output $15. The official claims that the single-task cost is about one-third of Fable 5. The model is now available on Kimi web, App, Kimi Work, Kimi Code, and API, with the highest intensity reasoning mode enabled by default. ## Known Limitations - Sensitive to historical thinking content; switching during a session may cause quality instability. - Training focuses on long-range difficult tasks, which may lead to over-autonomous decision-making when encountering ambiguous intent. - Overall user experience still lags behind Fable 5 and GPT-5.6 Sol.

Page 1 / 11Next