GPT-5.6 Launching Soon: 750 Tokens/s Inference Speed, Deployed Across 100 Wafers

OpenAI announced that the next-generation model GPT-5.6 will be released to the public this Thursday (July). The flagship version, Sol, achieves an inference speed of 750 Tokens/s on Cerebras custom hardware. The model has approximately 3 trillion total parameters and 150 billion activated parameters, deployed across 70-100 Cerebras wafer-scale chips, with each neural network layer occupying a single wafer. Meanwhile, OpenAI's self-developed inference chip, Jalapeño, was unveiled, compatible with all industry LLMs, and completed design and tape-out in just 9 months.

Release and Approval

• The AI Standards and Innovation Center (CAISI) under the U.S. Department of Commerce approved the public release of GPT-5.6. OpenAI technical experts are stationed in Washington for review coordination.
• OpenAI officially announced that GPT-5.6 will be fully launched this Thursday, offering three versions: Sol (flagship), Terra (Earth), and Luna (Moon), with pricing starting at $5 per million tokens.
• Codex CLI 0.143.0 has added three model variants on the Amazon Bedrock platform, supporting max inference intensity.

Technical Details

• Inference Speed: The Sol version achieves 750 Tokens/s on the Cerebras CS-3 system, equivalent to outputting 500-600 Chinese characters per second.
• Model Scale: Approximately 3 trillion total parameters, about 150 billion activated parameters, with 70-90 network layers.
• Deployment: Each neural network layer is deployed on a single Cerebras wafer, spanning 70-100 wafers, with full interconnect communication between wafers, achieving over 200 times the bandwidth of NVLink on Nvidia NVL72.
• Architecture Optimization: Possibly adopts a lightweight KV Cache scheme, such as an architecture similar to DeepSeekV4 or a hybrid SSM design (Mamba + Transformer), or decoupled attention and FFN (GPU handles attention, Cerebras handles FFN).

Self-Developed Chip Jalapeño

• OpenAI released its first self-developed inference chip, Jalapeño, a custom ASIC designed for large model inference, compatible with all industry LLMs.
• Design and tape-out completed in just 9 months, with OpenAI leading the architecture, Broadcom providing chip implementation and interconnect, and Celestica handling system integration.
• The first GW-level super data centers are planned for deployment from the end of 2026, using Jalapeño and subsequent chips.

Impact and Outlook

• GPT-5.6 Sol will initially be available only to specific customers, positioned as a high-end customized service.
• Real-time intelligent interaction and multi-step Agent tasks will be significantly improved due to low-latency inference.
• OpenAI accelerates the construction of a full-stack AI empire through hardware-model co-design, forming a flywheel of "AI accelerates infrastructure, infrastructure runs stronger AI."