GPT-5.6 Sol is set to deliver 750 tokens per second, a significant advancement...

GPT-5.6 Sol is set to deliver 750 tokens per second, a significant advancement in AI model throughput. Current GPT-5.5 priority and scale-tier services offer speeds of over 50 tokens per second for 99% of requests. This positions Sol on Cerebras to achieve speeds up to fifteen times higher. This performance boost is enabled by Cerebras’ specialized hardware. The wafer-scale chip architecture allows model data to move with reduced memory and network delays compared to standard multi-GPU systems. A release of GPT-5.6 Sol achieving this rate is planned for July. 📰 @aipost