OpenAI's Jalapeño Chip Outperforms Nvidia's Blackwell and Rubin in Benchmarks

OpenAI’s first in-house inference chip, Jalapeño, has reportedly outperformed Nvidia’s Blackwell and Rubin chips in both throughput and energy efficiency, as tested by SemiAnalysis. Dylan Patel, CEO of SemiAnalysis, noted that typically, first-generation chips do not achieve such competitive results, stating, “Usually first generation chips aren’t competitive, but OpenAI is beating Nvidia Blackwell and even Rubin.” This performance was highlighted during the Hot Chips conference. The advancement positions OpenAI as a formidable player in the chip market, potentially influencing future AI model deployment strategies. For practitioners, this development may shift reliance from Nvidia’s offerings to OpenAI’s custom solutions for inference tasks. More details can be found in The Decoder.