TechOpenAI’s Jalapeño chip built for fast inference at scale, benchmarks show
On SemiAnalysis’ InferenceX benchmark, OpenAI’s Jalapeño recorded both more tokens per user and higher throughput per kilowatt than the best state-of-the-art systems currently available.
OpenAI’s Jalapeño chip built for fast inference at scale, benchmarks show
Tech