General Compute says it will deploy a cluster of Positron AI inference chips, going live in early 2027
Our heterogeneous cloud just got better. We're announcing a cluster scale deployment of @positron_ai as our next partner. We believe demand for fast inference will outstrip supply for the next decade. Our bet on Positron is another step towards getting fast inference for opensource models into builders' hands. Hardware goes live Q1 2027. Thanks to @mitesh711, @trsohmers and the whole Positron team! We're excited for this partnership. LFG!
Context
More specialized inference hardware coming online could make serving open models faster and cheaper for developers.
General Compute is a cloud provider that says it runs several kinds of AI chips side by side. Positron AI is a startup building chips designed for AI inference, the work of running trained models. This is a company announcement, and neither side gave the size of the deployment.
Deep dive
On October 20, General Compute posted that its heterogeneous cloud just got better, announcing a cluster scale deployment of Positron AI as its next partner. It said it believes demand for fast inference will outstrip supply for the next decade, and that the bet on Positron is another step toward getting fast inference for open source models into builders' hands. The hardware goes live in the first quarter of 2027, it said.
The announcement video explains its approach as disaggregated inference, splitting a request into two workloads. The first, prefill, processes the prompt and is limited by raw computing power, which the video assigns to GPUs. The second, decode, writes the answer one token at a time and is limited by memory speed, which the video assigns to Positron's hardware.
The video ends with a panel photo labeled with Positron chief executive Mitesh Agrawal and General Compute's Jason Goodison. General Compute also thanked @trsohmers of Positron.
Neither company said how many chips are involved, what the deal is worth, or which open models will run on it first. The claim about demand outstripping supply for a decade is General Compute's forecast.
What to expect next
Watch for General Compute to publish speed and price figures for open models on the Positron cluster once it goes live in early 2027. Independent measurements will show whether splitting prefill and decode across different chips delivers faster responses in practice. Also watch for more deals between inference chip startups and smaller clouds, which are trying to compete with Nvidia based capacity at the large providers.