← Wednesday, October 14 deck

18Product

Inworld opens its inference service for consumer AI apps to all developers, saying it already processes tens of trillions of tokens a month

Inworld is your new favorite inference provider. We already process tens of trillions of tokens a month because we understand consumer AI different, and we've built our inference from the ground up for it. Today, the inference top consumer AI apps run on is opening up.

Dark promotional graphic for Inworld Inference showing claims of about 40% lower cost, 99.999% reliability and about 8 times faster replies, a rising usage curve labeled 25 times since March, and a bar chart of time to first token compared with other providers
60 replies145 reposts301 likes

Context

Why it matters

Consumer AI apps need fast, cheap responses at huge volume, and a specialist provider entering inference adds competition for hosts of open models.

This is a first hand launch post from Inworld, best known for AI characters and voice models. The cost, speed and reliability figures are the company's own claims, some based on OpenRouter provider measurements.

Deep dive

On October 14, Inworld posted: Inworld is your new favorite inference provider. It said it already processes tens of trillions of tokens a month and has built its inference from the ground up for consumer AI, adding that the inference top consumer AI apps run on is now opening up.

Inworld's blog says big labs and most providers have focused on enterprise and coding, while consumer AI needs the opposite. The service hosts open models including Gemma 4, GLM 5.3 Flash, MiMo 2.6 Pro and DeepSeek V4.1 Flash through an OpenAI compatible API.

The company claims that on Gemma 4 26B, first tokens arrive up to 7.8 times faster than from the median provider on OpenRouter, that up to 90% of each prompt is served from cache, and that 99.999% of more than 20 million GLM 5.3 Flash requests in 30 days completed without error. It also says input prices are the lowest of any provider that does not train on user data for three of its five featured models.

The press release says developers can combine Inworld hosted models with more than 100 third party models through routing, fallback and caching. Inworld's site lists dedicated GPUs from $5 per GPU hour.

What to expect next

Watch whether independent measurements on OpenRouter keep showing Inworld ahead on latency and price as traffic grows, and which consumer apps publicly move their workloads to it.

Also watch whether established inference providers cut prices for open models in response, and whether Inworld adds more models beyond its current featured lineup. Inworld has not disclosed pricing changes or customer names.