Inworld launched Inworld Inference, an LLM inference API built for consumer AI apps, serving open mo

🚨 AI News | TestingCatalog

🚨 AI News | TestingCatalog

@testingcatalog

Latest AI News on AI Agents, Model Releases, Tools, Leaks, and Rumors 🗞

7,835 מנויים
פתח בטלגרם
Inworld launched Inworld Inference, an LLM inference API built for consumer AI apps, serving open models including Gemma 4, GLM, DeepSeek, and MiMo.

> Inworld optimizes how each model runs to deliver faster responses for tutors, companions, games, and other consumer apps.

> On Gemma 4 26B, median time to first token is 0.17 seconds, compared with 0.61 seconds for the median of the other providers on OpenRouter - 3.6× faster.

> At the 95th percentile, time to first token is 0.31 seconds versus 2.42 seconds for the median of those providers - 7.8× faster.

> Developers can also set requests to switch automatically to a fallback model if the first model fails or takes too long.

Gemma 4 26B costs $0.07 per million input tokens - nearly 40% below the median among the compared providers offering the same model that don't train on customer data.

Developers can choose a service tier for each request, prioritizing live replies while spending less on tasks that can wait.

Try hosted models in the playground 👀
https://platform.inworld.ai
#sponsored
פתח את הפוסט בטלגרם