Osegi
AI·2 min read

Sarvam AI Launches Prism, an Open-Weight Decision Model

Sarvam AI has released Prism, a decision model built on its 105B LLM that returns option probabilities in about 44 ms, with open weights under Apache 2.0.

Abstract illustration of an AI decision model routing enterprise queries to different teams with probability scores.
Image: Inc42 Media

Sarvam AI has launched Prism, an open-weight decision model built on its Sarvam 105B foundation model and designed to make fast, structured choices in enterprise workflows. The company says it averages 71.8 across three evaluation indices, with a median response time of 44 milliseconds on an Nvidia B200 GPU.

How decision models differ

Most large language models generate text, so even a simple choice comes back as a response that other software must interpret. That can add latency and cost and introduce inconsistency. Decision models take information, a question and a fixed set of possible answers, then return a probability for each option, for example sales, support or billing for a customer complaint.

That suits repetitive, high-volume work such as support routing, content moderation, fraud checks, security screening and evaluating the actions of AI agents. Prism evaluates the options in a single processing pass instead of generating a sequence of words.

What Sarvam claims

Sarvam says Prism posted the highest average score among 25 decision models it tested that responded in under 100 milliseconds. It also reports consistent results across 2,000 questions after applying a fixed ordering mechanism, and says observed error rates stayed below predicted rates at the confidence thresholds tested, including in Indian languages.

The weights are released under the Apache 2.0 licence, so developers can adapt the model and run it on their own infrastructure. An API is also available. Target uses include document intelligence, prompt-injection detection and AI-agent evaluation.

Prism joins Laya from ConvAI Innovations, which targets small models running locally on laptops and phones, and Sieve from PurpleTalk's Sthānika AI, which focuses on evaluation, intent detection and tool selection. Articul8 is pursuing a multimodal approach with Bivia.

The figures are company-reported, and scrutiny has already started. Developer Sandipan Kundu said Prism looked capable but questioned the 44 ms median, citing a p95 latency of 420 milliseconds in his own testing, and flagged the cost of self-hosting a model of this size. Independent tests on comparable workloads will show how the results hold up in production.

Apps worth a look

SUMO: the number puzzle

Tap the right tiles, add them up, hit the target. Easy to learn, hard to master. Free, for all ages.

Tags:sarvam aiprismdecision modelsopen-weightindia aienterprise ai

More from this day

See all →

More in: AI

See all →