Forget JEV - LAYA is an open-source
Forget the idea of using a massive LLM for every single decision. LAYA points to a different future.
LAYA is an open-source, self-hosted, multilingual, non-autoregressive decision engine built to make fast, structured decisions without generating text token by token.
Instead of sending everything to GPT, Claude, or Gemini, LAYA can operate as a fast decision layer that can:
- classify requests;
- measure urgency;
- estimate risk;
- identify intent;
- detect fraud or prompt injection;
- select which agent should act;
- select which AI model should be called;
- decide when a task can be automated.
The idea is simple:
INPUT → DECISION → ACTION
LAYA works with three main decision primitives:
choice — selects one option from a set.
score — evaluates something on a scale.
noul — returns a probability between 0 and 1.
The project includes specialized checkpoints for English, multilingual workloads, and typed-decision workflows, as well as a Router that can automatically select the most appropriate model for each input.
According to benchmarks published by the project, some decisions can be made in tens of milliseconds on a GPU, with batching allowing hundreds of decisions per second.
But speed is not the most important part.
The real power of LAYA is specialization.
You could build:
LAYA Sales
LAYA Support
LAYA Finance
LAYA Security
LAYA Legal
LAYA HR
LAYA Agent Router
Each one specialized in the repetitive decisions required by a specific business process.
And because LAYA is open source, you can run it on your own infrastructure, fine-tune it for your domain, calibrate its probabilities, and integrate it directly into your agents and internal systems.
This changes the architecture of AI.
Instead of:
event → large LLM → response
we can build:
event → LAYA → decision → right agent → right model → action
LAYA can effectively become the nervous system of an agent architecture, filtering thousands of events and calling larger reasoning models only when they are actually needed.
The bigger shift is this:
AI is no longer one giant model trying to do everything.
We are entering an era of systems composed of decision models, LLMs, agents, tools, memory, rules, verifiers, and humans, with each component doing the job it is best suited for.
LAYA is one of the clearest examples of this new architecture.
Open source. Fast. Specialized. Built for decisions.