Auto Added by WPeMatico
NVIDIA has just released Nemotron 3.5 Bolt E4B 4GB, an open small language model for fast conversational agents. It targets voice assistants, game NPCs and robot interfaces running locally on RTX, Jetson and Spark hardware. The model is post-trained from Google’s Gemma 4 E4B using reinforcement learning only. For developers, this is agent behavior in
An AI search agent can work in a demo but fail under production workloads when retrieval returns incomplete evidence, retries repeat unsuccessful actions, or execution exceeds time and cost limits. TinyFish, which provides web infrastructure for AI agents, has published two technical guides addressing these challenges. The first defines a production agentic search architecture, while
TinyFish Breaks Down Agentic Search Architecture for Production AI Agents Read More »
You.com has launched Inference Router, a managed API for running open-weight models in production. The You.com Inference Router is an OpenAI-compatible service that routes requests across 12 live models. It bundles a 99.9% minimum uptime SLA and zero data retention (ZDR). It adds 100% US hosting and server-side web search. It is pay-as-you-go, with no
You.com Launches Inference Router: 12 Open-Weight Models With 99.9% Uptime SLA Read More »
Liquid AI just announced Liquid RIPL, short for Real-time Inference Pipeline. RIPL is a low-latency engine that serves Liquid Foundation Models (LFMs) inside a live request path. It returns complete generated responses end-to-end in under 50 ms. It also claims that latency holds while traffic arrives continuously at peak load. For developers, the message is
Liquid AI Launches RIPL, a Real-Time Inference Engine for Sub-50 ms LFMs Read More »
Gradium has open-sourced Phonon, a family of small text-to-speech models built to run on the device. The Gradium Phonon on-device TTS model comes in 31M and 40M sizes. The English Phonon 31m ships under Apache 2.0 and fits in a 64.5 MB file. Developers get natural speech with no cloud call, no GPU and no
Gradium Open-Sources Phonon, a 31M-Parameter On-Device TTS Model Under Apache 2.0 Read More »
Cohere AI has released Rerank 5, a new reranker family in Pro and Fast tiers. Cohere Rerank 5 is a retrieval model that reorders search results before they reach an LLM. It adds 2 developer features: Context Focus, which returns relevant passages inside each document, and calibrated relevance scores. For RAG and agent builders, the
Cohere Releases Rerank 5 With Passage-Level Context Focus and Calibrated Scores Read More »
IBM has released Granite Speech 5.0 2B, a new open speech-language model for transcription and translation. Granite Speech 5.0 2B is a 2B-parameter model from IBM that turns speech into text in 6 languages. It ships under Apache 2.0. IBM also updated 2 existing models: the edge-focused Turbo CTC and the diarization-focused 4.1 2B Plus.
IBM AI Releases Granite Speech 5.0 2B for Multilingual Transcription and Translation Read More »
Recursive Superintelligence has released Flint, its first model. The Recursive Flint local coding model is a mixture-of-experts (MoE) model with 40B total and 2.5B active parameters. Recursive team states that its Eureka Machine, an automated research system, helped build nearly every part of the stack. The weights are on Hugging Face under Apache 2.0. TL;DR
Google team have released llm-d 1.0, the first stable version of its distributed inference stack. This open-source, Kubernetes-native layer turns vLLM or SGLang model servers into one coordinated pool. They released it at the PyTorch Conference North America. It targets self-hosted agent and RL workloads, where round-robin load balancing breaks down. TL;DR A serving stack:
Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets Read More »
Nace AI has released Drex Max, a multimodal decision model for agents that use computers and browsers. The Drex Max multimodal decision model reads text and images and returns calibrated probabilities. It writes no text. Nace team reports 67.59 on the public Decision Index 0.3.2, 6.9 points above TypeSafe’s Jev 1.14. For agent builders, that
