Software engineering

Auto Added by WPeMatico

TinyFish Breaks Down Agentic Search Architecture for Production AI Agents

agentic ai, ai, AI (Artificial Intelligence), AI Agents, AI Shorts, Applications, Artificial Intelligence, Context Engineering, Editors Pick, Enterprise AI, For Devs, Harness, New Releases, Promote, Software engineering, sponsored, Staff, Tech News, Technology, Uncategorized

An AI search agent can work in a demo but fail under production workloads when retrieval returns incomplete evidence, retries repeat unsuccessful actions, or execution exceeds time and cost limits. TinyFish, which provides web infrastructure for AI agents, has published two technical guides addressing these challenges. The first defines a production agentic search architecture, while

TinyFish Breaks Down Agentic Search Architecture for Production AI Agents Read More »

🖐

Google Cloud Launches Agent Compute Engine: A MicroVM per AI Agent

agentic ai, ai, AI (Artificial Intelligence), AI Agents, AI Infrastructure, AI Shorts, Applications, Artificial Intelligence, Context Engineering, Editors Pick, Harness, Language Model, Large Language Model, Machine Learning, New Releases, Software engineering, Staff, Tech News, Technology, Uncategorized

Google Cloud has announced Agent Compute Engine, a compute service built specifically for AI agents. Google Agent Compute Engine gives each agent its own hardware-isolated microVM. The sandbox holds zero credentials. The service already powers Gemini as an agent for work tasks. Google unveiled it this week at AGNTCon + MCPCon. Customer preview is targeted

Google Cloud Launches Agent Compute Engine: A MicroVM per AI Agent Read More »

⚠

You.com Launches Inference Router: 12 Open-Weight Models With 99.9% Uptime SLA

agentic ai, ai, AI (Artificial Intelligence), AI Infrastructure, AI Shorts, Applications, Artificial Intelligence, Editors Pick, Enterprise AI, For Devs, Language Model, New Releases, Software engineering, Staff, Tech News, Technology

You.com has launched Inference Router, a managed API for running open-weight models in production. The You.com Inference Router is an OpenAI-compatible service that routes requests across 12 live models. It bundles a 99.9% minimum uptime SLA and zero data retention (ZDR). It adds 100% US hosting and server-side web search. It is pay-as-you-go, with no

You.com Launches Inference Router: 12 Open-Weight Models With 99.9% Uptime SLA Read More »

Cohere Releases Rerank 5 With Passage-Level Context Focus and Calibrated Scores

agentic ai, ai, AI (Artificial Intelligence), AI Infrastructure, AI Shorts, Applications, Artificial Intelligence, Context Engineering, Editors Pick, Enterprise AI, For Devs, New Releases, Software engineering, Staff, Tech News, Technology

Cohere AI has released Rerank 5, a new reranker family in Pro and Fast tiers. Cohere Rerank 5 is a retrieval model that reorders search results before they reach an LLM. It adds 2 developer features: Context Focus, which returns relevant passages inside each document, and calibrated relevance scores. For RAG and agent builders, the

Cohere Releases Rerank 5 With Passage-Level Context Focus and Calibrated Scores Read More »

NVIDIA Nsight Python Tutorial: How to Profile GPU Kernels

ai, AI (Artificial Intelligence), AI Infrastructure, Artificial Intelligence, Editors Pick, For Devs, Python, Software engineering, Staff, Tech News, Technology, Tutorials

In this tutorial, we implement on Nsight Python, NVIDIA’s open-source Python interface to its kernel profilers. Instead of running a script under the Nsight Compute command line and digging through a report afterward, we mark the code we care about with nsight.annotate, decorate a benchmark function with nsight.analyze.kernel, and get back a pandas DataFrame of

NVIDIA Nsight Python Tutorial: How to Profile GPU Kernels Read More »

Recursive Releases Flint, an Open-Weight 40B MoE Local Coding Model for Agents with 2.5B Active Params

agentic ai, ai, AI (Artificial Intelligence), AI Infrastructure, AI Shorts, Applications, Artificial Intelligence, Editors Pick, Enterprise AI, For Devs, Harness, Language Model, Large Language Model, Machine Learning, Open Source, Software engineering, Staff, Tech News, Technology

Recursive Superintelligence has released Flint, its first model. The Recursive Flint local coding model is a mixture-of-experts (MoE) model with 40B total and 2.5B active parameters. Recursive team states that its Eureka Machine, an automated research system, helped build nearly every part of the stack. The weights are on Hugging Face under Apache 2.0. TL;DR

Recursive Releases Flint, an Open-Weight 40B MoE Local Coding Model for Agents with 2.5B Active Params Read More »

Mistral AI Releases Voxtral 3: Speech-to-Text, TTS and a Voice Agent SDK

agentic ai, ai, AI (Artificial Intelligence), AI Shorts, Applications, Artificial Intelligence, Audio Language Model, Editors Pick, For Devs, Language Model, Large Language Model, Machine Learning, New Releases, Software engineering, Staff, Tech News, Technology, Uncategorized, Voice AI

Mistral AI just released Voxtral 3. Mistral Voxtral 3 is a speech model family paired with a voice agent SDK. It ships 3 transcription models, 1 text-to-speech model and an SDK built on LiveKit. One place for listening, reasoning, tool calls and speaking. All 4 models are in public preview on the Mistral API. TL;DR

Mistral AI Releases Voxtral 3: Speech-to-Text, TTS and a Voice Agent SDK Read More »

🧭

Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets

agentic ai, ai, AI (Artificial Intelligence), AI Infrastructure, AI Shorts, Applications, Artificial Intelligence, Editors Pick, Enterprise AI, For Devs, Language Model, Machine Learning, New Releases, Open Source, Python, Software engineering, Staff, Tech News, Technology

Google team have released llm-d 1.0, the first stable version of its distributed inference stack. This open-source, Kubernetes-native layer turns vLLM or SGLang model servers into one coordinated pool. They released it at the PyTorch Conference North America. It targets self-hosted agent and RL workloads, where round-robin load balancing breaks down. TL;DR A serving stack:

Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets Read More »

DeepSeek Open-Sources DeepInfer, the Inference Framework Behind DeepSeek-V4.1-Flash

agentic ai, ai, AI (Artificial Intelligence), AI Infrastructure, AI Shorts, Applications, Artificial Intelligence, Editors Pick, For Devs, Harness, Language Model, Large Language Model, Machine Learning, New Releases, Open Source, Software engineering, Staff, Tech News, Technology, Uncategorized

DeepSeek has open-sourced DeepInfer, the inference framework that runs its production services. The DeepSeek DeepInfer inference framework is the engine behind DeepSeek-V4.1-Flash. It ships under the Apache 2.0 license. DeepSeek also released deepseek-recipe, its MIT-licensed token encoding and decoding layer. For developers, this is a rare look at a frontier lab’s real serving stack. TL;DR

DeepSeek Open-Sources DeepInfer, the Inference Framework Behind DeepSeek-V4.1-Flash Read More »

Exa 3.0 Search API Tops Perplexity, Brave and Parallel on 8 Benchmarks

agentic ai, ai, AI (Artificial Intelligence), AI Infrastructure, AI Shorts, Applications, Artificial Intelligence, Editors Pick, For Devs, Generative AI, Language Model, Large Language Model, Machine Learning, New Releases, Software engineering, Staff, Tech News, Technology

Exa has released Exa 3.0, an upgrade to its web search API for AI agents. The Exa 3.0 search API ships a larger embedding model and a cheaper search type, Exa Lite. Dynamic Highlights is now generally available. Exa claims that it leads Perplexity, Brave and Parallel on 8 benchmarks. Those benchmarks were run by

Exa 3.0 Search API Tops Perplexity, Brave and Parallel on 8 Benchmarks Read More »