Audio Language Model

Auto Added by WPeMatico

↗

Gradium Launches stt-translate and s2s-translate, Real-Time Speech Translation Models Beating gpt-realtime-translate on Accuracy and Latency

ai, AI (Artificial Intelligence), Artificial Intelligence, Audio Language Model, Editors Pick, Language Model, New Releases, Staff, Technology, Voice AI

Gradium today released two real-time speech translation models: stt-translate and s2s-translate. Both run across five languages and stream results live in the browser. Gradium claims a better accuracy-latency tradeoff than gpt-realtime-translate and gemini-3.5-live-translate. It also adds output voice control, including cloning, that gpt-realtime-translate lacks. TL;DR Gradium launched two real-time speech translation models: stt-translate (speech → […]

Gradium Launches stt-translate and s2s-translate, Real-Time Speech Translation Models Beating gpt-realtime-translate on Accuracy and Latency Read More »

✅

How to Use NVIDIA Canary-1B-v2 for ASR, Translation, and Automatic SRT Subtitle Export in Python

ai, AI (Artificial Intelligence), Artificial Intelligence, Audio Language Model, Editors Pick, Language Model, Staff, Technology, Tutorials, Voice AI

In this tutorial, we build a speech recognition and translation workflow using NVIDIA Canary-1B-v2. We begin by setting up the required audio, NeMo, NumPy, and SciPy dependencies, then load the Canary model on a GPU-enabled runtime for efficient inference. From there, we prepare audio into a clean 16 kHz mono format, perform English ASR, translate

How to Use NVIDIA Canary-1B-v2 for ASR, Translation, and Automatic SRT Subtitle Export in Python Read More »

Google Releases Gemini 3.5 Live Translate, a Streaming Speech-to-Speech Audio Model Covering 70+ Languages Across Meet, Translate, and the Live API

agentic ai, ai, AI (Artificial Intelligence), Artificial Intelligence, Audio Language Model, Editors Pick, Language Model, New Releases, Software engineering, Staff, Technology, Voice AI

Google just announced Gemini 3.5 Live Translate. It is their latest audio model for live speech-to-speech translation. Speech-to-speech means spoken audio goes in, and translated spoken audio comes out. The model detects over 70 languages automatically and generates translated speech. It preserves the speaker’s intonation, pacing, and pitch in the output. Turn-by-turn systems wait for

Google Releases Gemini 3.5 Live Translate, a Streaming Speech-to-Speech Audio Model Covering 70+ Languages Across Meet, Translate, and the Live API Read More »

Microsoft AI Introduces MAI-Transcribe-1.5: 2.4% WER on Artificial Analysis, Best-in-Class FLEURS Accuracy, and Up to 5x Faster Long-Audio Transcription

agentic ai, ai, AI (Artificial Intelligence), Artificial Intelligence, Audio Language Model, Editors Pick, Language Model, New Releases, Software engineering, Staff, Technology, Voice AI

Last week Microsoft AI has announced MAI-Transcribe-1.5. It is the second iteration of the company’s in-house speech-to-text family. The model targets accuracy across 43 languages, accents, and noisy environments. The Microsoft team positions it for production transcription workloads. What is MAI-Transcribe-1.5 MAI-Transcribe-1.5 is an automatic speech recognition (ASR) model. It takes audio as input and

Microsoft AI Introduces MAI-Transcribe-1.5: 2.4% WER on Artificial Analysis, Best-in-Class FLEURS Accuracy, and Up to 5x Faster Long-Audio Transcription Read More »

NVIDIA Releases Nemotron 3.5 ASR: A 600M-Parameter Cache-Aware Streaming Model Transcribing 40 Language-Locales in Real Time

agentic ai, ai, AI (Artificial Intelligence), Artificial Intelligence, Audio Language Model, Editors Pick, Language Model, New Releases, Software engineering, Staff, Technology, Voice AI

NVIDIA’s Nemotron Speech team has released Nemotron 3.5 ASR. It is a 600M-parameter streaming Automatic Speech Recognition (ASR) model. A single checkpoint transcribes 40 language-locales in real time. Punctuation and capitalization are built in natively. The model ships as open weights on Hugging Face. The license is OpenMDW-1.1. The architecture is a Cache-Aware FastConformer-RNNT. What

NVIDIA Releases Nemotron 3.5 ASR: A 600M-Parameter Cache-Aware Streaming Model Transcribing 40 Language-Locales in Real Time Read More »

Miso Labs Releases MisoTTS: An 8B Emotive Text-to-Speech Model with Open Weights

agentic ai, ai, AI (Artificial Intelligence), Artificial Intelligence, Audio Language Model, Editors Pick, Language Model, New Releases, Open Source, Software engineering, Staff, Technology, TTS, Voice AI

Miso Labs has released MisoTTS, an open-weights 8-billion-parameter text-to-speech model. It generates expressive speech from both text and audio context. The model uses residual vector quantization (RVQ) to widen its sonic range. This avoids scaling a single flat vocabulary while keeping parameter count fixed. What is MisoTTS MisoTTS is an 8B-parameter text-to-dialogue RVQ Transformer. It

Miso Labs Releases MisoTTS: An 8B Emotive Text-to-Speech Model with Open Weights Read More »

Best Text-to-Speech TTS Models in 2026: A Benchmark-Based Comparison

agentic ai, ai, AI (Artificial Intelligence), Artificial Intelligence, Audio Language Model, Editors Pick, Language Model, Staff, Technology, Text to Audio, Top, TTS, Voice AI

Text-to-speech TTS moved fast over the past year. The line between synthetic and human speech narrowed. Latency dropped below 100 milliseconds for some real-time systems. Emotional control became a standard feature rather than a research demo. This guide reviews the models that really matter in 2026. It is written for AI professionals choosing a model

Best Text-to-Speech TTS Models in 2026: A Benchmark-Based Comparison Read More »

Stability AI Releases Stable Audio 3: A Family of Fast Latent Diffusion Models for Audio Generation and Editing

ai, AI (Artificial Intelligence), Artificial Intelligence, Audio Language Model, Editors Pick, Language Model, New Releases, Software engineering, Staff, Technology, Voice AI

Stability AI has released open weights for Stable Audio 3 along with a technical research paper. Stable Audio 3 is a family of latent diffusion models that generate stereo audio at 44.1 kHz. The models support variable-length outputs, inpainting-based editing, and fast inference. What Is Stable Audio 3? Stable Audio 3 is a family of

Stability AI Releases Stable Audio 3: A Family of Fast Latent Diffusion Models for Audio Generation and Editing Read More »

Meet OmniVoice Studio: A Local, Open-Source Alternative to ElevenLabs

agentic ai, ai, AI (Artificial Intelligence), Artificial Intelligence, Audio Language Model, Editors Pick, New Releases, Open Source, Software engineering, Staff, Technology, TTS, Voice AI

ElevenLabs charges between $5 and $330 per month for voice AI services. Every audio file you process goes through their cloud servers. For those looking for an open source alternative of ElevenLabs, OmniVoice Studio is good fit as an open-source desktop application that runs the same categories of tasks locally. It is a very interesting

Meet OmniVoice Studio: A Local, Open-Source Alternative to ElevenLabs Read More »

StepFun Releases StepAudio 2.5 Realtime: An End-to-End Voice Model with Roleplay-Specific RLHF and Paralinguistic Comprehension

ai, AI (Artificial Intelligence), Artificial Intelligence, Audio Language Model, Editors Pick, Language Model, New Releases, Software engineering, Staff, Technology, TTS, Voice AI

StepFun, the Shanghai-based AI lab, released StepAudio 2.5 Realtime. It is an end-to-end real-time speech large language model with fully customizable persona capabilities. StepAudio 2.5 Realtime is a voice model that operates in real time. Unlike pipeline-based systems that separate speech recognition, reasoning, and synthesis into sequential steps, this is an end-to-end model. Audio goes

StepFun Releases StepAudio 2.5 Realtime: An End-to-End Voice Model with Roleplay-Specific RLHF and Paralinguistic Comprehension Read More »