All posts

Real-time meeting translation: how it works and why accuracy matters

Real-time meeting translation has improved dramatically in the last few years. Understanding where it still fails — and why — is the difference between following a meeting and guessing your way through it.

Person at a desk, leaning slightly forward toward a laptop screen showing a video call with multiple participants, expression focused and attentive — the look of someone concentrating hard to follow a conversation in another language.

There's a specific moment that everyone who has sat through a meeting in a second language will recognise. Someone makes what is clearly a decision — you can hear the finality in their voice, you see everyone nod — but you didn't catch the last part. You spend the next ten minutes piecing it together from context and facial expressions. You leave the call with a rough idea of what was decided, but not rough enough to act on with confidence.

The tools designed for real time translation for meetings have these flaws. It's not a translation failure in the traditional sense — the words came through. The problem is that language in meetings doesn't work the way language in documents does. It's faster, more compressed, and it carries meaning in structure and rhythm as much as in individual words. Translation that handles a contract accurately will fail a meeting in ways that aren't immediately obvious — and by the time they become obvious, a decision has already been misunderstood.

What happens during real time meeting translation

Real-time translation in a meeting runs through a short but consequential pipeline. Each stage introduces its own margin for error.

Stages of real-time translation
Stages of real-time translation

Step 1: Audio capture. The first step is simply listening to the speaker, kicking off the most important aspect of comprehension. Meeting calls lose audio quality in transmission: voices get flattened, background noise bleeds in, a speakerphone adds echo, someone joins from a coffee shop. By the time the audio reaches the translation layer, it's already a rougher version of what was said in the room. A tool that listens to what's coming out of your meeting software — the audio you're actually hearing — works differently from one that listens to your own microphone. Which approach a tool takes shapes the quality of everything that follows.

Step 2: Speech recognition. Automatic speech recognition (ASR) converts the audio signal to text. It is very reliable in clean conditions, but meetings are messy. Multiple speakers, overlapping voices, and the habit of trailing off mid-sentence all create gaps. Domain-specific vocabulary — industry jargon, product names, acronyms — is the most consistent failure point. A model that has never encountered niche phrases such as "Q3 updates" or "EBITDA adjustment" will improvise, and the improvisation breaks into the resulting translation.

Step 3: Translation. The transcribed text is passed to a machine translation model. It handles idiom, context window, and syntactic reordering across language pairs with reasonable reliability. The catch is that it translates what it received. Errors from the previous stage compound at translation. A misheard word becomes a mistranslated sentence, and a mistranslated sentence in a fast-moving discussion can point you in a different direction from everyone else in the room.

Step 4: Display. The translated text appears on screen. The lag between someone finishing a sentence and you reading the translation in your language is typically two to four seconds for well-optimised systems. This delay is significant, and it must be just right. In a fast pace conversation, it's important to make sense of the exchange with lower latency compared to a situation where a more complex idea is being conveyed.

Conversation speed - Why meeting translation is a different problem

Most people's model of good translation comes from written language. Live meeting translation is a different problem: in a document, accuracy means the translated text conveys the same information as the source text, assessed by someone with time to read and re-read both. In a meeting, accuracy means something narrower and more demanding — the translated caption must let you participate in real time, with no opportunity to pause and re-read, in the middle of a discussion that is moving at conversational speed.

Latency failures. The naive assumption is that faster is better. It isn't. A translation that arrives 500–1,000ms after each spoken word streams text word-by-word while the speaker is still talking — you're reading mid-clause while they've already moved to the next point, perpetually catching up. An eight-second delay leaves you watching a conversation that has moved on entirely; a 500ms delay creates a different but equally disorienting lag where your comprehension is always one thought behind the speaker.

The right approach approximates a natural sentence boundary — waiting long enough to capture complete meaning, short enough to appear before the speaker has moved two steps ahead. A tool that prioritises raw translation quality over display timing produces beautiful captions that arrive too late. A tool that prioritises display speed produces captions that arrive too soon. The balance point is not a fixed number of seconds; it shifts depending on speaking pace, sentence length, and language pair.

Rendering failures. Even when the timing is right, how the translated text is displayed creates its own cognitive load. As captions accumulate, the visible paragraph grows. Every time that paragraph reflows — when a long line wraps, when the layout shifts to accommodate new text — your eye loses its position and has to reanchor. That reanchoring is attention you're spending on the screen instead of on the speaker.

The problem compounds with translation: a translated sentence is rarely the same length as its source. German runs longer than English; Italian expands; Japanese compresses. A single growing block of translated captions reflows unpredictably because the length variation accumulates — you can't anticipate where the next line break will fall. The solution is to anchor each utterance with its translation as a pair, separated by a fixed divider, so length differences between languages are contained within a row rather than cascading through the whole display. This is a display engineering problem, not a translation problem — but it determines whether a good translation is actually readable under meeting conditions.

Paragraphs are vertically aligned in each language
Paragraphs are vertically aligned in each language

Compression failures. Spoken language is not prose. People use shorthand, reference earlier parts of the conversation by inference, and rely on shared context that doesn't appear in the transcript. "The same thing we discussed last quarter" is a complete thought in a meeting; it's opaque to a translation model that has no memory of last quarter. Systems that treat each sentence as an isolated unit break here in ways that accumulate invisibly.

Intent failures. This is one of the most challenging to catch. The literal meaning of a sentence is often not its communicative meaning. "We could look at that option" means something completely different when it's said by a project manager in a planning meeting versus a skeptical executive in a budget review. Tone, context, role, and relationship all colour meaning in ways that the text of a caption cannot capture.

A translation can be word-for-word accurate and still deliver the wrong intent. Someone who understood the literal words but missed the intended meaning — the hesitation, the conditional framing, the social signal embedded in the phrasing — will leave the meeting with a misread of what actually happened.

This is the sense in which accuracy in meeting translation means more than linguistic correctness. It means preserving enough of the original meaning that the listener can form the right interpretation, not just read the right words.

What bad translation costs you in practice

The costs are concrete and they accumulate.

A misheard product name or project term in the ASR stage can route an entire thread of translation into a parallel universe. A meeting about one system becomes — in your captions — a meeting about something else. You participate confidently and leave with the wrong mental model.

A misunderstood decision means the follow-up actions from your side don't match what was agreed. You may not discover the gap until the next meeting, or until someone asks why a deliverable doesn't match the brief.

A misread tone means you respond to a concern that wasn't raised, or miss a concern that was. International relationships where one side is working through translation are already at a slight disadvantage; poor translation widens that gap instead of closing it.

These failures are hard to attribute to translation. The meeting happened, everyone was present, the decision was made. The problem surfaces later, in execution, in follow-up, in the friction that builds when one side of a cross-language working relationship consistently seems slightly out of step.

What a good real-time translation tool for meetings looks like

Given all of the above, what should you actually be evaluating when you choose a real-time translation tool for meetings?

Display timing. Don't evaluate a tool by whether it feels fast — evaluate whether captions complete a thought before the next one starts. Sub-second translation is often worse than a short delay: text that streams word-by-word gives you fragments to read while the speaker is still forming the sentence, so you're perpetually mid-comprehension. The useful range is timed to sentence boundaries, not to raw speed. Test this by watching whether you can actually follow a fast back-and-forth exchange, not a single prepared speaker talking slowly into a microphone.

Caption rendering. Watch what happens as text accumulates. If the visible paragraph keeps growing, at some point the layout reflows — lines shift, the text block reorganises — and your eye has to find its place again. That reanchoring is cognitive work happening instead of listening. A display that scrolls within a fixed area, or breaks into new paragraphs at natural intervals, keeps your reading position stable. This is easy to miss in a short demo; it becomes obvious after ten minutes of a real meeting.

ASR accuracy on domain vocabulary. The only way to test this reliably is with your own terminology. If your meetings involve technical terms, product names, or acronyms that don't appear in general consumer content, test those specifically. Many tools perform well on general language and poorly on domain vocabulary — the difference is invisible in demos and obvious in real meetings.

Handling of multiple speakers. Meetings with clear speaker separation are easier for ASR. Meetings where people interrupt, finish each other's sentences, or talk over each other are where systems diverge. Tools that use speaker diarization (assigning each voice to a separate labelled track) tend to handle this better, because errors are contained to one speaker rather than propagating across the transcript.

Privacy architecture. Whether a translation tool joins your meeting as a visible participant matters beyond aesthetics. A bot that appears in the attendee list may be prohibited by your client's policies, your own company's NDAs, or the nature of the meeting itself. Tools that operate on your device — listening to system audio locally without joining the call — have a fundamentally different privacy profile from cloud-based bots. For high-stakes meetings, this distinction is not minor.

Post-meeting record. A translated caption that disappears when the call ends solves only half the problem. You followed the meeting live, but without a record, the ground truth is whatever your memory produces when someone asks you three hours later what was agreed. A tool that saves both the original transcript and the translation — searchable, timestamped, with any notes you took during the call — closes that gap. The translation is useful live; the record is what you act on afterward.

For a direct comparison of how specific tools perform on these criteria, see real-time translation software compared.

How Localingo approaches this

Localingo is built on the premise that AI meeting translation and meeting memory are the same problem.

Localingo running during your meeting
Localingo running during your meeting

The live translation — captions in your language, running alongside any meeting platform without joining the call — handles the in-meeting problem. No bot appears in the attendee list. The tool listens to your system audio and renders captions in your browser, in Picture-in-Picture mode if you want them floating over the meeting window.

The saved record handles the after-meeting problem. The original transcript, the translation, and any notes you took are saved as a searchable meeting history. The translated version of a call in Korean is there when you need it the next morning, not just for the forty-five minutes the call was running.

The accuracy question — intent preservation, not just word accuracy — is the part most tools skip in demos and most buyers forget to test. A demo in a clean acoustic environment with prepared speech will make most tools look similar. The gap shows up once a real meeting gets going — past the first few turns, when speakers start overlapping and shorthand starts flying.

That gap is what we're working on — and closing it is what makes AI meeting translation a different engineering problem from document translation.

What this means if you're evaluating translation tools

If you're choosing a real-time translation tool for your meetings, the most useful thing you can do is test it in a meeting that looks like your hardest meetings, not your best ones. Not a demo call with a single prepared speaker. A working session with the terminology, pacing, and speaker dynamics you actually deal with.

Evaluate the latency live, not in a recording. Evaluate the domain vocabulary against your own project terms. And evaluate whether the translation is still there when you need to act on it — not just while the call is running.

If any of those tests reveal a gap, it's worth knowing what kind of gap it is: a latency problem, an ASR problem, or an intent problem. They have different causes and different fixes. And only one of them — the intent problem — is the hard one.