localizationtranslation-memoryai-translationengineering

Translation Memory: What It Is, How It Works, and Why It Matters for AI Localization

A translation memory stores the lines your team already approved. We needed to figure is what TM means when the translator is an LLM, how the tools on the market remember (or forget), and the bet we made at Transept: memory as decision context.

Vitalii VlasiukLiteress
Vitalii Vlasiuk & Literess13 min read
Translation Memory: What It Is, How It Works, and Why It Matters for AI Localization
On this page

If your team translates product content, support articles, documentation, campaigns, or software strings, you keep running into the same problem:

  • the same phrases appear again and again,
  • yet they still cost time to translate, review, and approve every single time.

That is exactly what translation memory is built to solve.

A translation memory, or TM, is where your translation setup keeps the lines your team has already approved. Source text goes in, the final translation sits next to it, and the next time something similar shows up, you do not start from zero.

Figure 1 · The payoff
You don’t start from zero
Save changesin memory
↳ from memory: «Enregistrer les modifications»
Welcome backin memory
↳ from memory: «Bon retour»
+Your free trial ends in 3 daysnew
↳ no match yet: translate once, then it’s remembered
Cancelin memory
↳ from memory: «Annuler»
Settingsin memory
↳ from memory: «Paramètres»
+Export as PDFnew
↳ no match yet: translate once, then it’s remembered
Sign outin memory
↳ from memory: «Se déconnecter»
+Delete accountnew
↳ no match yet: translate once, then it’s remembered

5 of 8 lines were already in memory. You only translate the 3 that are new.

Most of what you translate, you’ve translated before, so those lines come back with what the translation memory already holds. You only pay for the new ones.

Old translation tools used it to save time. With AI it matters even more: it shows the model what is your translation standard, and what decisions are expected. The payoff is tremendous:

  • faster turnaround (no re-translating boilerplate, disclaimers, or repeated UI)
  • lower cost, not only because you can reuse lines. With enough TM grounding, we in Transept managed to make a 4× cheaper model match a premium one
  • consistent style (decisions you approved years ago is the one every new feature reuses).

But how do you do translation memory with AI translation?

  • Do glossaries and styleguides count as TM? How do you keep them up to date?
  • How do you decide what counts as a relevant TM segment?
  • How much context does the AI need? What is too little, and what is too much?
  • How do you make sure a client's copyrighted and sensitive information never leaks to other clients?

That is exactly what we had to figure out at Transept. What should translation memory mean when the translator is no longer only human? And how do we make the human work with that memory meaningful instead of processing a list of slop?

That question is what sent us down the rabbit hole.

What is translation memory in AI translation?

Traditionally, a translation memory is a structured database of translated text pairs. Each pair usually holds:

  • The source segment (the original text).
  • The target segment (the translation).
  • Metadata — who translated it, when it was approved, the surrounding context.

When a translator opens a new document, the TM software scans the text, compares it to the database, and when it finds a match, suggests the previous translation.

That is the classic CAT definition. Once you are working with LLMs and agentic translation systems, several more artifacts come into play:

  • Glossaries generated as translation progresses, to stabilize the terminology the AI uses.
  • Handoff notes and summaries produced when AI agents pass work between each other.
  • Thinking traces from agents, created during translation, editing, and proofreading — the why behind each decision.
  • Discussion context between agents and humans: chats, reply threads, search histories, Slack/Teams context.
Figure 2 · Anatomy of a TM record
What a translation memory stores now
just the pair
SourcePure steel rejects lacquers and paints
Target«Чиста сталь відкидає лаки та фарби»
Metadataapproved by · date · file & context
…and what the agents also kept
Thinking trace
weighing  "rejects lacquers and paints"
  ├ literal    «відкидає лаки та фарби»   keeps the metaphor ✓
  ├ smoother   «не приймає покриття»      clearer, but flattens it
  └ decision   go literal, the bluntness is the point
Glossary
steel сталь🔒paints фарби
Handoff note
translator → editor
“Kept the steel metaphor literal. Check it reads naturally in UK.”
Discussion
Maria
Maria is «відкидає» too harsh for a product line?
Literess
Literess It mirrors the source’s bluntness. I’d keep it.
Switch to AI-era to see what an agentic pipeline adds →
Classic CAT memory kept three things: the source, the target, and a little metadata. Toggle to AI-era to see what an agentic pipeline also keeps: the glossary it locked, the note it handed off, the reasoning it went through, the conversation behind the call.

This is still useful for humans, but it is critical for AIs. It lets the model rebuild the context that human translators carry in their docs, their brains, and their conversations. Ironically, LLM-powered translation needs TM and CAT tooling more than humans do — a human can translate just fine with a pen, paper, and a dictionary.

How translation memory matches work

TM software breaks content into smaller pieces called segments — usually a sentence, a heading, or a button label. Then it looks for matches. How the TM searches for matches is the most important discipline in the whole field.

  • Exact matches: the new segment is 100% identical to one in the database. The software can fill the translation in automatically.
  • Fuzzy matches: similar but not identical. Flagged for a human to review, update, or use as inspiration. Usually powered by a sparse search — searching for every word or lexeme in the sentence, then scoring database segments by how many they share.
  • Semantic matches: a segment in the database means something similar even though no words overlap. This uses dense search — vector embeddings and retrieval. Your usual RAG play.
Figure 3 · Match types
One source segment, three ways to find it
New segment to translate
Save changes
Enregistrer les modifications
fuzzy 100 · sem 100
Exact 100%
Save your changes
Enregistrez vos modifications
fuzzy 78 · sem 90
Fuzzy
Keep my edits
Conserver mes modifications
fuzzy 18 · sem 72
Semantic
Discard changes
Annuler les modifications
fuzzy 50 · sem 34
Below threshold
Delete account
Supprimer le compte
fuzzy 16 · sem 8
Below threshold
Exact hit. The TM has translated this verbatim before, so the system can fill Enregistrer les modifications automatically.
Pick a phrase to translate. Exact matches auto-fill, fuzzy matches flag for review, and semantic matches surface meaning even when no words overlap. Real systems run all three at once.

Traditional TM relied on exact and fuzzy matches. LLMs brought the semantic layer. But semantic search alone is still not enough for good performance.

In literary translation, fuzzy term matches are critical for keeping proper nouns and lore consistent. In healthcare, the same thing can be phrased many ways, so semantic search should help — except it backfires. For a general-domain embedder, the distance between ileum and ilium is as small as between crimson and scarlet.

(The ileum is the final part of the small intestine; the ilium is the large upper part of the hip bone. Completely unrelated terms that collapse to "healthcare stuff" in general-domain semantic space.)

Figure 4 · Why semantic-only backfires
In general-domain space, “ileum” and “ilium” collapse together
colorgutbone
ileum ↔ ilium
8units · collapsed
crimson ↔ scarlet
10units · true synonyms
For a general-domain embedder, the gap between ileum (intestine) and ilium (hip bone) is as small as between crimson and scarlet: a one-letter typo the model reads as a synonym. Toggle to a domain-aware setup and the medical guardrail pulls them apart. This is why 2026 TM needs reranking, not raw vectors.

So you need guardrails. The default expectation for translation memory in 2026 is therefore:

  • Hybrid search, where exact, fuzzy, and semantic matches are combined for the most relevant results from past translation history.
  • Reranking, where the candidates are re-scored against the actual context for relevance.
  • Tree traversal, where a human or agent can step from one match to its nearest neighbours to explore the database.
Figure 5 · The 2026 default stack
Retrieve wide, then rerank narrow
Query
A new source segment arrives. No assumptions yet about which kind of memory will help.
Exactidle
Fuzzyidle
Semanticidle
Candidates
Waiting for retrieval…
Step 1 / 5
Modern TM is not one search; it’s parallel exact + fuzzy + semantic recall, deduped, then reranked against the real context, with tree traversal to explore. Raw vector recall alone would have kept “Reset device”; reranking drops it.

How the rest of the market does translation memory

Every serious localization tool can store past translations and suggest them again. The useful questions are: what does the system remember, when does it trust that memory, and where does it use that memory next?

From that angle the market falls into three levels — memory as reuse, memory as governance, and memory as AI fuel. Transept's bet is a fourth: memory as decision context.

Figure 6 · The market, four levels deep
What each tool actually remembers
Everyone can store the final translation. The real differences are what the system remembers, when it trusts that memory, and where it uses it next. Filter by level; Transept’s bet is level 4: memory as decision context.

Level 1: memory as reuse

Classic CAT tools answer the oldest TM question: "Have we translated this before?"

They are not primitive — many support context-aware matching, fragment recall, MT plugins, team servers, and strong editor workflows. But memory mostly sits beside the editor as a suggestion source. It helps the translator reuse past work; it does not usually remember why one version was chosen over another.

  • Trados / RWS is the classic CAT baseline — strong at exact matches, fuzzy matches, concordance, and in-context exact matches, and the wider Trados ecosystem now folds in AI and Language Weaver workflows. But at the TM level, the core idea is still segment reuse inside a CAT environment.
  • memoQ pushes classic TM especially far on context. Its 101% and 102% matches try to decide whether the same segment appears in the same place — which matters for software strings, repeated labels, and structured files. Smart retrieval, but the remembered object is still the segment in context.
  • Wordfast keeps TM portable and practical. Wordfast Anywhere gives translators browser-based shared TMs, glossaries, QA, and MT. The value is accessibility and reuse, not a deeper memory of decisions.
  • OmegaT and CafeTran show serious reuse is not only an enterprise feature — free, open-source fuzzy matching, match propagation, multiple TMs, and glossary support, with team-oriented TM servers for power users.

So the baseline is already high. Even low-cost and indie tools remember and reuse translations well. The commercial competition begins on what happens after reuse.

Level 2: memory as governance

The next group asks a different question: "Which memory should be trusted for this client, team, project, or workflow?"

  • Phrase TMS treats memory as one managed resource inside a larger platform — TM, term bases, MT engine profiles, Phrase Language AI, quality scoring, QA. Broad coverage, but the TM itself still mainly stores reusable segments.
  • Crowdin makes memory useful at project scale: auto-created project TMs, the option to store only approved translations, and a distinction between plain 100% matches and Perfect matches (text and context). It pre-fills strings, but still remembers approved text, not the reasoning.
  • Smartcat organizes memory around the relationship — clients, departments, workspaces, AI Translation Profiles — auto-attaching the relevant memories and glossaries, with one write-enabled TM and others read-only. The strength is routing and ownership.
  • XTM Cloud treats memory as something that needs status and protection: entries can be approved or not, raw MT is not saved automatically, tracked-change segments wait until accepted or rejected, and settings decide whether unapproved memory can be suggested. The point is trust control.
  • Wordbee separates durable Translation Memories from temporary Project Memories. A Project Memory captures live work and can suggest segments mid-flight; afterwards the useful parts are consolidated into a master TM. Close to live document context, but still a segment store.
  • Bureau Works leans into control — memories linked to departments, read/write permissions (grunt translators may use them; only locale leads may add to them), and a single recommendation stream blending TM, LLM, classical MT, and glossaries. Powerful, occasionally overwhelming, and the final judgment still rests on a human reading the suggestions.
  • MateCat is a web CAT editor wired to MyMemory for TM and ModernMT for MT. Public and private memories feed MT suggestions, and live corrections improve output as the translator works — closer to "TM feeding adaptive MT" than simple TM beside MT. Still, the memory means segments, matches, and corrections.

Level 3: memory as AI fuel

The newest group asks what happens when AI creates, edits, or learns from translation. Can machine output become memory? Does it need review first? Can a quality score replace human approval? Can TM steer the engine itself?

  • Lilt treats TM as fuel for adaptive MT — confirmed translation units and termbase data improve predictive suggestions over time. The bet is adaptive prediction inside the engine, not a broader memory of comments, rejected alternatives, and review reasoning.
  • Smartling makes provenance explicit: AI output can go into a separate Machine-Created Translation Memory, while human or human-validated work stays in the regular TM. A strong trust model — AI output is reusable but never silently poses as human-approved.
  • Lokalise uses review as the trust gate: AI or MT translations can enter TM when a reviewer accepts them in a Review task, even without editing the text. AI output can earn durable memory, but only through a human step — which adds friction, and is not ideal for small teams where decisions happen in the trenches and should be captured immediately.
  • Transifex uses TQI as an automation gate. Normally generated translations do not enter TM without review, but Transifex AI can score a translation with its Translation Quality Index, and above a configured threshold it can be added automatically. The catch: you have to trust the proprietary index.
  • Phrase Language AI is the orchestration layer — routing work across engines and agentic workflows, using quality estimation, applying glossaries, managing MT profiles, supporting bring-your-own engines. Strong system design, but TM remains one input among MT, glossary, QA, and routing.

The gap we found in the market

Across all of these, the market is getting good at storing the final translation, separating human and machine output, routing the right memory, and deciding when AI output is reusable. We treated all of that as the default.

What is still rare is memory of the work around the translation. Few tools keep rejected alternatives, comments, review history, search context, approval logic, and the decision path that explains why one version won. Translation generates this engineering gold naturally — and almost nobody bothered to dig it up.

Rarer still is feeding that history back into a capable LLM so the next translation can use the reasoning, not just the final output.

That is the bet we made at Transept. Translation memory should not only remember the sentence, however important the sentence is. It should remember the work that made the sentence trustworthy. TM must become decision context — shared by humans and AIs alike.

Figure 7 · Memory as decision context
Transept remembers the work behind the sentence
The approved segment · EN → FR · idiom
It costs an arm and a leg
«Ça coûte les yeux de la tête»
Everyone stores this
Context fed to the next translationkept 1 / 7
«Ça coûte les yeux de la tête»· the French idiom, same idea and register
«Ça coûte un bras et une jambe»· a literal calque, reads as a translation
«C’est très cher»· accurate, but flattens the colour
"costs an arm and a leg": an idiom, translate the meaning
  · a literal calque would read as a translation
  · plain "très cher" is accurate but loses the colour
  → use the French idiom for the same idea
idiom mapped, not calqued
register matches source (casual)
length checked, fits the button
v1machine«un bras et une jambe»
v2Literess«les yeux de la tête»
v3humanapproved · current
Maria
Maria Keep the body-part image, or go fully idiomatic?
Literess
Literess French has its own: «les yeux de la tête». Same register, lands natively.
web: “arm and a leg french equivalent”dictionary: coûter les yeux de la têtecomment: matches our playful brand voice
Right now the next translation sees only the final sentence, the same memory the market keeps. It can copy the style; it can’t replay the logic.
Translation generates engineering gold: the rejected drafts, the reasoning, the review trail. Almost everyone throws it away. Switch on the layers we keep behind one idiom, and watch how much more the next translation gets to see.

How Transept implements translation memory

At Transept we want to build the state of the art for the quality of translation you can reach with LLMs.

Back when we were solo authors and translators without funding, AI was the only accessible solution. LLMs do not show their full potential without human input — but that input is the most valuable resource in the world: the time of somebody's life. So instead of treating memory as a passive database, we built it as an active participant in the workflow. It feeds constantly, and it constantly gives back.

Hybrid search and granular filtering

Transept's translation memory runs on a hybrid search that combines fuzzy and vector retrieval — fast and accurate. But retrieval is only half the battle; the other half is control over what gets retrieved.

You can filter exactly what enters the memory: draw from an entire organizational library, narrow to one team's portfolio, or restrict it to a single project. By default the system only includes manually approved documents using TMS statuses, but you can override that at the team, document, or project level.

Both humans and AI agents see the most relevant previous translations — including rejected alternatives and the discussion behind the final decision. You don't just see what was chosen; you see why.

Gradient translation memory grounding

For automated AI flows we built what we call "gradient translation memory grounding" to help LLMs perform better:

  • Real-time document syncing: while translating, the AI reads not only approved TM sources but also earlier segments in the same document — keeping terms, style, and choices consistent even without a strict glossary or styleguide.
  • Safe proofreading: when the AI is proofreading or improving text, same-document segments are only used as context once the AI Editor has flagged them as approved. This stops the model from hallucinating or resurfacing earlier errors.
  • Parallel agent syncing: when extra-large documents are translated by multiple agents at once, their memories constantly sync to propagate decisions across the whole text. This was a massive technical hurdle — but it cut translation time for a 40,000-word document from 8 hours to 50 minutes.
Figure 8 · Prompt translation memory
One graded memory, many parallel agents
all 3 agents translating at once
TM sources · what feeds each agent kept · dropped, with the reason
This documentthis run · live
Ajoutez un composant.live draft, used for consistency
Team / project docsshared, approved
dashboard → tableau de bord
«maquette en cours»dropped: WIP, no editorial sign-off
Org librarywhole org, broadest
Sign in → Se connecter
«se loguer»dropped: rejected alternative
Glossary & styleguidelocked rules
🔒widget → composant
🔒formal «vous»
every agent grounds on the kept sources, plus its own live drafts
TranslatingAgent A¶ 1–14k
Add a widget.Ajoutez un composant.🔒 locks widget → composant, syncs →
TranslatingAgent B¶ 14–27k
Remove the widget.Supprimez le composant.✓ uses synced composant
TranslatingAgent C¶ 27–40k
Configure the widget.Configurez le composant.✓ uses synced composant
Phase 1. Each agent reads the kept sources and its own live drafts. The instant Agent A locks widget → composant it syncs to the glossary, so all three land on composant without waiting on each other.
8h50minfor a 40,000-word document, consistent end to end.
A big document is translated by many agents in parallel, then proofread in parallel: the same job at the same time, never mixed. Each agent grounds on a graded stack of sources, and not everything makes the cut.

Extended context and workflow control

Once we had a way to capture good decisions and human talent, we pushed further into deep context and workflow convenience:

  • Omnichannel context: chats, comments, and document search help both humans and AIs find the context behind a translation — web searches, dictionary queries, editor comments, and discussions with teammates and Literess.
  • Adjustable workflows: Transept's automated workflows can improve documents using TM too. Rather than forcing a default behaviour, we let teams tune how memory behaves at each step.
  • Version alternatives: translation version logs help teams remember which of many AI or human drafts was selected — so the memory can replicate the logic of a translation, not just the style.
  • Literess in the review layer: Literess brings memory directly into review. She uses the glossary, styleguide, document context, previous segments, QA findings, and translation history to comment on the document, explain issues, suggest fixes, and help the human reviewer make the final call.

Human–AI feature parity

A core part of Transept's philosophy is feature parity. Because translators' workflows vary wildly, we make sure every tool, memory layer, and context window is equally available to human experts and AI agents.

The result is a memory layer that actively participates in the work. Instead of a human manually checking old files for how a word was translated, the system feeds that context to the AI during drafting, uses it to flag errors during QA, and surfaces it for the human reviewer.

The team stops managing repetitive consistency and goes back to deciding what sounds right. The AI makes sure nothing is forgotten, and Transept captures every creative or legal decision along the way.

The authors

Vitalii Vlasiuk
Vitalii VlasiukCo-founder

Co-founder of Transept, writing as “Mevkh.” A Language and Literature degree, then a turn into software: senior AI engineer shipping production LLM features to 50,000+ users — RAG, agentic tools, LLM-as-judge evaluation. A novelist on the slow path, with 120,000 words of satirical romance fantasy in a drawer. The friction between AI translation and his own prose is what set this whole thing in motion.

Literess
LiteressTransept’s resident assistant

Transept’s in-app assistant. She lives in the editor — building glossaries, running workflows, and answering questions — and every so often she co-writes a post about something she helped figure out. She knows the product better than anyone, mostly because she is part of it.