trillionlabs/Tri-1.8B-Translation

Tri-1.8B Translation

We release Tri-1.8B Translation, a lightweight multilingual translation model from Trillion Labs.

Tri-1.8B Translate is trained through pretraining and supervised fine-tuning (SFT), and was distilled from our larger Tri-21B model to preserve strong translation quality in a much smaller, deployment-friendly 1.8B parameter model. It supports all translation directions among English, Korean, Japanese, and Chinese.

✨ Highlights

• Compact & efficient: ~1.8B params, easy to serve on a single GPU.
• Multilingual: Fully bidirectional EN ↔ KO ↔ JA ↔ ZH.
• Simple prompts: Works with a short task instruction + <lang> tag.
• Research-ready: Suitable for domain SFT or lightweight adapters.

---

🧾 Prompt format

Translate the following {SRC_NAME} text into {TGT_NAME}:
{TEXT} <{lang_tag}>

Where {lang_tag} ∈ { en, ko, ja, zh }.

---

🔧 Usage

1) 🤗 Transformers

from transformers import AutoTokenizer, AutoModelForCausalLM

model_name = "trillionlabs/Tri-1.8B-Translation"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")

text = "안녕하세요"
messages = [
    {"role": "user", "content": f"Translate the following Korean text into English:\n{text} <en>"}
]

inputs = tokenizer.apply_chat_template(
    messages, 
    return_tensors="pt",
    add_generation_prompt=True
).to(model.device)

outputs = model.generate(
    inputs,
    max_new_tokens=256,
    do_sample=False,
    pad_token_id=tokenizer.eos_token_id
)

full_output = tokenizer.decode(outputs[0], skip_special_tokens=True)
translation = tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True)

print(f"Korean: {text}")
print(f"English: {translation}")

---

2) Local vLLM

from vllm import LLM, SamplingParams

llm = LLM(model="trillionlabs/Tri-1.8B-Translation")
sp = SamplingParams(temperature=0.3, max_tokens=512)

def translate(text, target="en"):
    prompt = f"Translate into {target}:\n{text} <{target}>"
    out = llm.chat([{"role": "user", "content": prompt}], sampling_params=sp)
    return out[0].outputs[0].text.strip()

print(translate("안녕하세요", "en"))

---

3) API client (OpenAI-compatible)

import openai

client = openai.OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")

def translate(text, target="en"):
    prompt = f"Translate into {target}:\n{text} <{target}>"
    resp = client.chat.completions.create(
        model="trillionlabs/Tri-1.8B-Translation",
        messages=[{"role": "user", "content": prompt}],
        temperature=0.3,
        max_tokens=512,
    )
    return resp.choices[0].message.content.strip()

print(translate("안녕하세요", "en"))

📜 License

Apache-2.0 (for model weights & code). Please verify data licenses for your use.

🙏 Acknowledgments

• Thanks to the ByteDance Seed team for releasing Seed-X; our prompt template and some training design were adapted from their paper.

📚 Citation

If you use Tri-1.8B Translation, please cite:

@misc{suk2025tri18b,
  title   = {Tri-1.8B Translation: A Lightweight Multilingual Translation Model},
  author  = {Juyoung Suk and Trillion Labs},
  year    = {2025},
  howpublished = {\url{https://huggingface.co/trillionlabs/Tri-1.8B-Translation}}
}