Offline AI Guide

Offline AI Translation on macOS with Hy-MT2, Gemma 3, and PaddleOCR

Translate selected text and screenshots entirely on your Mac without cloud API keys or sending data off-device.

Last updated:

Quick Answer

Beyond Translate runs on-device translation models (Hy-MT2 1.8B Q4 at ~1.13 GB for 4 GiB+ Macs, Hy-MT2 7B Q4 at ~4.62 GB for 8 GiB+ Macs, plus Gemma 3) and offline multilingual PaddleOCR (PP-OCRv6 Small) directly inside the native macOS app—no API key required, resumable downloads with SHA256 verification.

On-Device Engine Specifications

Engine / ModelDownload SizeMinimum RequirementKey Highlights
Hy-MT2 1.8B (Q4)~1.13 GB≥ 4 GiB system RAMFast on-device translation; official Hy-MT2 chat template; streaming output
Hy-MT2 7B (Q4)~4.62 GB≥ 8 GiB system RAMHigher translation quality on-device; resumable SHA256-verified download
Gemma 3Varies by variantApple Silicon / macOSSelectable alongside Hy-MT2 under Local models → Manage downloads
PaddleOCR (PP-OCRv6 Small)Compact offline bundlemacOSOffline multilingual OCR for screenshots, subtitles, and dropped images
macOS System TranslationOS language packsmacOS 26 or laterBuilt into macOS; install language pairs in System Settings

How to Enable Offline Translation & OCR on macOS

  1. 01

    Open Local Model Management

    Launch Beyond Translate on macOS and open Settings → Providers → Local models → Manage downloads. The app prepares the local model directory automatically.

  2. 02

    Accept the Model License and Download

    Choose Hy-MT2 1.8B, Hy-MT2 7B, or a supported Gemma 3 variant, accept the model license, and start downloading. Downloads support resume and verify against pinned SHA256 hashes.

  3. 03

    Enable and Set Your Default Translation Service

    Once downloaded, enable the local model service in Settings → Services and mark it as your default translation service for screen selection, clipboard, and input.

  4. 04

    Optionally Enable Offline PaddleOCR

    In provider settings, download PaddleOCR (PP-OCRv6 Small) and select it as your default OCR service in Settings → Services if you want fully offline screenshot recognition.

Self-Hosting Larger Hy-MT2 Models (vLLM / SGLang)

If you run a larger model on a workstation or private server—such as tencent/Hy-MT2-30B-A3B via vLLM or SGLang—choose the OpenAI Compatible provider in Beyond Translate and point the Base URL at your server.

Keep the custom system prompt blank so Beyond Translate automatically applies Hy-MT2’s official translation instructions and plain-text / streaming output handling. Note that 1.25-bit and 2-bit quantizations require specialized backend kernels and are not included in the built-in download catalog.

Privacy & Daily Limits Note

All on-device inference keeps your source text and screenshot pixels on your Mac. No external translation API charges apply when using local models or macOS system translation.

Beyond Translate’s app-level free allowance covers up to 100 translation requests and 50 screenshot text requests per day with no account required; a one-time US$9.99 lifetime license removes these daily limits.

Local Model FAQs

Do local models work without an internet connection?

Yes. Once you finish downloading the model files (and optionally PaddleOCR), both text recognition and translation run offline on your Mac without internet access or an API key.

What happens if a 4.6 GB model download is interrupted?

Built-in downloads support resuming from where they left off and automatically verify file integrity against pinned SHA256 checksums.

Which Hy-MT2 size should I pick?

Choose Hy-MT2 1.8B Q4 (~1.13 GB) for quick responses or Macs with 4–8 GiB RAM, and Hy-MT2 7B Q4 (~4.62 GB) on Macs with at least 8 GiB RAM when you want stronger translation quality.

Do I need PaddleOCR if macOS already has built-in OCR?

Not strictly—macOS built-in OCR already works offline with no key. Offline PaddleOCR (PP-OCRv6 Small) gives you an alternative multilingual OCR engine that you can download and set as default in Settings → Services.

Related Resources

All Supported Providers

Browse built-in, on-device, cloud BYOK, and OpenAI-compatible engines.

All Supported Providers

Download macOS Beta

Install Beyond Translate on macOS via TestFlight.

Download macOS Beta

Documentation

Permissions, global shortcuts, and troubleshooting details.

Documentation