# Offline AI Translation on macOS with Hy-MT2, Gemma 3, and PaddleOCR

> Beyond Translate runs on-device translation models (Hy-MT2 1.8B Q4 at ~1.13 GB for 4 GiB+ Macs, Hy-MT2 7B Q4 at ~4.62 GB for 8 GiB+ Macs, plus Gemma 3) and offline multilingual PaddleOCR (PP-OCRv6 Small) directly inside the native macOS app—no API key required, resumable downloads with SHA256 verification.

- Last updated: 2026-11-19
- Canonical URL: https://beyondtranslate.com/guides/local-models

Translate selected text and screenshots entirely on your Mac without cloud API keys or sending data off-device.

## On-Device Engine Specifications

| Engine / Model | Download Size | Minimum Requirement | Key Highlights |
| --- | --- | --- | --- |
| Hy-MT2 1.8B (Q4) | ~1.13 GB | ≥ 4 GiB system RAM | Fast on-device translation; official Hy-MT2 chat template; streaming output |
| Hy-MT2 7B (Q4) | ~4.62 GB | ≥ 8 GiB system RAM | Higher translation quality on-device; resumable SHA256-verified download |
| Gemma 3 | Varies by variant | Apple Silicon / macOS | Selectable alongside Hy-MT2 under Local models → Manage downloads |
| PaddleOCR (PP-OCRv6 Small) | Compact offline bundle | macOS | Offline multilingual OCR for screenshots, subtitles, and dropped images |
| macOS System Translation | OS language packs | macOS 26 or later | Built into macOS; install language pairs in System Settings |

## How to Enable Offline Translation & OCR on macOS

1. **Open Local Model Management** — Launch Beyond Translate on macOS and open Settings → Providers → Local models → Manage downloads. The app prepares the local model directory automatically.
2. **Accept the Model License and Download** — Choose Hy-MT2 1.8B, Hy-MT2 7B, or a supported Gemma 3 variant, accept the model license, and start downloading. Downloads support resume and verify against pinned SHA256 hashes.
3. **Enable and Set Your Default Translation Service** — Once downloaded, enable the local model service in Settings → Services and mark it as your default translation service for screen selection, clipboard, and input.
4. **Optionally Enable Offline PaddleOCR** — In provider settings, download PaddleOCR (PP-OCRv6 Small) and select it as your default OCR service in Settings → Services if you want fully offline screenshot recognition.

## Self-Hosting Larger Hy-MT2 Models (vLLM / SGLang)

If you run a larger model on a workstation or private server—such as tencent/Hy-MT2-30B-A3B via vLLM or SGLang—choose the OpenAI Compatible provider in Beyond Translate and point the Base URL at your server.

Keep the custom system prompt blank so Beyond Translate automatically applies Hy-MT2’s official translation instructions and plain-text / streaming output handling. Note that 1.25-bit and 2-bit quantizations require specialized backend kernels and are not included in the built-in download catalog.

## Privacy & Daily Limits Note

All on-device inference keeps your source text and screenshot pixels on your Mac. No external translation API charges apply when using local models or macOS system translation.

Beyond Translate’s app-level free allowance covers up to 100 translation requests and 50 screenshot text requests per day with no account required; a one-time US$9.99 lifetime license removes these daily limits.

## Local Model FAQs

### Do local models work without an internet connection?

Yes. Once you finish downloading the model files (and optionally PaddleOCR), both text recognition and translation run offline on your Mac without internet access or an API key.

### What happens if a 4.6 GB model download is interrupted?

Built-in downloads support resuming from where they left off and automatically verify file integrity against pinned SHA256 checksums.

### Which Hy-MT2 size should I pick?

Choose Hy-MT2 1.8B Q4 (~1.13 GB) for quick responses or Macs with 4–8 GiB RAM, and Hy-MT2 7B Q4 (~4.62 GB) on Macs with at least 8 GiB RAM when you want stronger translation quality.

### Do I need PaddleOCR if macOS already has built-in OCR?

Not strictly—macOS built-in OCR already works offline with no key. Offline PaddleOCR (PP-OCRv6 Small) gives you an alternative multilingual OCR engine that you can download and set as default in Settings → Services.
