Files
office_translator/tests/test_story_2_13_validation.py
sepehr 526c87348f
All checks were successful
Deploy to Production / Build and Deploy (push) Successful in 2m20s
feat(translation): quality pipeline overhaul + new features (audit 2026-08-29)
Translation quality & format preservation:
- Word: merge adjacent same-format runs into one unit (sentence-level
  coherence like inline-tag handling); translate comments/balloons;
  dedupe textbox collection (was translated twice); RTL no longer
  overrides center/justify alignment; CJK/Arabic font hints (eastAsia/cs)
- PPTX: chart translations now actually reach the output file
  (ChartPart.blob is read-only — rewrite chart XML in the saved ZIP);
  CJK typeface hints (a:ea)
- Excel: sheet renames no longer break references — rewrite cell
  formulas (3D/quoted), defined names, data validations, cond. formats
- PDF: bold/italic honored (hebo/heit/hebi); table cells never merge;
  unchanged blocks left untouched (typography preserved, fixes duplicate
  hyperlinks); attempted/changed stats + route gate now cover PDF;
  CJK font paths; scanned PDFs via Mistral OCR (detection + admin settings)

Features:
- formality param (formal/informal) + automatic regional-variant prompts
- output_mode=bilingual docx (source above translation)
- per-user translation memory on Redis (falls back to LRU), context-hashed
- QA report + 0-100 confidence score in job status; L0 on by default
- OpenAI-compatible providers: whole chunk in ONE numbered-JSON request
  (~15x fewer calls) with per-item fallback; base prompt always present
  (custom prompt no longer replaces translation instructions)

Infra & marketing alignment:
- plan-based engine gating + vision gating (closes paid-engine leak);
  /providers/available filtered per plan; 107 languages exposed
- zh-CN/zh-TW validation fixed; libmagic disabled on Windows (native crash)
- admin: Mistral OCR settings + engine status dashboard; httpx<0.28 pin
  (TestClient breakage); Prometheus test fixture fixed
- marketing docs aligned with code (PDF+OCR, retention, engines, pricing)
- security: .env.ionos/.env.production/provider_settings.json removed

Tests: 1173 passed / 0 failed (6 network tests deselected: free Google
endpoint temporarily blocked from this machine)
2026-08-29 18:38:09 +02:00

66 lines
2.4 KiB
Python

import pytest
from fastapi.testclient import TestClient
from main import app
from routes.translate_routes import TranslateEndpointError
client = TestClient(app)
def test_validate_unsupported_extension():
# Test with .txt file
files = {"file": ("test.txt", b"some text content", "text/plain")}
response = client.post(
"/api/v1/translate",
files=files,
data={"target_lang": "fr"}
)
assert response.status_code == 400
assert response.json()["error"] == "INVALID_FORMAT"
# Updated message to French
assert "Formats acceptes" in response.json()["message"]
def test_validate_invalid_magic_bytes():
# Test with .docx extension but invalid content (should trigger CORRUPTED_FILE)
files = {"file": ("test.docx", b"not a zip file", "application/vnd.openxmlformats-officedocument.wordprocessingml.document")}
response = client.post(
"/api/v1/translate",
files=files,
data={"target_lang": "fr"}
)
assert response.status_code == 400
assert response.json()["error"] == "CORRUPTED_FILE"
assert "corrompu" in response.json()["message"]
def _minimal_zip() -> bytes:
"""A real minimal ZIP archive (Office files are ZIPs)."""
import io, zipfile
buf = io.BytesIO()
with zipfile.ZipFile(buf, "w") as zf:
zf.writestr("[Content_Types].xml", "<Types/>")
return buf.getvalue()
def test_validate_valid_file_header():
# Minimal real ZIP: passes magic-byte AND zip-safety checks
files = {"file": ("test.docx", _minimal_zip(), "application/vnd.openxmlformats-officedocument.wordprocessingml.document")}
response = client.post(
"/api/v1/translate",
files=files,
data={"target_lang": "fr"}
)
# Should be 202 (Accepted) if validation passes
assert response.status_code == 202
assert response.json()["data"]["status"] == "processing"
def test_validate_too_large_file():
# Test with file larger than 50MB
large_content = b"PK\x03\x04" + b"0" * (51 * 1024 * 1024)
files = {"file": ("large.docx", large_content, "application/vnd.openxmlformats-officedocument.wordprocessingml.document")}
response = client.post(
"/api/v1/translate",
files=files,
data={"target_lang": "fr"}
)
assert response.status_code == 413
assert response.json()["error"] == "FILE_TOO_LARGE"
assert "volumineux" in response.json()["message"]