Svitla Systems Inc. is looking for a Senior AI Engineer for a full-time position (40 hours per week) in Argentina. Our client is a developer of an AI-native project intelligence platform for residential construction - the source of truth that helps architects, builders, and GCs manage design plans, decisions, approvals, and change orders across the full project life cycle. The platform includes an AI assistant that automates manual admin tasks, answers project and document questions, and logs decisions and action items in a transparent audit trail.

The AI-native stack is built from scratch on Azure, spanning a mobile app and a desktop experience, and uses retrieval (RAG) and an agentic orchestration engine. The in-house team includes a CTO with a data science/AI background, a head of product design (ex-Amazon general UX), a small senior dev team, and an orchestration engine built by a technical advisor.

You'll assume prompts and models will drift, that a new model release can quietly break what worked yesterday,



and that you need objective evidence - not gut feel - to know whether the AI assistant is getting better or worse. The instinct is to build the test harness, the golden datasets, and the drift reports that let the team ship changes with confidence. Success looks like: fewer surprises in production, safe model upgrades, and a measurable, improving quality bar.

Requirements

Senior-level experience in prompt engineering on production LLM products.
Hands-on experience building LLM evaluation / eval frameworks (offline and/or online), including regression and A/B testing.
Strong intuition for measuring model quality - designing metrics and test sets, not just eyeballing outputs.
Strong knowledge of Python.
Be comfortable integrating with an Azure-based AI stack and CI-style automation for eval runs.

Responsibilities

Design, test, and maintain production prompts across a range of nuanced workflows and use cases on both mobile and desktop.
Turn fuzzy product r

📌 SENIOR AI ENGINEER (Argentina)
🏢 Svitla Systems
📍 Argentina