AI Evaluation Rubric Auditor (Buenos Aires)

AI Evaluation Rubric Auditor (Buenos Aires)

21 nov
|
Mercor
|
Buenos Aires

21 nov

Mercor

Buenos Aires

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: AI Evaluation Rubric Auditor
Type: Contract
Compensation: $60–$85/hour
Location: Remote

Role Responsibilities

- Audit complete tasks, including prompts and grading rubrics, to ensure rubric failures are fair.
- Evaluate if information was available and if rubrics accurately grade the prompt requirements.
- Determine if valid answers were incorrectly marked wrong and if rubric structures follow guidelines.
- Provide feedback to reviewers on prompt and rubric issues.
- Work independently and asynchronously to meet deadlines and improve AI model performance .

Qualifications

Must-Have





- Substantial experience writing or reviewing rubrics for LLM evals .
- Experience providing feedback to writers/reviewers.
- Consistent availability.
- Ability to read long agent transcripts and identify errors.
- Precise writing skills and data verification instead of relying on reference answers.

Application Process (Takes 20–30 mins to complete)

- Upload resume
- AI interview based on your resume
- Submit form

Resources & Support

- For details about the interview process and platform information, please check:
- For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

📌 AI Evaluation Rubric Auditor (Buenos Aires)
🏢 Mercor
📍 Buenos Aires

Postulate a este anuncio

Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: ai evaluation rubric auditor (buenos aires) / buenos aires

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: ai evaluation rubric auditor (buenos aires) / buenos aires