Overview Are you passionate about languages, writing, and quality evaluation?
We are launching an exciting language evaluation project and are looking for Spanish LATAM-speaking experts to join our team.What you will do: Identify realistic search-related failures where an AI model provides inadequate responses.
Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.
Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability.
Testing multiple queries before finding failures is expected.Project DetailsStart Date: ASAPDuration: Ongoing Project.Commitment: 20 hours per week.Job Type: Freelance contract.Location: RemoteRate: $30 per hour.RequirementsResearch skills - ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentationCritical thinking - Can spot contradictions between sources,
identify outdated information, and recognize when something doesn't apply to a specific locale/contextAttention to detail - Can catch nuances in language, local variations (prices, regulations, requirements), and edge casesProblem-solving mindset - Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-errorDomain knowledge - Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verificationWriting clarity - Can articulate instructions and rubrics clearly so others understand the logic behind their reasoningLocale knowledge - Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures
#J-*****-Ljbffr