Driven by our enthusiasm for meeting new talents and fostering connections within the community and as part of our profile mapping program, we are now exploring diverse roles, including Semi Senior QA Engineer to expand the QA area. It's important to note that, in this instance, the role does not involve immediate hiring but rather serves as a part of a pipeline for future recruitments.

We're looking for a QA Engineer with experience testing AI-powered applications.

What are the main responsibilities of this role?
- Create detailed, comprehensive, and well-structured test plans and test cases.
- Review client needs and technical specifications with the development team to provide timely and meaningful feedback.
- Estimate, prioritize, plan, and coordinate testing activities.
- Identify, record, document thoroughly, and track bugs.
- Design, develop, and execute automation scripts (including Playwright-based automation).
- Perform thorough regression testing when bugs are resolved.
- Track quality assurance metrics and reports.
- Design and maintain evaluation suites (evals)



to validate AI-powered features and detect regressions in model behavior.
- Test non-deterministic AI systems, including LLM-based features, AI agents, and RAG applications, using qualitative and quantitative evaluation methods.
- Analyze AI outputs, identify failure patterns (hallucinations, instruction-following issues, grounding, etc.), and collaborate with engineers to improve system quality.
- Stay up to date with new testing tools, AI evaluation techniques, and quality assurance strategies while driving continuous improvement.
- Investigate the causes of software defects and collaborate with the development team to implement preventive solutions.
- Collaborate on internal initiatives.

Which skills and experience do we envision for this role?
- Background in Software Engineering, Computer Science, or a related field.
- 3+ years of experience as a QA Engineer.
- Advanced English skills.
-

📌 Ssr QA Engineer (Buenos Aires)
🏢 Rootstrap
📍 Buenos Aires