26 feb
AgileEngine
Victoria
Job Description AgileEngine is an Inc. **** company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries.
We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE We are looking for a Manual QA Engineer to ensure the quality and reliability of web applications and AI-driven features in an Agile environment.
This role is critical in validating user experiences, APIs, and LLM-powered functionality, safeguarding accuracy, compliance, and performance across releases.
You'll collaborate closely with engineering to strengthen testing practices, contribute to CI/CD quality gates, and elevate standards in both traditional and AI-focused QA processes.
WHAT YOU WILL DO - Perform manual testing of web applications to identify bugs, glitches, and inconsistencies; - Develop, maintain, and execute detailed manual test cases based on product requirements and specifications; - Perform thorough cross-browser UI testing to ensure consistent behavior across Chrome, Firefox, Safari, Edge, etc.
; - Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs to ensure accuracy, completeness, and alignment with project requirements; - Design and execute test scenarios to verify AI behavior, including prompt–response consistency, contextual relevance, and deterministic vs. non-deterministic outputs; - Evaluate AI model quality using defined acceptance metrics (precision, recall, hallucination rate, duplication rate); - Conduct manual API testing to validate request/response accuracy, error handling, and integration; - Use TestRail to create, manage, and track test plans, test cases,
and test execution results; - Use Jenkins CI/CD pipelines; - Report and document defects clearly using the bug tracking system (JIRA); - Participate in daily stand-ups, sprint planning, and other Agile team meetings; - Review user stories and acceptance criteria to understand the scope of testing; - Estimate own tasks, report on risks to the team lead; - Collaborate with developers and other QA team members to reproduce issues and verify fixes; - Maintain and update test documentation as needed.
MUST HAVES - 2+ years of experience with manual testing ; - Basic understanding of methodologies and SDLC and STLC (Software Development and Testing Life Cycle) models; - Knowledge of Testing and Quality Assurance Processes; - Strong experience with Test Design activities to cover a set of product requirements; - Knowledge of Test Design techniques; - Knowledge of testing methodologies; - Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes; - Experience with Postman (API testing) and Browser developer tools; - Experience with UI testing; - Understanding of LLM evaluation principles, including prompt engineering, output validation, and model fine-tuning cycles; - Familiarity with AI/ML concepts, APIs, and frameworks (e.g., OpenAI API, Azure OpenAI, LangChain ); - Knowledge of data protection and compliance standards for AI systems (GDPR, zero-data retention, PII anonymization); - Experience with TestRail as a Test Management system (as a user,
test execution is required); - Basic understanding of CI/CD process; - Upper-intermediate English level .
NICE TO HAVES - Experience with SSO testing; - Experience in Performance or Load.
PERKS AND BENEFITS - Professional growth: Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation: USD-based pay with education, fitness, and team activity budgets.
- Exciting projects: Modern solutions with Fortune 500 and top product companies.
- Flextime: Versátil schedule with remote and office options.
Meet Our Recruitment Process It includes main stages: Application ? Coding Challenge ? Video Interview ? Technical Interview or Interview with the Hiring Manager(s).
Each step helps us understand your skills and overall fit.
If it's a match, you'll receive an offer.
Requirements 2+ years of experience with manual testing; Basic understanding of methodologies and SDLC and STLC (Software Development and Testing Life Cycle) models; Knowledge of Testing and Quality Assurance Processes; Strong experience with Test Design activities to cover a set of product requirements; Knowledge of Test Design techniques; Knowledge of testing methodologies; Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes; Experience with Postman (API testing) and Browser developer tools; Experience with UI testing; Understanding of LLM evaluation principles, including prompt engineering, output validation, and model fine-tuning cycles; Familiarity with AI/ML concepts, APIs, and frameworks (e.g., OpenAI API, Azure OpenAI, LangChain); Knowledge of data protection and compliance standards for AI systems (GDPR, zero-data retention, PII anonymization); Experience with TestRail as a Test Management system (as a user, test execution is required); Basic understanding of CI/CD process; Upper-intermediate English level.
📌 Manual Qa Engineer (Middle) Id51808 (Victoria)
🏢 AgileEngine
📍 Victoria
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.