
AI Quality Engineer
Skills
About the role
Location: Singapore
About the Role
Help build trust in AI-powered solutions by ensuring agents, copilots, and intelligent workflows are reliable, accurate, and ready for production. This role focuses on validating AI behavior, business outcomes, integrations, and automation quality across enterprise platforms and managed services operations.
Key Responsibilities
Design and execute quality engineering strategies for AI agents, copilots, intelligent workflows, and Human + Agent operating models.
Validate agent outputs, prompt behavior, hallucination risks, regression impacts, and business process accuracy.
Develop AI testing frameworks, evaluation datasets, acceptance criteria, and risk-based quality gates.
Build and maintain automated regression suites for AI-enabled enterprise applications and workflows.
Test integrations and end-to-end user journeys across platforms such as SAP, Salesforce, ServiceNow, SuccessFactors, mobile applications, and enterprise systems.
Partner with Product Managers, Solution Architects, Agentic Engineers, and AgentOps teams to ensure AI solutions are safe, reliable, auditable, and production-ready.
Required Qualifications:
Proven experience in QA Automation and test automation frameworks.
Experience testing APIs, integrations, and enterprise applications.
Proficiency in Playwright, TypeScript, and/or Python.
Experience developing automated test strategies, regression suites, and quality assurance processes.
Strong analytical and problem-solving skills with attention to quality and risk management.
Preferred Qualifications
Experience testing AI, Generative AI, copilots, agents, or intelligent automation solutions.
Knowledge of prompt evaluation, hallucination detection, model validation, and AI quality metrics.
Experience with CI/CD pipelines, DevOps, or Quality Engineering practices.
Familiarity with SAP, Salesforce, ServiceNow, SuccessFactors, or other enterprise platforms.
Experience working in Agile product development or managed services environments.
Questions about this role
Want AI Applyd to auto-apply to roles like this?
We tailor your resume per posting, fill the forms, and track replies for you.