AI/ML Quality Assurance Engineer Full Time

About E2M:

E2M Solutions works as a trusted white-label partner for digital agencies. We support agencies with consistent and reliable delivery through services such as website design, web development, ecommerce, SEO, AI SEO, PPC, AI automation, and content writing. Founded on strong business ethics, we are an equal opportunity organization powered by 300+ experienced professionals, partnering with 400+ digital agencies across the US, UK, Canada, Europe, and Australia. At E2M, we value ownership, consistency, and people who are committed to doing meaningful work and growing together. If you’re someone who dreams big and has the gumption to make them come true, E2M has a place for you.

Job Summary

We are looking for a dedicated AI/ML Quality Assurance Engineer who will be responsible for ensuring the quality and reliability of AI/ML solutions, models, and intelligent systems. You will develop and execute test plans, validate model performance, collaborate with AI developers, and automate testing where applicable.

Key Responsibilities:

• Design, develop, and execute comprehensive test plans and test cases for AI/ML models and AI-enabled applications (functional, non-functional, regression, performance)
• Validate AI model accuracy, stability, robustness, fairness, and reliability under diverse scenarios
• Collaborate closely with AI engineers / data scientists to understand model behaviour and requirements
• Automate validation workflows using scripting languages/tools
• Track, investigate, and report issues/defects; work with developers for root-cause analysis
• Ensure end-to-end testing of data pipelines feeding AI system
• Contribute to continuous improvement of the AI QA framework and standards
• Create test documentation, results reports, and QA metrics dashboards
• Participate in planning and QA strategy discussions

Required Skills & Qualifications:

Technical Skills:

• Bachelor’s degree in Computer Science, IT, Engineering, or related field.
• 3+ years overall QA experience (manual + automation; preferably including AI systems)
• At least 1 year of hands-on experience with AI/ML system testing or AI solutions
• Familiarity with automation tools (Selenium, PyTest, JUnit, or similar)
• Knowledge of version control (Git), CI/CD principles, test management tools
• Understanding of data validation, model evaluation metrics, bias/fairness checks

Soft Skills:

• Strong analytical and problem-solving ability
• Excellent communication and collaboration skills
• Detail-oriented, proactive in eliminating defects early
• Ability to work in cross-functional teams

Nice-to-Have:

• Experience in automated model testing frameworks
• Knowledge of NLP, computer vision, or deep learning testing
• Experience with cloud platforms (AWS / GCP / Azure)
• Certifications in AI/ML or QA (ISTQB, AI certification etc.)