AI QA Engineer (all genders)

Responsibilities

• Design, implement, and maintain automated tests, especially for systems using AI/ML models
• Integrate tests into CI/CD pipelines, monitor regression runs, and adjust strategies for AI components
• Create and maintain comprehensive test plans covering requirements, use cases, and AI-specific quality aspects (performance, accuracy, robustness, fairness)
• Actively contribute to scrum ceremonies, providing feedback from both a user and AI quality perspective
• Collaborate with Product Owners, Tech Leads, Developers, and AI Engineers from use case definition to model refinement to ensure testability
• Assess datasets for quality and bias and evaluate their impact on model behavior
• Apply foundational knowledge of machine learning and statistics to design meaningful tests and interpret AI results
• Drive continuous improvement in QA processes, especially AI-related testing methods
• Work closely with QA colleagues and development teams across units to align on quality standards and address AI-specific challenges

Requirements

• Experience in test automation, software development, or quality assurance, with proficiency in Python or similar languages
• Strong understanding of QA principles, SDLC, and foundational machine learning concepts
• Ability to design meaningful AI/ML test scenarios, focusing on model behavior, edge cases, and reliability
• Knowledge of evaluation metrics and basic statistical methods (precision, recall, F1, AUC, distributions, sampling)
• Experience assessing datasets, including labeling, data quality checks, and identifying bias, data drift, or concept drift
• Familiarity with AI evaluation tools (e.g., MLflow, Weights & Biases) and standard automation or CI/CD tools (e.g., Selenium, GitLab, Jenkins)
• Awareness of ethical AI principles and best practices for responsible AI
• Good communication skills to collaborate with different stakeholders

What we offer

• 28 days of well-deserved holidays
• Onsite Onboarding in our HQ office for an optimal start
• Great compensation and benefits packages including company achievement bonus and stock-based options, regular salary reviews
• Public transport friendly office
• Special terms for local gyms
• Fresh organic fruits, muesli, soft drinks and snacks for free
• Access to Corporate Benefits platform with many discounts
• Regular Team events and company-wide celebrations
• Open door policy, no dress code rules and frequent all Hands
• Hybrid and Flexible work time with up to 50% home office
• Work From Abroad Program allowing up to 40 days of work outside your contracting country
• We celebrate diversity as one of core values, join and drive one of the c-a-r-e initiatives together with us!

For this position, the collectively agreed minimum salary (IT Collective Agreement) is €3,843 gross per month based on a 38.5-hour work week. Naturally, a market-competitive overpayment is possible depending on your qualifications, professional experience, and overall expertise.