Responsibilities
- Test Strategy & Design: Design, implement, and maintain comprehensive automated test suites specifically tailored for AI/ML systems, covering unit, integration, and end-to-end scenarios.
- CI/CD Integration: Integrate testing workflows into the Continuous Integration/Continuous Delivery (CI/CD) pipelines, managing regression runs and optimizing testing strategies for the unique characteristics of AI components (model performance, latency, and drift).
- Model Quality Assurance: Apply knowledge of machine learning and statistics to design meaningful validation tests, interpret model outputs, and continuously assess datasets for quality, completeness, and potential bias or drift.
- Collaboration & Alignment: Work closely with Product Owners, Technical Leads, Developers, and AI Engineers to ensure testability is baked into the model design from the start, driving continuous improvement in AI-related QA processes.
- Ethical AI Focus: Actively contribute to implementing and enforcing responsible AI and ethical principles within the QA framework.
Requirements
- Testing Proficiency: Proven experience in test automation, quality assurance, or software development, with strong proficiency in Python or a similar programming language.
- QA & ML Fundamentals: Strong understanding of general QA principles, the Software Development Lifecycle (SDLC), and core machine learning concepts.
- Metrics Mastery: Knowledge of key ML evaluation metrics and basic statistical methods (e.g., precision, recall, F1 score, AUC) necessary for interpreting and validating model performance.
- Tool Familiarity: Practical experience with AI evaluation and tracking tools (e.g., MLflow, Weights & Biases) and familiarity with standard automation/CI/CD tools (e.g., Jenkins, GitLab, GitHub Actions).
- Cross-Functional Collaboration: You possess strong communication and collaboration skills to effectively bridge the gap between AI Engineers (model builders) and Software Engineers (system builders), driving a unified quality standard.
- Proactive Advocate for Quality: You are a proactive driver of process improvement, always looking for ways to automate testing, increase coverage, and ensure the reliability and ethical soundness of production models.
What we offer
- 28 days of well-deserved holidays
- Onsite Onboarding in our HQ office for an optimal start
- Great compensation and benefits packages including company achievement bonus and stock-based options, regular salary reviews
- Public transport friendly office
- Special terms for local gyms
- Fresh organic fruits, muesli, soft drinks and snacks for free
- Access to Corporate Benefits platform with many discounts
- Regular Team events and company-wide celebrations
- Open door policy, no dress code rules and frequent all Hands
- Hybrid and Flexible work time with up to 50% home office
- Work From Abroad Program allowing up to 40 days of work outside your contracting country
- We celebrate diversity as one of core values, join and drive one of the c-a-r-e initiatives together with us!
For this position, the collectively agreed minimum salary (IT Collective Agreement) is €3,843 gross per month based on a 38.5-hour work week. Naturally, a market-competitive overpayment is possible depending on your qualifications, professional experience, and overall expertise.