Mid-Level QA Analyst – AI/ML Systems Validation

Hook – Inspire Innovation and Precision in AI/ML Validation
Empower the future of AI — deliver flawless, fair, and reliable intelligent systems!

Location & Work Model
Porto, Portugal — Hybrid work arrangement with up to 2 remote days per week

Introduction
As a Mid-Level QA Analyst, you will be working for our client, a leading financial institution’s innovative Business Unit. You will contribute to the validation and testing of AI-powered applications, ensuring their functional reliability, fairness, robustness, and performance. This role bridges advanced AI/ML model evaluation with standard quality assurance practices, offering a unique opportunity to shape cutting-edge AI solutions with high impact and scope for professional growth.

Your main responsibilities:

• Develop and implement test strategies, plans, and manual/exploratory test cases specifically tailored for AI/ML systems, addressing model fairness, explainability, and edge cases.
• Validate AI/ML models by assessing prediction accuracy, data pipeline integrity, and data quality, contributing to defining success metrics such as precision, recall, and model bias.
• Analyze backlog user stories, estimate testing efforts considering AI data variability, and challenge AI model requirements with Product Owners.
• Manage defect tracking and reporting using Jira and Xray, supporting defect resolution and UAT activities.
• Collaborate with business stakeholders and UAT teams to ensure models’ outputs meet functional and business expectations.
• Participate actively in Agile Scrum ceremonies, sprint planning, and backlog refinement to ensure seamless integration of testing activities within development cycles.

You’re ideal for this role if you have:

• At least 4 years of experience as a QA Analyst, with hands-on testing of complex applications in Agile environments.
• Strong knowledge of API testing (Postman, SoapUI) and SQL data validation.
• Practical experience in testing AI/ML models, understanding model accuracy metrics, and validating data pipelines.
• Proficiency with Jira and Xray for test management.
• Skills in scripting languages such as Python for test data preparation.
• Excellent command of English; French language skills are a strong plus.

It is a strong plus if you have: (optional)

• Experience with automated testing frameworks like Selenium or Playwright.
• Background in Data Science, Computer Science, or Software Engineering.

Language Required for the role:
Fluent English. Fluent or working proficiency in French is highly desirable.

Eligibility for the role:
Only candidates with an existing legal right to work in the European Union will be considered for this role.

#MAKEYourCareerBETTER
Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.