Senior AI QA

Job Title Senior AI QA Job Description Hello, we're IG Group. We are an FTSE250 FinTech company who run mobile, web and desktop platforms that help our clients trade stocks & shares, leveraged products, Futures & Options and Crypto.We are ambitious. Over 340,000 people already use our platforms. We're global with offices in 18 countries and products in 16 regions. We're hungry to move faster, ship better product for our customers and grow our user base. We believe in high autonomy, and we want people who are looking to do things differently in order to create better experiences for our customers.We work in cross-functional teams and are laser-focused on increasing the number of active clients we serve to drive sustainable growth.# Your team AI has already begun to transform marketing at IG. To meet the challenge a new team is being created to drive AI Transformation. The AI QA (Quality Assurance) Team operates as part of the first line of defence but is distinct from the core AI development team. This team is responsible for reviewing, evaluating, and verifying the accuracy and performance of AI systems through testing and validation# Your role in the Team's Success The AI QA team collaborates closely with various departments, including IT, business units, and the AI development team, to ensure the successful implementation and monitoring of AI systems. Regular communication and coordination are essential to address any issues promptly and maintain the integrity and performance of AI tools.# What you'll do Develop and implement QA strategies and processes. Ensure compliance with AI governance and risk management frameworks. Monitor ethical considerations and client profiling to prevent biases Conduct technical monitoring of AI tools, ensuring tool integrity and maintenance Work with business and where applicable risk/ compliance, to define expected outcomes including performance, reliability, etc. Provide E2E quality oversight from business requirements to outcomes to ensure alignment. Define data testing strategy (real, synthetic, etc.) and ensure appropriate data is available to conduct quality testing activities Execute regular spot comprehensive checks across all risk levels and environments. Define dashboards/reporting/telemetry to report defects/ issues or discrepancies in AI system performance. Conduct initial and ongoing risk assessments for AI tools.# What you'll need for this role Proven experience in QA/testing of AI/ML systems, with deep understanding of AI model validation, testing methodologies, and performance metrics Strong knowledge of AI governance frameworks, responsible AI principles, and bias detection/mitigation techniques Expertise in developing comprehensive testing strategies including functional, integration, performance, and security testing for AI systems Proficiency in data testing approaches including synthetic data generation, data quality assessment, and test data management Experience with monitoring tools, dashboard creation, and telemetry systems to track AI system performance and defects Familiarity with test automation frameworks and tools relevant to AI/ML workflows Understanding of risk assessment methodologies and quality gating processes across development environments Experience working in Agile/DevOps environments with CI/CD pipelines Proficient in Python and SQL# How we work We try to take a thoughtful approach to our ways of working as a company. We follow a hybrid working model with 3 days in the office - which we think balances the need to collaborate effectively and connect with each other. When it comes to how we deliver, there are 5 things we want everyone to do to drive high performance, better learning and career satisfaction: Lead and Inspire: Drives trust, alignment, and enthusiasm Think Big: Focus on the problems that most impact commercial outcomes Champion the client: Understand and prioritise client's needs Deliver at pace: Push for fast, sustainable growth; Raise the bar: Take ownership, be accountable and share feedbackWe believe that diversity is vital to success, it fuels creativity, drives innovation and sets us up for global success. We're committed to building teams with a variety of perspectives and skills to help us realise our vision and strategy, that's why we encourage applications from people with diverse backgrounds and experiences to join us on this journey. Learn more about our D&I approach .# The Perks Your growth fuels our success!Thrive with tailored development programs, mentoring opportunities with leaders, and clear career progression. Expand your network through committees, sports and social clubs. Enjoy extra time off for volunteering and community work. Competitive salary Flexible Benefits Package on top of your salary (12%) Private medical cover for you and your family Life insurance Contribution to gym memberships 25 Days holiday, with 1 additional day off to celebrate your Birthday & 2 additional days off a year for voluntary work (28 in total The option to buy or sell holiday days. Unlimited access to the LinkedIn Learning Platform A comprehensive global and local onboarding process Employee-led LGBTQ+, Women's, Black and Parents & Carers networks with an annual budget for organising events & projects that foster an open, diverse and inclusive culture Option to participate and create ESG initiatives based on IG Brighter Future Fund Enhanced primary (maternity), secondary (paternity), and shared parental pay and leave, as well as a range of support and benefits for parentsLearn more about the Perks ! Join us for this exciting journey. # Apply now! Number of openings 1