Lead QA engineers (AI)
Posted 4 hours 39 minutes ago by LA International
£40,000 - £60,000 Annual
Permanent
Full Time
Other
London, Croydon, United Kingdom, CR0 1SZ
Job Description
Role: AI Tester
Rate: Inside IR35
Location: Remote with occasional travel to Croydon
Duration: 6 months initially
SC Clearance or Eligible
- Strong understanding of machine learning concepts, algorithms and deep learning models to effectively test AI applications.
- Strong understanding of use cases such as classification, text generation, text summarisation.
- Good understanding of data quality and pipelines (Data and ML Pipelines).
- Software testing experience focusing on AI testing, AI test planning including creation of AI test strategies and test plans.
- Experience with testing Generative AI and Natural Language Processing (NLP) systems.
- Experience in model evaluation and model testing.
- Experience with model stacking and model integration testing of AI Machine Learning models for quality, robustness, and performance.
- Experience of Machine Learning testing for anomaly detection using Python libraries.
- Familiarity with AI frameworks and tools like TensorFlow, PyTorch, Keera or similar.
- Proficiency in programming languages such as Python, Java or others used in AI.
- Experience testing with models such as BERT, Meta LLAMA and XGBOOST.
- Strong understanding of model evaluations including model overfitting and underfitting.
- Experience with API testing on endpoints and data exchange formats.
- Experience with version control systems like GIT to manage and track changes to AI codebase.
- Familiarity with metrics related to model classifications and an ability to analyse dashboards provided by cloud native services.
- Understanding of cloud computing platforms like AWS and Azure.
- Effective communication to work collaboratively with cross functional teams including developers and data scientists.
- Azure models specific to Classification: XGBOOST
- AWS SageMaker specific to Summarisation: Meta LLAMA 30B
- Hugging Face models on Azure
- BERT for text generation or data creation
LA International welcomes applications from all sections of the community and from people with diverse experience and backgrounds.