Data Engineer (SC Cleared)
Posted 5 days 15 hours ago by Scrumconnect Limited
London, United Kingdom Posted on 12/08/2025
Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. With a strong commitment to user-centred design and agile delivery, and more to deliver innovative digital services that matter
Clearance: Active SC clearance is mandatory
We are looking for an experienced Data Engineer to develop and maintain data products and a Strategic Data Platform. You will work as part of multi-functional Agile delivery teams, ensuring operational stability, ongoing support, and enhancement of data solutions. The role focuses on designing, delivering, and optimising scalable data architectures, with a strong emphasis on Azure-based tools and modern engineering practices.
Design, build, and maintain data solutions using Azure Data Factory and Azure Synapse.
Manage data development lifecycle within Agile delivery teams.
Integrate and automate data workflows into Azure DevOps pipelines.
Create and maintain dimension data models and semantic models for integration with Power BI.
Develop complex dashboards, visualisations, and reporting solutions using Power BI.
Implement data governance, quality checks, and profiling to ensure accuracy and compliance.
Migrate legacy data capabilities to modern Azure-based platforms.
Collaborate with business stakeholders to translate requirements into robust technical solutions.
Coach and mentor team members to enhance capability in data engineering best practices
Active SC Clearance (must be valid and in place at application stage).
Proven experience with:
Power BI (including semantic models)
Python (including PySpark)
Experience with Terraform for infrastructure-as-code deployments.
Ability to deliver solutions using structured and unstructured data.
Experience in Agile environments.
Strong business analysis skills to understand service needs and document accurately.
Proven experience in legacy migration projects within complex organisations.
Ability to work collaboratively and communicate effectively with technical and non-technical stakeholders.
Azure certifications (Data Engineering, Data Scientist, or related specialisation).
Knowledge of GDPR compliance, data security, and governance best practices.