Data Engineer
Posted 9 hours 9 minutes ago by IO Associates
We are partnering with a leading consultancy to recruit a Data Engineer to join their team on a permanent basis. This role is ideal for someone with experience in MOD systems assurance and a strong track record of reviewing, assessing, and recommending best practices across complex technical environments.
This position is hybrid, with 1 to 2 days per week in the London office and the remainder mostly remote.
Due to the nature of the work, candidates must be eligible for Security Clearance (SC). You must be a sole British passport holder and have lived in the UK for at least five years.
Responsibilities:
- Analyse data requirements and work with large, structured datasets to ensure accuracy and completeness
- Build and maintain scalable ETL/ELT pipelines for ingestion, transformation, and validation
- Develop data models and implement storage solutions such as S3, Azure Blob, BigQuery or Snowflake
- Apply data quality checks and prepare datasets for reporting, analytics and visualisation
- Support data governance, standards, anonymisation and security best practice
- Monitor, tune and optimise data workflows for performance, cost efficiency and reliability
- Contribute to research and emerging technology evaluation to improve data engineering practices
Key Requirements:
- Proven experience working as a Data Engineer in complex or secure environments
- Strong understanding of data modelling, data integration and data management principles
- Proficiency in SQL, Python and pipeline tools (eg, Airflow, Spark)
- Experience with cloud platforms such as AWS, Azure or GCP
- Awareness of modern data architectures, analytics and visualisation tooling
- Strong analytical skills and ability to work independently as part of a collaborative team
This is an exciting opportunity to grow your data engineering expertise while contributing to programmes of national importance. The client offers strong career development, ongoing training and the chance to work with modern cloud and data technologies.
If you have practical experience in data engineering and want to progress your career on meaningful, mission-led projects, get in touch to learn more!