Lead Data Engineer

Join a Leading Growth business on its transformative journey to become the UK's most recommended businesses in their industry

Lead Data Engineer

Salary: £70-90k

Location: Reading - Hybrid

Benefits: Competitive

Role Overview:

As Lead Data Engineer , you will be part of the Corporate Data team, reporting directly to the Senior Leadership team. You will lead a small team of data engineers, overseeing the design, build, and maintenance of the infrastructure and systems that collect, store, and process corporate data for reporting and analysis.

Key Responsibilities:

• Lead and manage a team of data engineers.

• Design, build, and maintain data infrastructure and systems.

• Ensure effective use of Microsoft Fabric and Synapse analytics platform.

• Collaborate with various stakeholders, including Data and Systems owners, Data Analysts, Data Architects, Infrastructure Architects, and external suppliers.

Experience required

• Dynamic and hands-on leader who excels in managing and coaching a team.

• Thrives in a collaborative environment and adapts to changing priorities with ease.

• Excellent communication and presentation skills, capable of conveying complex ideas to both technical and non-technical stakeholders.

• Deep understanding of DataLake, Lakehouse, and Warehouse paradigms.

• Extensive experience in developing and maintaining data pipelines for ELT/ETL from various data sources, including databases, APIs, text files, and Parquet.

• Expert knowledge of the Microsoft Fabric Analytics Platform (Azure SQL, Synapse, PowerBI).

• Proficient in Python for data engineering tasks, including data ingestion from APIs, creation and management of Parquet files, and execution of ML models.

• Strong SQL skills, enabling support for Data Analysts with efficient and performant queries.

• Skilled in optimizing data ingestion and query performance for MSSQL or other RDBMS.

• Familiar with data processing frameworks such as Apache Spark.

• Highly analytical and tenacious in solving complex problems.