Data Technical Lead
Posted 5 hours 47 minutes ago by Certain Advantage
£750 - £800 Daily
Temporary
Not Specified
Other
London, United Kingdom
Job Description
Data Technical LeadCertain Advantage is hiring for a Data Technical Lead based in London.This role is on an initial contract basis until the end of the year and requires onsite working three days per week.The CompanyWe're working with a business undergoing significant cloud modernisation, transforming its data landscape to improve speed, agility, and technical capability. The PDE platform is a key initiative supporting the organisation's future data vision, enabling consistent global reporting, near real-time access to curated datasets, and improved business decision-making through enhanced data capabilities.The Role: We are seeking a highly experienced Technical Lead with deep expertise in the Azure Data Platform and Databricks ecosystem. The ideal candidate should have strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms.You'll be responsible for:
- Leading the design, development, and implementation of scalable data solutions across Azure and Databricks.
- Defining and driving data strategy, governance, quality standards, and platform best practices.
- Optimising platform performance and managing cloud costs, with a focus on Databricks streaming workloads.
- Providing end-to-end technical leadership from architecture through delivery and production support.
- Collaborating with business stakeholders to deliver solutions aligned with organisational goals.
- Strong experience leading data engineering or technical delivery teams within complex enterprise environments.
- Proven experience designing and delivering solutions using Azure and Databricks.
- A strong understanding of data architecture, governance, data quality, and cloud optimisation.
- Experience managing Databricks streaming workloads and improving platform performance.
- Experience within the financial trading domain, including knowledge of trading data models and related business processes.
- A track record of delivering complex data solutions from concept through to implementation and support.