Databricks Engineer (SC Cleared)

Databricks Engineer (SC Cleared)

London (Hybrid)

6 Month Contract

£550-600/day (Inside IR35)

Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid).

Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start ASAP in Nov/Dec 2025.

Hybrid Working - 2 days/week remote (WFH), and 3 days/week working on-site from the Central London office.

A chance to work with a leading global IT and Digital transformation business specialising in Government projects:

• In-depth Data Engineering + strong hands-on Azure Databricks expertise.
• Azure Data Services, Azure Data Factory, Azure Blob Storage + Azure SQL Database.
• Designing, developing, building + optimising data pipelines, implementing data transformations, ensuring data quality and reliability.
• Deep Data Warehousing knowledge including data modelling techniques + data integration patterns.
• Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design.
• Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases.
• Experience with data quality, data governance processes, Git version control + Agile development environments.
• Azure Data Engineer certification preferred -eg- Azure Data Engineer Associate.
• Advantageous skills: Azure Event Hubs, Kafka, data visualisation tools, Power BI, Tableau, Azure DevOps, Docker, Kubernetes, Jenkins.