SC Cleared Databricks Architect | Remote
Posted 36 minutes 45 seconds ago by SR2 - Socially Responsible Recruitment
SC Cleared Databricks Architect | Remote
SR2 is supporting a major public sector data transformation programme seeking experienced Databricks Architects. We're interested in architects with strengths in platform design, data product architecture, or both.
The Role
You'll help shape an enterprise Databricks environment on AWS, supporting secure platform foundations and trusted, reusable data products. Working with engineering, governance and business teams, you'll define architecture that enables teams to discover, access and use data effectively.
Your focus will reflect your expertise, spanning platform infrastructure and integration through to data modelling, product standards and self-service analytics.
Key Responsibilities
Define architecture, reference designs and reusable patterns for Databricks platforms and data products.
Shape AWS platform foundations, integration approaches and processing patterns for batch and streaming workloads.
Establish standards for data modelling, data contracts, metadata, quality and product lifecycle management.
Design governance and access controls through Unity Catalog, supporting discovery, lineage and secure data sharing.
Guide performance, reliability and cost decisions across platform services and data workloads.
Lead design reviews and stakeholder workshops, providing technical assurance and direction to delivery teams.
Essential
Strong architecture experience delivering enterprise Databricks and Lakehouse solutions.
Expertise in Delta Lake, Unity Catalog and modern data engineering patterns.
Experience integrating Databricks with AWS, including relevant storage, identity and networking services.
A strong background in either:
Platform architecture: AWS infrastructure, medallion architecture, compute, orchestration, Terraform and deployment automation.
Data product architecture: reusable data products, data contracts, modelling, metadata, governance and self-service consumption.
Understanding of security, access management and governance within complex organisations.
Ability to communicate architecture decisions clearly and guide multidisciplinary teams.
SC clearance required.
Desirable
Knowledge of Spark, dbt, Databricks SQL or Workflows.
Experience applying data mesh principles and enabling governed data sharing.
Relevant Databricks, AWS, Terraform or data management certifications.
The Details
Contract role: 6-month rolling contract
IR35 Status: Inside IR35
Rate: £600-£650
Location: Mainly remote - ad hoc visits in London.
Clearance: SC required
If you are a Databricks Architect with platform or data product expertise and this looks of interest, please apply for immediate consideration.