Databricks Solution Architect

Day Rate - £700

Working pattern - Hybrid 2-3 days onsite

Location - London / Glasgow / Cardiff

SC Security Clearance required

Role Purpose

To design, implement, and enable a secure Azure Databricks platform aligned with architecture, security standards, and operating model. The role will establish reference patterns, governance controls, and onboarding guidance to support decentralized teams.

Responsibilities

• Design and deploy Azure Databricks using secure, enterprise patterns
• Configure Databricks workspaces, clusters, and policies aligned with cost and security guardrails.
• Implement Unity Catalog including metastores, access connectors, external locations, and fine-grained RBAC recommending best practices
• Define and implement least-privilege access models for multiple teams.
• Support security and TDA assurance with architecture diagrams, control mappings, and risk mitigations.
• Define reference patterns for data ingestion, transformation, and data product creation.
• Support use cases across analytics, data engineering, and machine learning.
• Establish standards for data isolation, sharing, and lineage.
• Create onboarding playbooks and guardrails for internal teams.
• Define "how to use" and "how not to use" Databricks
• Provide knowledge transfer to internal engineers and architects.
• Work closely with Cloud Architecture, Security, CDP teams, and TDA.

Essential Skills & Experience

• Proven experience designing and delivering Azure Databricks in enterprise or public sector environments.
• Deep hands-on knowledge of Unity Catalog, Azure networking (VNets, Private Link, NSGs, UDRs), ADLS Gen2 integration and access control, Entra ID / Azure AD integration.
• Experience supporting security assurance and architecture governance.
• Strong understanding of data platform operating models and data product concepts.

Key Deliverables

• Secure Databricks platform implemented in Azure.
• Reference architecture and design documentation.
• Governance and RBAC models.
• Onboarding and operating guides.
• Final evaluation findings and adoption recommendation.