Azure / Databricks Platform Engineer
Posted 1 day 16 hours ago by Shareforce
Permanent
Full Time
Other
Not Specified, United Kingdom
Job Description
Location: London (2 days per week on client site) Rate: £600 per day Start Date: 01/11/25 Engagement: Outside IR35 Initial 6-month contract
We are seeking an experienced Platform Engineer to support the rollout and ongoing operation of a large-scale, federated Data and AI platform. The role will focus on building secure, scalable, and cost-optimised Azure infrastructure, implementing governance, and enabling advanced data services across multiple business domains.
Key Responsibilities- Design, build, and maintain Azure infrastructure using Terraform (IaC).
- Develop, manage, and optimise CI/CD pipelines with GitHub Actions.
- Implement secure network connectivity using Azure Private Link and Private Link Service.
- Configure and govern Databricks and Unity Catalog to ensure compliant data access and lineage.
- Enforce consistency and control through Azure Policy and compliance frameworks.
- Manage identity and access management (IAM) using OAuth, federated credentials, and RBAC principles.
- Apply Azure security best practices, including Defense in Depth, BCDR, and high availability.
- Monitor and optimise cloud cost efficiency using Azure Cost Management and FinOps practices.
- Collaborate with data, platform, and security teams to ensure a resilient, governed, and performant cloud ecosystem.
- Proven experience delivering Terraform-based Azure infrastructure.
- Strong understanding of GitHub Actions and CI/CD automation.
- Hands-on expertise with Azure Private Link and Private Link Service.
- Deep knowledge of Databricks and Unity Catalog for governance and security.
- Solid experience with Azure Policy, compliance enforcement, and resource governance.
- Background in identity and access management, OAuth, and federated authentication.
- Proven ability to design with security, resilience, and cost-optimisation in mind.
- Excellent collaboration and documentation skills within cross-functional teams.