Azure data bricks engineer (platform engineer)

Posted 5 hours 16 minutes ago by Collab Group

Permanent
Not Specified
Other
Noord-Holland, Amsterdam, Netherlands
Job Description

We are looking for an experienced Platform Engineer with strong expertise in Databricks and the Microsoft Azure ecosystem . In this permanent role, you will build and maintain a scalable Databricks platform for Reporting & Analytics, focusing on CI/CD pipelines, Lakeflow processes, and data integrations.

You will collaborate closely with data engineers, BI analysts, and architects to ensure a secure, standardized, and high-performing data platform. This role requires 2-3 days per week on-site .

Key Responsibilities

  • Develop metadata-driven CI/CD pipelines in Databricks
  • Implement Lakeflow and medallion architecture
  • Manage Azure components (Key Vault, ADLS Gen2, AAD)
  • Integrate data via APIs
  • Deploy using Databricks Asset Bundles (DABs)
  • Monitor and optimize cluster performance
  • Manage reporting integrations (Power BI/Fabric) and publishing to the Lakehouse
  • Contribute to documentation and knowledge sharing

What You Bring

  • 5+ years as a Platform Engineer or Data Engineer within Azure
  • Strong programming skills in Python and PySpark
  • Hands-on experience with Databricks (Unity Catalog, Lakeflow, DABs)
  • Experience with testing, version control, and Azure DevOps
  • Relevant certifications (e.g., DP-203, Databricks Associate/Professional)
  • Strong analytical and problem-solving skills

What We Offer

  • Competitive salary and excellent benefits
  • Opportunities for continuous learning and development
  • Hybrid working model with 2-3 days in the office