Azure data bricks engineer (platform engineer)
Posted 5 hours 16 minutes ago by Collab Group
Permanent
Not Specified
Other
Noord-Holland, Amsterdam, Netherlands
Job Description
We are looking for an experienced Platform Engineer with strong expertise in Databricks and the Microsoft Azure ecosystem . In this permanent role, you will build and maintain a scalable Databricks platform for Reporting & Analytics, focusing on CI/CD pipelines, Lakeflow processes, and data integrations.
You will collaborate closely with data engineers, BI analysts, and architects to ensure a secure, standardized, and high-performing data platform. This role requires 2-3 days per week on-site .
Key Responsibilities
- Develop metadata-driven CI/CD pipelines in Databricks
- Implement Lakeflow and medallion architecture
- Manage Azure components (Key Vault, ADLS Gen2, AAD)
- Integrate data via APIs
- Deploy using Databricks Asset Bundles (DABs)
- Monitor and optimize cluster performance
- Manage reporting integrations (Power BI/Fabric) and publishing to the Lakehouse
- Contribute to documentation and knowledge sharing
What You Bring
- 5+ years as a Platform Engineer or Data Engineer within Azure
- Strong programming skills in Python and PySpark
- Hands-on experience with Databricks (Unity Catalog, Lakeflow, DABs)
- Experience with testing, version control, and Azure DevOps
- Relevant certifications (e.g., DP-203, Databricks Associate/Professional)
- Strong analytical and problem-solving skills
What We Offer
- Competitive salary and excellent benefits
- Opportunities for continuous learning and development
- Hybrid working model with 2-3 days in the office