Azure Data Engineer Netherlands

Job Location: Amsterdam, Netherlands

Experience (Years): 12+ years

Pay Rate - TBN

Start Date - ASAP

6 Months Contract - Renewable

Key Responsibilities:

• Design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks.
• Build and optimize large-scale data processing solutions using PySpark and Databricks.
• Develop, test, and maintain robust data solutions in Python for data extraction, transformation, and loading (ETL) processes.
• Implement CI/CD pipelines in Azure DevOps for automated testing, integration, and deployment of data solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Collaborate with cross-functional teams to understand data requirements and deliver efficient data solutions.
• Ensure data security and compliance with company standards and best practices.
• Stay updated with the latest trends and best practices in cloud data engineering and Azure services.

Required Skills and Qualifications:

• MS DP-203 certification is mandatory.
• Experience with Azure Data Factory for orchestrating and automating data movement and transformation.
• Proficiency in Azure Databricks for building and managing scalable data processing frameworks.
• Strong programming skills in Python and experience working with PySpark for big data processing.
• Familiarity with SQL for querying and managing large datasets.
• Knowledge of Azure DevOps and experience with CI/CD pipeline implementation.
• Strong problem-solving skills and the ability to work independently or as part of a team.
• Excellent communication and documentation skills.