Data Engineer (Databricks) Data Engineering LATAM

PROJECT OVERVIEW

Our client is developing and maintaining a next-generation platform for both customers and internal users in the Logistics and Transportation Industry.

IN THIS ROLE, YOU WILL

Good knowledge and hands on experience with the modern data stack, including:

• Ingestion: Autoloader, Kafka;
  
• Storage: ADLS;
  
• Data transformation: PySpark, Structured Streaming;
  
• Workflow orchestration: Databricks Workflows;
  
• Data import/export using queues: Kafka in Azure EventHub;
  
• Data governance, data catalog, data quality: Unity Catalog with RBAC, Great Expectations.

IF YOU ARE

• Solid understanding of distributed data processing with Spark;
• Experience with Structured Streaming, Autoloader, UDFs, pandas, etc.;
• Experience with Databricks Live Tables;
• Experience with Databricks Asset Bundles;
• Experience with Kafka / Azure EventHub;
• Proficiency in Python;
• Strong knowledge of SQL.

AS AN OPINOV8R, YOU WILL HAVE

• Digital-First Approach: Great talent knows no borders! You can work from wherever you are - we hire and collaborate with professionals worldwide.
• Remote Work Model: Balance your professional and personal life with our flexible working conditions, empowering you to deliver your best from anywhere.
• Exciting Projects: Dive into impactful projects across industries that challenge and spark creativity.
• Boost Your Expertise: Grow your career with continuous learning, development opportunities, and hands on experience.
• Join the Best Team Ever: Collaborate with our diverse and cross cultural team of passionate technologists and creative thinkers.

HOW'S THE HIRING PROCESS GOING

We strive to make our hiring process smooth and transparent to find the perfect match for both sides. Steps may differ depending on the role, but here's what to expect:

• Initial Interview: If your background fits the role, we'll invite you for an interview with a Talent Acquisition Specialist.
• Technical Interview: Depending on the position, you may complete a technical assessment or test task.
• Final Decision:After all steps, we'll get back to you with the result and next steps.