Lead Data Engineer

Posted 22 hours 40 minutes ago by Cavendish Professionals

Permanent
Full Time
Factory Jobs
Madrid, Spain
Job Description

Our client is looking for a remote Lead Data Engineer on a full-time, freelance basis


Qualifications

  • Advanced Python knowledge and software engineering skills.
  • Proven experience with Spark and SQL for data engineering and analysis.
  • Experience with Databricks for data ingestion and transformation.
  • Hands-on experience with one or more cloud services (Azure - must, AWS, GCP).
  • Experience with Azure Data Factory, Azure Cosmos DB, Azure functions, Event store, ADLS, Key Vault.
  • Proficiency in RDBMS/NoSQL data stores and appropriate use cases.
  • Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, familiarity with containerization tools such as Docker (must have) and Kubernetes (plus).
  • Solid understanding of the software development life cycle.
  • Strong communication, interpersonal and presentation skills.
  • Experience leading teams.