Azure Databricks Engineer

Posted 22 hours 50 minutes ago by IO Associates

Permanent
Not Specified
Other
Lancashire, Manchester, United Kingdom, M21 0
Job Description


Data Engineer- Outside Ir35 - £500 daily rate- Manchester - 6 Month

Role Overview:
We're seeking an experienced Contract Data Engineer with a strong background in Databricks and cloud data platforms to support a high-impact data transformation programme. This hybrid role requires 2 days per week onsite in our Manchester office (non-negotiable), with the remainder remote.

You'll join a fast-paced, delivery-focused data team responsible for building and optimising scalable, production-grade data pipelines and infrastructure.

Key Responsibilities:

  • Design and implement robust, scalable ETL/ELT pipelines using Databricks and Apache Spark
  • Ingest, transform, and manage large volumes of data from diverse sources
  • Collaborate with analysts, data scientists, and business stakeholders to deliver clean, accessible datasets
  • Ensure high performance and reliability of data pipelines and warehouse structures
  • Apply data governance, security, and quality best practices
  • Work with cloud-native tools and services (preferably Azure)

Required Skills & Experience:

  • Proven experience as a Data Engineer on cloud-based projects
  • Strong hands-on skills with Databricks, Apache Spark, and Python or Scala
  • Proficient in SQL and working with large-scale data environments
  • Experience with Delta Lake, Azure Data Lake, or similar technologies
  • Familiarity with version control, CI/CD, and infrastructure-as-code tools
  • Ability to deliver independently in a contractor capacity and meet tight deadlines


Data Engineer- Outside Ir35 - rate £500 day rate- Manchester - 6 Month