Data Engineer

Candidates will only be considered if they have 7-10 years of Data Engineering experience , including hands-on expertise with Databricks, Hadoop, and PySpark.

Contract: 12-month rolling
Location: Dublin (Hybrid - 2-3 days onsite)

Overview
Our client, a leading global technology organisation operating across 200+ countries, is seeking an experienced Senior Data Engineer to join their expanding Data & Analytics division. This role is ideal for someone who brings deep technical skills in modern big-data ecosystems and who thrives in collaborative, cloud-driven engineering environments.

You'll be joining a high-performing team responsible for building scalable data pipelines, modernising Legacy platforms, and supporting critical data products across both on-prem Hadoop clusters and cloud-based Databricks environments.

As a Senior Data Engineer, you will:

• Build, maintain, and optimise batch and streaming pipelines using Spark (PySpark/Scala).
• Lead and support the migration of on-prem Hadoop workloads to Databricks Cloud.
• Develop and maintain ETL/ELT workflows using Hive, Impala, HDFS, Airflow and related tooling.
• Implement robust data ingestion, transformation, and quality frameworks using Delta Lake, SQL Warehouses and DLT.
• Collaborate with Senior engineers, architects, and stakeholders to design scalable, maintainable data solutions.
• Work with Git-based version control and CI/CD pipelines (Jenkins).
• Troubleshoot production issues, conduct performance tuning, and maintain documentation for data workflows.

Candidates must have:

• 7-10 years' experience as a Data Engineer in enterprise-scale environments.
• Hands-on expertise with:
  • Databricks
  • Hadoop ecosystem (HDFS, Hive, Impala)
  • PySpark/Spark
• Strong programming skills in Python or Scala.
• experience with Airflow or similar orchestration tools.
• Exposure to cloud platforms (preferably AWS-based Databricks), including S3, Delta Tables, DLT.
• Solid SQL skills and experience with large-scale distributed data processing.
• experience with Git and Jenkins for CI/CD workflows.

Job Title: Data Engineer

Location: Dublin, Ireland

Rate/Salary: .00 EUR Daily

Job Type: Contract

Trading as TEKsystems. Allegis Group Limited. Level 1, The Chase, Carmanhall Road, Sandyford, Dublin 18, Ireland. No. 909257. TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands. If you apply, your personal data will be processed as described in the Allegis Group Online Privacy Notice available at our website.

To access our Online Privacy Notice, which explains what information we may collect, use, share, and store about you, and describes your rights and choices about this, please go our website.

We are part of a global network of companies and as a result, the personal data you provide will be shared within Allegis Group and transferred and processed outside the UK, Switzerland and European Economic Area subject to the protections described in the Allegis Group Online Privacy Notice. We store personal data in the UK, EEA, Switzerland and the USA. If you would like to exercise your privacy rights, please visit the "Contacting Us" section of our Online Privacy Notice on our website for details on how to contact us. To protect your privacy and security, we may take steps to verify your identity, such as a password and user ID if there is an account associated with your request, or identifying information such as your address or date of birth, before proceeding with your request. commitments under the UK Data Protection Act, EU-U.S. Privacy Shield or the Swiss-U.S. Privacy Shield.