Data Engineer (Databricks and AWS)

Job Description (Data Engineer - Databricks & AWS)

At CGI, we're helping to transform the future of healthcare through the power of data. As a Senior Data Engineer, you'll play a pivotal role in designing, building, and optimising data platforms that underpin critical national services. Working at the heart of our Healthcare team, you'll use your expertise in AWS, Databricks, and Python to deliver high impact solutions that improve outcomes, enhance decision making, and drive innovation across the sector.

CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK 'Best Employer' by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner, not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent, inspiring everyone to pursue careers in our sector-including our Armed Forces-and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant.

Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This is a hybrid position based in Leeds.

Key Responsibilities

• Design & Build: Develop and optimise data pipelines using Databricks, Apache Spark, and Python.
• Develop & Deliver: Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services.
• Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability.
• Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data solutions.
• Secure & Govern: Ensure compliance with data governance, NHS standards, and security frameworks.
• Innovate & Improve: Drive continuous improvement across data engineering practices and technologies.

Required Qualifications

• Hands on commercial expertise with Databricks.
• Proven experience as a Data Engineer working with large, complex datasets.
• Hands on expertise with Apache Spark and SQL.
• Strong proficiency in Python (PySpark preferred).
• Experience with AWS cloud services including S3, Glue, Lambda, IAM.
• Familiarity with ETL design, data modelling, and data lake/lakehouse concepts.
• Understanding of data governance and compliance frameworks.
• Experience in the healthcare sector or knowledge of NHS data standards (advantageous).

Additional Information

Together, as owners, let's turn meaningful insights into action.

Skills

• Apache Spark
• ETL
• Python
• Data Modeling

Reference Click here to apply