Lead Data Engineer

Data Engineer

We're supporting a leading enterprise financial services organisation in the search for an experienced Data Engineer to join a high-performing data team on an initial 6-month contract.

Contract Details:

• Inside IR35
• Initial 6-month engagement
• Sheffield-based, 3 days per week on-site

Key Requirements:

• Strong hands-on experience with PySpark and Databricks
• Deep understanding of Spark performance optimisation, including lazy evaluation, column pruning, groupBy operations, and window functions
• Proven ability to troubleshoot and resolve Spark job performance issues
• Extensive experience designing, developing, and supporting enterprise-scale data pipelines
• Strong technical depth across modern data engineering platforms, tools, and technologies
• Experience working within complex, large-scale enterprise environments

This is an excellent opportunity to contribute to a major data transformation programme within a leading financial services organisation.

Additional information available on successful application.