Pyspark developer (CTC Clearance) - 100% remote - £615 inside IR35

Pyspark developer (CTC Clearance) - 100% remote - £615 inside IR35

Exalto consulting are currently recruiting for a contract Pyspark developer this is an inside IR35 contract role paying £615 per day, 100% remote working and initial contract until end of 2025, must be CTC cleared.

Key Duties and Responsibilities

• Develop and optimise PySpark batch pipelines that process Parquet data and use Delta Lake for all IO, applying validation, enrichment, and billing calculation logic directly in PySpark code.
• Build reliable PySpark jobs that read/write Delta tables on ADLS Gen2.
• Integrate with orchestrators (ADF or Container App Orchestrator) and CI/CD pipelines (GitHub Actions)
• Operate securely within private-network Azure environments (Managed Identity, RBAC, Private Endpoints).
• PySpark with Delta Lake (structured APIs, MERGE, schema evolution).
• Solid knowledge of Azure Synapse Spark pools or Databricks, ADLS Gen2, and Azure SQL.
• Familiarity with ADF orchestration and containerised Spark workloads.

If you have the above experience and are looking for a new contract role please send your CV for immediate consideration as our client are looking for someone to hire ASAP

Pyspark developer (CTC Clearance) - 100% remote - £615 inside IR35