Senior Data Engineer

Posted 8 days 23 hours ago by N Consulting Limited

Permanent
Not Specified
Other
London, United Kingdom
Job Description

Possibility of remote work: Hybrid (number of WFO days will depend on the client's needs)

Contract duration: 6 months

Location: London

JOB DETAILS

Role Title: Senior Data Engineer

Note: (Please do not submit the same profiles as for 111721-1)

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling

Minimum years of experience: 7 years

Job Description:
  • Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams.
  • Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark.
  • Must have hands-on experience with PySpark, Python, AWS, data modelling.
  • Must have experience in ETL processes.
  • Must have hands-on experience in Databricks development.
  • Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures.
  • Must have hands-on experience in SQL development.
  • Excellent communication skills & logical thinking.