Data Engineer
Posted 10 hours 19 minutes ago by Levy Associates Ltd
We are looking for a Data Engineer to join a high-impact, agile team building scalable, Real Time, and batch data integration solutions in a modern cloud environment. You'll work within a complex application landscape that processes millions of records daily and supports mission-critical use cases. Leveraging Azure-based technologies, your role will be central to enabling data-driven innovation and building secure, high-quality data solutions.
Are you a hands-on technical expert with a strong foundation in data engineering and data management? Are you passionate about solving complex challenges and driving innovation? Then this role is for you.
Key ResponsibilitiesDesign, develop, and maintain robust data pipelines and data lake solutions.
Implement Real Time and streaming integrations across multiple systems.
Perform data transformations and ensure efficient delivery to target systems.
Work with technologies such as ADLS Gen2, Databricks, Azure Functions, EventHub, and Apache Kafka.
Collaborate within an Agile/Scrum DevOps team, taking full ownership of your deliverables.
Contribute to BI/reporting solutions and provide actionable business insights.
Your Skills and Experience
- Medior to Senior level experience as Data Engineer
At least 2-3 years of experience with Big Data tools (eg, PySpark, Databricks)
Proficient in Python and SQL
Experience with cloud-based storage (eg, ADLS Gen2)
Nice to Have:
Familiarity with data management practices (retention, archiving, data quality)
Understanding of data cataloguing, metadata management, and data governance
Experience with Azure DevOps, Git, CI/CD pipelines
Knowledge of workflow automation tools (eg, Azure Data Factory, Databricks Workflows, Apache Airflow)
If you're passionate about building data solutions that matter and thrive in a collaborative environment, we'd love to hear from you.