Data Engineer - PySpark - Airflow - Unix - CI/CD - Lithuania
Posted 6 hours 8 minutes ago by Empiric Solutions
Data Engineer - PySpark - Airflow - Unix - CI/CD - Lithuania
Empiric has received an exciting opportunity for an Data Engineer with good experience in PySpark, Airflow and proficiency in Unix. Docker and Kubernetes experience are also required.
The Data Engineer will troubleshoot data pipelines and address issues with Real Time, batch processing.
Plus Develop ETL process and data flows using PySpark and Airflow.
Remote and a few days in the office initially
Skills/Experience:
- PySpark & Airlow
- Unix
- Docker & Kubernetes
- CI/CD Tools: GitHub Actions
- Maintenance & troubleshooting
- Understanding & ensuring data quality, integrity, governance
Term: 6 to 18 Months plus extensions
Good day rate (B2B is fine) + Starter Bonus + Free Lunch Club experience
This is a critical position, please respond to this advert or reach out to Woody for a confidential chat and more details on rate and this terrific project.