Leave us your email address and we'll send you all the new jobs according to your preferences.
DevOps Engineer - Kafka Services
Posted 2 hours 52 minutes ago by Consol Partners
Contract
Not Specified
Other
Luxembourg, Luxembourg
Job Description
Job Title: DevOps Engineer - Kafka
Duration: 12months + Contract (Possible Extensions)
Location: Luxembourg (Onsite)
Role Overview:
- We are looking for a highly skilled DevOps Engineer to take ownership of the Kafka service within our IT ecosystem.
- The ideal candidate will be responsible for implementing and maintaining Kafka infrastructure to ensure high availability, scalability, and performance.
- This role requires deep expertise in Apache Kafka, strong automation skills, and experience managing distributed data streaming platforms in a complex enterprise environment
Key Accountabilities:
- Kafka Administration & Operations: Deploy, configure, monitor, and maintain Kafka clusters in a high-availability production environment.
- Performance Optimization: Tune Kafka configurations, partitions, replication, and producers/consumers to ensure efficient message streaming.
- Infrastructure as Code (IaC): Automate Kafka infrastructure deployment and management using Terraform, Ansible, or similar tools.
- Monitoring & Incident Management: Implement robust monitoring solutions (eg, Dynatrace) and troubleshoot performance bottlenecks, latency issues, and failures.
- Security & Compliance: Ensure secure data transmission, access control, and compliance with security best practices (SSL/TLS, RBAC, Kerberos).
- CI/CD & Automation: Integrate Kafka with CI/CD pipelines and automate deployment processes to improve efficiency and reliability.
- Capacity Planning & Scalability: Analyze workloads and plan for horizontal scaling, resource optimization, and failover strategies.
- Collaboration: Work closely with development teams to support Kafka-based applications and ensure seamless data flow.
- Training and technical support to end users and other stakeholders.
- Writing/Updating procedure.
- To contribute to the knowledge base.
- Work together as a team.
Essential Skills:
- 5+ years of experience in DevOps, Site Reliability Engineering (SRE), or Kafka administration.
- Strong hands-on experience with Apache Kafka (setup, tuning, and troubleshooting).
- Proficiency in Scripting (Python, Bash) and automation tools (Terraform, Ansible).
- Experience with cloud environments (AWS, Azure, or GCP) and Kubernetes-based Kafka deployments.
- Familiarity with Kafka Connect, KSQL, Schema Registry, and Zookeeper.
- Knowledge of logging and monitoring tools (Dynatrace, ELK, Splunk).
- Understanding of networking, security, and access control for Kafka clusters.
- Experience with CI/CD tools (Jenkins, GitLab, Argo CD).
- Ability to analyze logs, debug issues, and propose proactive improvements.
- Excellent problem-solving and communication skills.
- An ITIL qualification is an asset.
- Strong communication skills (oral/written) to interact effectively and professionally with both internal and external customers.
- Ability to work in an international/multicultural environment.
- Ability to work both independently and with other team members.
- EU citizenship.
- You can work in shifts (7 AM - 8 PM) and provide 24/7 support.
Preferred Skills:
- Experience with Confluent Kafka or other managed Kafka solutions.
- Knowledge of event-driven architectures and stream processing (Flink, Spark, Kafka Streams).
- Experience with service mesh technologies (Istio, Linkerd) for Kafka networking.
- Certifications in Kafka, Kubernetes, or cloud platforms.
Consol Partners
Related Jobs
Flink: Meal & Grocery Delivery Driver (Bike)
- Overijssel, Deventer, Netherlands, 7411 AA
Part-Time Bike Courier for Meal Delivery at Flink
- Noord-Holland, Zaandam, Netherlands, 1501 AA
Bike courier English speaking
- Zuid-Holland, Rotterdam, Netherlands
Flink: Meal & Grocery Delivery Driver (Bike/Scooter)
- Noord-Brabant, Tilburg, Netherlands, 5011 AA
Bike/ Scooter Courier and Meal Delivery Driver at Flink
- Gelderland, Nijmegen, Netherlands, 6511 AA