Technology Lead-Kafka, Confluent cloud and Data Integration-UK

Posted 11 days 8 hours ago by Infosys Limited

Permanent
Full Time
Other
England, United Kingdom
Job Description
Role

Technology Lead - Kafka, Confluent Cloud and Data Integration - UK

Technology

Kafka, Confluent cloud and Data Integration

Location

UK

Business Unit

DNAINS

Compensation

Competitive (including bonus)

Job Description

We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus.

Your role

In the role of a Data Integration Lead, you will drive the design, implementation, and optimization of enterprise grade data integration solutions, with a strong focus on real time streaming and cloud native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event driven architectures that support high throughput, low latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to development and deployment, ensuring seamless integration between diverse data sources and targets. Your expertise will guide teams in stream processing, schema evolution, and integration with cloud platforms and enterprise data lakes. As a senior integration specialist, you will collaborate with cross functional teams to define integration strategies, enforce data governance, and ensure platform reliability and security. You will also contribute hands on to building and maintaining robust data pipelines, resolving production issues, and optimizing performance. You will participate in architecture reviews, mentor junior engineers, and promote best practices in data integration, streaming technologies, and cloud native development.

Responsibilities
  • Act as the primary technical owner for Kafka and Confluent Cloud implementations.
  • Design, configure, and maintain Kafka clusters, topics, and streaming pipelines.
  • Ensure secure, reliable, and scalable data onboarding from various sources to both on prem and cloud environments.
  • Develop and optimize SQL queries for data validation, transformation, and integration.
  • Data Engineering capabilities using any of the ETL in Fivetran/Snowflake/ADF/SSIS (any one).
  • Troubleshoot and resolve issues related to data ingestion and streaming performance.
  • Serve as the go to expert for all Kafka and Confluent related queries and solutions.
  • Collaborate with data engineering teams, architects, and business stakeholders to define onboarding strategies.
  • Provide technical guidance and best practices for event driven architectures.
  • Conduct knowledge sharing sessions and mentor team members on streaming technologies.
  • Oversee daily operations for data onboarding and streaming pipelines.
  • Implement monitoring and alerting mechanisms for proactive issue resolution.
  • Ensure compliance with data governance, security, and regulatory standards.
Required
  • 5+ years of experience in Kafka and Confluent Cloud implementations.
  • Strong proficiency in SQL for data analysis and integration.
  • Hands on experience with data onboarding in hybrid environments (on prem & cloud).
  • Excellent problem solving, communication, and stakeholder management skills.
  • Familiarity with event driven architecture and streaming best practices.
Preferred
  • Experience with Fivetran, SSIS, ADF or Snowflake technologies.
  • Knowledge of ETL processes, data warehousing, and cloud data platforms.
  • Exposure to Azure for cloud based data solutions.
Personal
  • High analytical skills
  • High customer orientation
  • High quality awareness
Why Infosys

Infosys is a global leader in next generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

Equal Opportunity Statement

All aspects of employment at Infosys are based on merit, competence and performance. We are committed to embracing diversity and creating an inclusive environment for all employees. Infosys is proud to be an equal opportunity employer.