Senior Kafka Engineer

Office in Hyderabad, Bangalore, Pune, Chennai, Gurgaon

Cloud Operations

We are looking for a Senior Kafka Engineer to join our team and be responsible for installing, monitoring, troubleshooting, and maintaining Kafka platform, ensuring optimal performance, security, and developing new features/automation/integration.

Responsibilities

Install and provision new Kafka clusters and supporting components.
Regularly monitor the health and performance of the Kafka platform and data pipelines.
Identify and fix issues related to the platform, including data pipelines, network problems, cloud or containerization resources failures, or software bugs.
Perform regular performance tuning of Kafka platform components.
Monitor and optimize the cost and performance of Kafka clusters.
Upgrade the Kafka platform to newer versions, including planning, testing, and implementation.
Manage the security of the Kafka platform, including access control lists, encryption, and regular security reviews.
Perform regular backups and disaster recovery procedures.
Manage the capacity of the Kafka platform, including projecting future growth and scaling needs.
Document procedures, configurations, and issue resolutions, and share knowledge with the team.

Requirements

Proven experience in the implementation and maintenance of Confluent Platform.
Minimum 5 Years of experience in Kafka Administration
Experience in Helm / Kubernetes
Proficiency with deploying Kafka in Kubernetes
Experience in Python Or Shell Scripting
Excellent knowledge of Cloud : AWS /GCP (compute, networking, storage, IAM)
B2+ English level