Senior Kafka Engineer
Office in Hyderabad, Bangalore, Pune, Chennai, Gurgaon
Cloud Operations
& others
We are looking for a Senior Kafka Engineer to join our team and be responsible for installing, monitoring, troubleshooting, and maintaining Kafka platform, ensuring optimal performance, security, and developing new features/automation/integration.
Responsibilities
- Install and provision new Kafka clusters and supporting components.
- Regularly monitor the health and performance of the Kafka platform and data pipelines.
- Identify and fix issues related to the platform, including data pipelines, network problems, cloud or containerization resources failures, or software bugs.
- Perform regular performance tuning of Kafka platform components.
- Monitor and optimize the cost and performance of Kafka clusters.
- Upgrade the Kafka platform to newer versions, including planning, testing, and implementation.
- Manage the security of the Kafka platform, including access control lists, encryption, and regular security reviews.
- Perform regular backups and disaster recovery procedures.
- Manage the capacity of the Kafka platform, including projecting future growth and scaling needs.
- Document procedures, configurations, and issue resolutions, and share knowledge with the team.
Requirements
- Proven experience in the implementation and maintenance of Confluent Platform.
- Minimum 5 Years of experience in Kafka Administration
- Experience in Helm / Kubernetes
- Proficiency with deploying Kafka in Kubernetes
- Experience in Python Or Shell Scripting
- Excellent knowledge of Cloud : AWS /GCP (compute, networking, storage, IAM)
- B2+ English level