backGo to search

Senior Kafka Engineer

Office in Hyderabad, Bangalore, Pune, Chennai, Gurgaon
bullets
Cloud Operations
& others
bullets
hot

We are looking for a Senior Kafka Engineer to join our team and be responsible for installing, monitoring, troubleshooting, and maintaining Kafka platform, ensuring optimal performance, security, and developing new features/automation/integration.

Responsibilities
  • Install and provision new Kafka clusters and supporting components.
  • Regularly monitor the health and performance of the Kafka platform and data pipelines.
  • Identify and fix issues related to the platform, including data pipelines, network problems, cloud or containerization resources failures, or software bugs.
  • Perform regular performance tuning of Kafka platform components.
  • Monitor and optimize the cost and performance of Kafka clusters.
  • Upgrade the Kafka platform to newer versions, including planning, testing, and implementation.
  • Manage the security of the Kafka platform, including access control lists, encryption, and regular security reviews.
  • Perform regular backups and disaster recovery procedures.
  • Manage the capacity of the Kafka platform, including projecting future growth and scaling needs.
  • Document procedures, configurations, and issue resolutions, and share knowledge with the team.
Requirements
  • Proven experience in the implementation and maintenance of Confluent Platform.
  • Minimum 5 Years of experience in Kafka Administration
  • Experience in Helm / Kubernetes
  • Proficiency with deploying Kafka in Kubernetes
  • Experience in Python Or Shell Scripting
  • Excellent knowledge of Cloud : AWS /GCP (compute, networking, storage, IAM)
  • B2+ English level