Kafka Admin

We are seeking a skilled and motivated Kafka Administrator to manage, maintain, and optimize our Apache Kafka clusters. The ideal candidate will have hands-on experience in deploying, configuring, and monitoring Kafka environments, ensuring high availability, reliability, and performance of data streaming systems. You will collaborate with development, DevOps, and infrastructure teams to support real-time data pipelines and streaming applications.

Install, configure, and manage Apache Kafka clusters in production and non-production environments
Monitor Kafka cluster health, performance, and capacity using tools such as Prometheus, Grafana, or similar
Perform cluster tuning and optimization to ensure high throughput and low latency
Manage Kafka topics, partitions, brokers, replication, and retention policies
Implement and maintain data security, including authentication (SASL), authorization (ACLs), and encryption (SSL/TLS)
Troubleshoot and resolve Kafka-related issues, including broker failures, consumer lag, and data inconsistencies
Automate routine tasks using scripting (Shell, Python, etc.) and configuration management tools
Work closely with development teams to design scalable and fault-tolerant data streaming solutions
Perform upgrades, patching, and maintenance with minimal downtime
Ensure backup and disaster recovery mechanisms for Kafka clusters
Maintain documentation for configurations, processes, and troubleshooting guides

2–5 years of experience working with Apache Kafka administration/support
Strong understanding of distributed systems and messaging architectures
Hands-on experience with Kafka ecosystem tools (Zookeeper/KRaft, Kafka Connect, Kafka Streams)
Experience with monitoring tools such as Prometheus, Grafana, or ELK stack
Knowledge of Linux/Unix systems administration
Familiarity with cloud platforms like AWS, Azure, or GCP
Experience with containerization and orchestration tools (Docker, Kubernetes) is a plus
Understanding of data pipelines, ETL processes, and streaming concepts
Strong troubleshooting and analytical skills
Good scripting knowledge (Bash, Python, or similar)

Bachelor’s degree in Computer Science, Information Technology, or a related field

Education: Bachelor of Engineering

Preferred skills: Technology->Java->Apache->Kafka