Job Description
Join Citco's dynamic IT Operations Middleware team as a Kafka Engineer and play a pivotal role in our data infrastructure. As a Kafka Engineer, you will be responsible for the support, administration, and optimization of our Kafka Platform Service (KPS), ensuring high availability, performance, and scalability of our messaging system.
This is an excellent opportunity for a skilled professional to work with cutting-edge technologies in a fast-paced environment. You will collaborate with cross-functional teams to design, implement, and maintain robust data pipelines that drive our business forward. If you are passionate about distributed systems, message queuing, and data streaming, we invite you to apply and contribute to our innovative technology stack.
Citco offers a competitive compensation package, professional development opportunities, and a collaborative work culture that values technical excellence and innovation. Join us in shaping the future of financial technology solutions.
Responsibilities
- Support and administer the Kafka Platform Service (KPS) within the IT Operations Middleware team
- Monitor, troubleshoot, and optimize Kafka clusters for performance, reliability, and scalability
- Design, implement, and maintain robust data pipelines using Kafka and related technologies
- Collaborate with development teams to integrate Kafka with various applications and services
- Ensure high availability and disaster recovery of Kafka infrastructure
- Stay current with Kafka ecosystem developments and best practices
- Document Kafka configurations, procedures, and architecture
- Participate in on-call rotation for Kafka system support
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or related field
- 3+ years of experience with Apache Kafka and related technologies (Kafka Connect, Kafka Streams, Zookeeper)
- Strong understanding of distributed systems, messaging patterns, and data streaming concepts
- Experience with cluster management tools like Kubernetes or Docker
- Proficiency in programming languages such as Java, Python, or Scala
- Experience with monitoring and observability tools for Kafka (Prometheus, Grafana, etc.)
- Strong problem-solving skills and ability to work in a fast-paced environment
- Excellent communication and teamwork skills