Kafka & Kubernetes Engineer

Job Description

Responsibilities

. To work on the Integration platform using Kubernetes and Kafka

. To understand the interface requirements and develop those requirements into design and development

. Designing and implementing new CRDs, as well as developing corresponding controllers to manage them effectively

. To manage Kafka infrastructure and deployments with scripting and automation skills.

Skills Requirement

. Bachelors degree in Engineering/Information Technology/Computer Science or related field

. In-depth knowledge of Apache Kafka architecture, including topics, brokers, producers, and consumers.

. Proficiency in Kafka APIs, such as Producer and Consumer API, Kafka Streams API, and Kafka Connect API.

. Strong skills in one of languages such as Java OR Python for developing Kafka applications.

. Familiarity with scripting languages like Bash, PowerShell for automation tasks.

. Possesses in-depth knowledge of Kubernetes, including:

. Understanding of operators and providers

. Experience in container management

. Ability to handle component upgrades

. Skilled in debugging resources and managed objects

. Proficient in Custom Resource Definitions (CRDs)

. Capable of designing and implementing new CRDs, as well as developing corresponding controllers to manage them effectively.

. Experience with any one of API Gateway technologies (e.g., Kong, Apigee, gravitee) for managing and securing APIs.

. Understanding of DevOps practices, including CI/CD pipelines for automating testing and deployment processes.

. Strong understanding of distributed systems concepts, including replication, partitioning, and fault tolerance.

. Familiarity with monitoring tools (e.g., Grafana, Kafka Manager) and logging frameworks to ensure system performance and reliability.

. Excellent verbal and written communication skills to collaborate effectively with team members and stakeholders.

. Strong analytical and troubleshooting skills to quickly identify and resolve issues within Kafka-based systems.

. Ability to document processes, configurations, and findings clearly for future reference and knowledge sharing.

EA Number: 11C4879