Our client, one of Asia-Pacific’s leading organizations is looking for:
Kafka Developer
Responsibilities
• Design and implement Kafka Streams and KSQL-based transformations for real-time data processing.
• Develop and maintain CDC pipelines using Kafka Connect, Debezium, or custom connectors.
• Handle initial data loads from large relational datasets via manual exports and ensure seamless transition to incremental CDC.
• Work with complex relational schemas, including:
• Tables without primary keys
• Tables with/without constraints
• Optimize data ingestion and transformation pipelines for performance, reliability, and scalability.
• Collaborate with data architects, DBAs, and application teams to ensure data integrity and consistency.
• Document technical designs, data flow diagrams, and operational procedures.
• Communicate effectively with cross-functional teams and stakeholders.
Requirements
• Strong hands-on experience with Apache Kafka, Kafka Streams, and KSQL.
• Proficiency in Kafka Connect and CDC tools (Debezium, Confluent).
• Deep understanding of Oracle, MS SQL Server, and PostgreSQL internals and schema design.
• Experience handling non-standard table structures and resolving challenges in CDC replication.
• Familiarity with manual data export/import strategies and their integration into streaming pipelines.
• Strong knowledge of data serialization formats (Avro, JSON, Protobuf).
• Experience in Java or Scala for custom Kafka development.
-----------------------------------------------------------------------------------------------------
Interested applicants can also email CV at vimmi@nsearchglobal.com (for faster processing, please state the exact job/position title applied “Kafka Developer”)
Only shortlisted candidates will be notified.
-----------------------------------------------------------------------------------------------------
EA License Number: 10C3636
EA Personnel Name: Vimmi Baunthiyal
EA Personnel Registration Number: R1543982
