Seasoned data professional with demonstrated ability to approach data challenges holistically and practically, in line with the strategic needs of a digital bank.
- Proven track record in constructing robust Big Data pipelines capable of real-time processing, instrumental in delivering instant banking services and real-time analytics.
- Hands-on experience with Spark, Spark Streaming, and Spark optimizations, capable of managing large-scale, high-speed data processing tasks crucial in digital banking.
- Proficient with Hive, Impala Kudu, HBase, and Phoenix, experienced in managing substantial databases typical in the banking sector.
- Skilled in using orchestration tools like Oozie & Airflow, capable of managing complex workflows integral to automated banking processes.
- Experienced Kafka developer, adept at using Kafka Connect, Schema Registry, and Kafka Stream for handling high-volume, real-time messaging crucial for digital banking services.
- Proficient with Apache Nifi and Nifi Registry, experienced in managing complex data flows vital for real-time banking operations.
- Minimum 5 years experience in Big Data
- Experience in below technologies:
- Kudu
- Kafka
- HBase
- Cloudera
- PySpark
This job has been sourced from an external job board.
