Dice is the leading career destination for tech experts at every stage of their careers. Our client, Rivago infotech inc, is seeking the following. Apply via Dice today!
• Role: Data Engineer with streaming or flink exp
• Location: MTV/San Diego CA (100% Onsite)
Must have:
• Expertise in Apache Flink or streaming exp
• Strong programming skills in Java
• Knowledge of stream processing and batch processing
• Experience working with Apache Kafka.
• Proven experience with projects in Apache Flink production Java or Scala
• Knowledge of relational databases.
• Knowledge of MPP like AWS Athena
• Knowledge of HIVE
• Experience of AWS cloud services
What You'll Do:
• Work on writing new data pipelines.
• Debug and optimize existing data pipelines.
• Analyze pipelines consuming high resources or having high execution time and optimize as needed
• Implementation for automating pipeline management and metrics setup for observability
• Gather requirements, work on high level design, implement (code) and deliver efficient and scalable DW solutions in high data growth environment
• Oversee team activities related to coding, unit testing, system testing, resolve defect originating during system test and deploy the fixes for the defects when needed
Good to Have
• Familiarity with big data technologies like Spark, Hive
• Familiarity with CI/CD and basic dev ops.
• Familiarity with shell scripting
