Hadoop Data Engineer Position
We are seeking an experienced Hadoop Data Engineer to join our team. As a Hadoop Data Engineer, you will be responsible for designing and developing batch and near-real-time data pipelines using Spark Structured Streaming, MapReduce, and other Big Data frameworks.
Key Responsibilities:
• Design, develop and maintain batch and near-real-time data pipelines.
• Ingest data from multiple sources such as message queues (Kafka), file shares, REST APIs, relational databases.
• Transform clean and validate data in HDFS Hive Impala or Spark SQL.
