Job Title: Hadoop Data Engineer
Location: Chicago, IL/Denver, CO/Washington DC (Local Only No relocation - In person Interview )
Work Arrangement: Fully Onsite
Client Industry: Banking
Duration: 12 Months Contract
Day-to-Day:
• Design, develop, and maintain batch and near-real-time data pipelines using Spark Structured Streaming, MapReduce, and other Big Data frameworks.
• Ingest data from multiple sources such as message queues (Kafka), file shares, REST APIs, and relational databases.
• Transform, clean, and validate data in HDFS, Hive, Impala, or Spark SQL.
• Convert and manage data in formats like JSON, CSV, XML to support downstream analytics.
• Perform data validation, profiling, and analysis to identify anomalies and ensure data integrity.
• Troubleshoot issues in data pipelines, SQL jobs, or Spark applications, including slow-running jobs or failures.
Must Haves:
• Strong SQL Skills one or more of MySQL, HIVE, Impala, SPARK SQL
• Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
• Experience working with SPARK Structured steaming
• Experience working with Hadoop/Big Data and Distributed Systems
• Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.
• Hands on programming experience in at least one of Scala, Python, PHP,
PLUSES
• Banking or finance
• Compensation
• Hourly Rate: 60$-65$ per hour
This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications.
Benefits:
• The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)
• About Us
• At Collabera, we don t just offer jobs we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.
• Ready to Apply?
• Apply now or reach out to Pritam Palai at for more information. We look forward to speaking with you!
