Job Title: Hadoop Data Engineer
Location: Chicago, IL/Denver, CO/Washington DC (Local Only No relocation - In person Interview )
Work Arrangement: Fully Onsite
Client Industry: Banking
Duration: 12 Months Contract
Day-to-Day:
Design, develop, and maintain batch and near-real-time data pipelines using Spark Structured Streaming, MapReduce, and other Big Data frameworks.
Ingest data from multiple sources such as message queues (Kafka), file shares, REST APIs, and relational databases.
Transform, clean, and validate data in HDFS, Hive, Impala, or Spark SQL.
Convert and manage data in formats like JSON, CSV, XML to support downstream analytics.
Perform data validation, profiling, and analysis to identify anomalies and ensure data integrity.
Troubleshoot issues in data pipelines, SQL jobs, or Spark applications, including slow-running jobs or failures.
Must Haves:
Strong SQL Skills one or more of MySQL, HIVE, Impala, SPARK SQL
Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
Experience working with SPARK Structured steaming
Experience working with Hadoop/Big Data and Distributed Systems
Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.
Hands on programming experience in at least one of Scala, Python, PHP,
PLUSES
Banking or finance
Compensation
Hourly Rate: 60$-65$ per hour
This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications.
Benefits:
The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)
About Us
At Collabera, we don t just offer jobs we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.
Ready to Apply?
Apply now or reach out to Pritam Palai at for more information. We look forward to speaking with you!
