Hadoop Designer/Senior Developer- NY / NJ

New York 1 months agoFull-time External
853.6k - 1.1m / yr
Job Title : Hadoop Designer/Senior Developer Location : NY/NJ Position Type : FULL TIME Salary : DOE/W2 US Citizen, Green Card and GC EAD Preferred • *** NO Visa Sponsorship (H1B Transfer) or no Corp. to Corp no 1099 **** Job description • More than 5 years of experience with at least 3 years of good hands on experience on Hadoop components such as Hive,Pig,MapReduce,HBase • Experience on Hortonworks Hadoop platform will be preferred • Working knowledge on tools such as Pentaho will be a plus • Hands on experience in either Python or Scala with Spark • Experience is building Data Quality rules and implementing complex transformations using Hadoop stack • Data warehouse or ETL(Informatica or data Stage) background will help • Good understanding of CICD from Hadoop perspective for change management • Should be able to evaluate multiple transformation approaches along with other optimization's (file format, compression etc.)