Hadoop Developer

New York 22 months agoFull-time External
Negotiable
Job Title: Hadoop Developer Position Type: Full-time Location: Tysons Corner, Virginia (Day 1 Onsite) Responsibilities: · Responsible for regular communication with others involved in the development process · Implement, test, and bug-fix functionality · Responsibility for design and implementation of software projects · Provide support to end users · Design, build, and maintain efficient and reliable Data Lake solutions. · Perform data analysis independently and provide end-to-end problem resolution Required Skills: · 7+ years in data engineer role · 3+ years of experience with Hadoop/Spark/Snowflake · Design and implement high profile data ingestion pipelines from various sources using Spark and hadoop technologies · Extensive knowledge in Spark, Hive, Sqoop, Hbase and Snowflake · Experience in cloudera, CDP hadoop distribution · Experience in shell script, Scala, Python is must · Proficiency in writing complex SQL statements using Hive, SnowSQL and RDBMS standards · demonstrable Experience in designing and implementing modern data warehouse/data lake solution with understanding of best practices · Experience in troubleshooting and fixing real time production jobs in spark and Hadoop · Good to have AWS cloud knowledge and S3,IAM,EMR, etc. · Customer-focused attitude and desire to interface directly with end-user clients · Excellent verbal and written communication skills Education: • Bachelor's in computer science or in similar field