Title: Hadoop Developer
Location: Remote(Must work for PST
Duration: Long Term
Employment Type: Contract to Hire
TECHNICAL KNOWLEDGE AND SKILLS:
• Strong project experience in Big Data, Cloudera Distribution x, Cloud migration. RDBMS is a must.
• Strong project experience with Amazon EMR/Databricks/Cloudera CDP is
• 4-5 years of programming experience in Python, Java and Scala is a must.
• Hands-on experience building data pipelines using Hadoop components Hive, Som, MR, Impala, Spark. Spark SQL., HBase, NIFi.
• Strong experience working in Real-Time analytics like Spark/Kafka/Storm
• Micro Services/Web service development experience using Spring
• Strong experience with REST API development using Python frameworks (Django, Flask )
• Experience with Jenkins, JIRA
• Expertise in Unix/Linux environment in writing scripts and schedule/execute
• Provide more in-depth analysis with a high-level view of goals and end
• Complete work within a reasonable time frame under the supervision of a manager or
team lead.· Plan and manage all aspects of the support function.· Extensive knowledge of and proven experience with data processing systems, and methods of developing, testing, and moving solutions to implementation.· Strong knowledge of project management practices and ability to document processes.and procedures as needed.· Work collaboratively with other support team members and independently on assigned tasks and deliverables with minimum supervision.
• Communicate effectively with users at all levels, from data entry technicians up to senior management, verbally and in
• Self-motivated, working closely and actively communicating with team members to accomplish time critical tasks and
• Ask questions and share information gained with other support team members, recording, and documenting this
• Elicit and gather user requirements and/or problem description information and record this information
• Listen carefully and act upon user
• Convey and explain complex problems and solutions in an understandable language to
· both technical and non-technical persons
• Present technical solutions to management and decision makers
• Follow the lead of others on assigned projects as well as take the lead when
· appropriate
• Think creatively and critically, analyzing complex problems, weighing multiple solutions, and carefully selecting solutions appropriate to the business needs, project scope, and available
• Take responsibility for the integrity of the
