Cliecon Solutions Inc, (head quartered in central NJ ) is one of the fastest growing and a leading consulting and management firm with 12 years of experience in Staff Augmentation. We handle complete recruiting cycle for fortune 500 clients, major implementing partners and tier -1 vendors. We specialized in recruiting for Application development, Big data, Databases, Infrastructure, Cloud, Mobile and ERP based solutions projects.
Role: Hadoop Administrator with NIFI
Location: Remote
Duration: Long Term Contract
Job Description:
We are looking for a talented Hadoop Administrator with specialized knowledge in NiFi to manage and optimize our Hadoop ecosystem. In this role, you will play a pivotal role in ensuring the availability, scalability, and performance of our big data infrastructure, while leveraging NiFi to streamline data flow and processing.
Key Responsibilities:
• Design, deploy, and maintain Hadoop clusters, ensuring optimal performance, scalability, and high availability.
• Manage and troubleshoot issues related to Hadoop ecosystem components, including HDFS, YARN, Hive, HBase, Spark, and NiFi.
• Collaborate with data engineers and data scientists to optimize data pipelines, data ingestion, and data processing workflows using NiFi.
• Monitor and analyze cluster health, capacity, and performance, and take proactive measures to prevent and resolve potential bottlenecks or failures.
• Implement security best practices to safeguard data stored and processed within the Hadoop environment.
• Automate deployment, configuration, and management tasks using tools such as Ansible, Chef, or Puppet.
• Work closely with cross-functional teams to design and implement data integration and transformation processes using NiFi.
• Develop and maintain documentation for installation, configuration, and troubleshooting procedures.
• Participate in on-call rotation for critical incident response and resolution.
Qualifications:
• Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent work experience).
• Proven experience as a Hadoop Administrator with hands-on experience managing Hadoop clusters in production environments.
• Expertise in NiFi, including designing and configuring complex data flows, processors, and integrations.
• Strong understanding of Hadoop ecosystem components, architecture, and best practices.
• Proficiency in scripting and automation (Bash, Python, etc.) for managing and maintaining Hadoop clusters.
• Experience with cloud platforms (e.g., AWS, Google Cloud Platform, Azure) and their Hadoop-related services is a plus.
• Familiarity with data warehousing concepts and tools (e.g., Hive, HBase) for data storage and querying.
• Excellent problem-solving skills and ability to diagnose and resolve complex technical issues.
• Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams.
• Relevant certifications such as Cloudera Certified Administrator (CCA) or Hortonworks Certified Administrator (HCA) are a plus.
Hadoop Administrator with NIFI - Remote
