Elastic Stack (ELK) with Hadoop - W2 Only - Atlanta,GA (or) Remote
Role : ELK Stack with Hadoop Admin
Location : Atlanta,GA / Remote
Client : Morgan Stanley
Job Type : Contract
Skills Required:
1. Expert in setting up Elasticsearch cluster from scratch and server maintenance.
2. Expert in setting up Hadoop cluster from scratch and server maintenance.
3. 7+ years of experience with ELK Stack and Hadoop: Elasticsearch, Logstash, Kibana, Apache Hadoop
4. Able to create and debug complex Unix shell scripts.
5. Decommissioning and Recommissioning servers.
6. Analyzing and troubleshooting the issues with the clusters.
7. Evaluate existing Elastic clusters, configuration parameters, indexing, security, and administration.
8. Set up and maintain appropriate infrastructure to maintain performance and data integrity.
9. Elasticsearch upgrade experience and following best practices.
10. Ensuring appropriate monitoring & alerting of Elasticsearch cluster.
11. Expert in networking and security settings to support network related pipelines.
12. Good to have Ruby and/or Python, Unix and GIT Knowledge.
13. Deploying and maintaining a Hadoop cluster
14. Commissioning and decommissioning of the nodes to/from the Hadoop cluster.
15. Implementing, managing, and administering the overall Hadoop infrastructure
16. Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
17. Monitoring the Hadoop cluster connectivity and performance of the cluster for application teams.
18. Replicating huge amount data from one Hadoop cluster to another.
19. Applying encryption to secure the data in the Hadoop cluster.
20. Applying the configuration changes and testing the cluster.
21. Sound knowledge of Hadoop services – HDFS, Hive , HBase , Impala , Hue , Ranger etc.
22. Experience with Cloudera CDP Hadoop upgrade will be good to have.
Soft Skills:
1. Good verbal and written communication skills.
2. Good analytical and problem-solving skills.
3. Good team player.
Email : christian.florantine@concenttech.com
