BigData Engineer

Singapore 1 days agoFull-time External
Negotiable
Requirements University Graduate in Computer Science or Related discipline5-7 years of experience in developing, maintaining and supporting Enterprise Class Big Data Applications, preferably in banking environmentsExpertise in Big Data technologies/tools/platforms such as Hadoop, HDFS, Hive, Impala, HDFS, Presto, Spark, Hive, Impala, Zeppelin, Yarn, Cloudera, HortonworksExperience in Relational DatabasesKnowledge and experience in coding and performance tuning of Spark jobs. Java Spark preferred but not compulsoryEstablish and adhere to best practices relating to Apache Spark programmingResponsible for understanding functional/non-functional requirements and implement them in Apache SparkExperience in usage of CI/CD tools Jenkins, Git, BitbucketExperience in writing Linux basic Shell ScriptsKnowledge and experience in Apache Spark batch and streaming frameworkKnowledge of working with different file formats like Parquet, ORC, AVRO and JSONKnowledge of Micro Services architectureKnowledge of S3 is added advantageAbility to work proactively, independently and with cross-functional and cross-regional teamsStrong communication and analytical skills and experience in Agile projects