Data Engineer - Big Data

Singapore 7 months agoContractor External
32.8k - 49.1k / mo
Responsibilities · Responsible for developing and enhancing data pipelines and system architecture · Create and maintain the optimal data pipeline to enable ingestion from a wide variety of structured and unstructured data sources via Talend · Define and understand business requirements to develop and implement solutions · Support development and deployment of applications utilising the data pipelines to provide actionable insights · Involve in UAT execution with a focus on strategic testing processes and procedures to ensure that business standards and specifications are met · Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery and cleansing/transformation · Collaborate with multiple stakeholders independently to drive key initiatives/ projects · Skills/Requirement · Minimum 5 years of working experience in Data Engineering, Big Data solutions, and analytics functions · Strong background in traditional structured database environments such as Teradata / Oracle, SQL & PL/SQL. · Fluent in the management of structured and unstructured data, as well as modern data transformation methodologies and tools like DBT. · Proficient in Hadoop ecosystem components (e.g., HIVE, Impala, HDFS, Spark, Scala, HBase) · Hands-on experience working on real-time data and streaming applications using Kafka or other similar tools · Hands-on experience in automation process – building procedures, ETL and automated job scheduling using data integration tool such as Talend · Experience in risk management and project management will be advantageous Interested candidates, who wish to apply for the above position, please send in your resume to: kellyitsg@persolkelly.com PERSOLKELLY Singapore Pte Ltd EA License No. 01C4394 EA Reg No: R23118975 (ABDUL RAHMAN ANSARI RAJA) We regret to inform you that only shortlisted candidates will be contacted. • ********************************* This is in partnership with Employment and Employability Institute Pte Ltd (“e2i”). e2i is the empowering network for workers and employers seeking employment and employability solutions. e2i serves as a bridge between workers and employers, connecting with workers to offer job security through job-matching, career guidance and skills upgrading services, and partnering employers to address their manpower needs through recruitment, training, and job redesign solutions. e2i is a tripartite initiative of the National Trades Union Congress set up to support nation-wide manpower and skills upgrading initiatives. By applying for this role, you consent to e2i’s PDPA. By sending us your personal data and curriculum vitae (CV), you are deemed to consent to PERSOLKELLY Singapore Pte Ltd and its affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy available at https://www.persolkelly.com.sg/policies. You acknowledge that you have read, understood, and agree with the Privacy Policy. • *********************************