Big Data Consultant
SINGAPORE / FULL-TIME / PERM ROLE / ON-SITE
Client: Bank
Payroll: Leading Software Services Company
Greetings!
We are looking to hire a talented big data engineer to develop and manage our client's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.
To ensure success as a big data engineer, you should have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills.
You will drive various activities of EDW Modernization including data engineering, leading a high performing data engineering team responsible for ETL / ELT Development using Teradata utilities, Hadoop Eco tools on Teradata, Big Data/Cloud platforms to meet business processes and application requirements for collecting, storing, processing, and analyzing of huge sets of data in the VCG/VBG areas of Data Warehouse & Big Data initiatives.
Requires good Experienced Big data resource who can guide, mentor, support team members and manage data processing operations using TD Utilities, Informatica, UNIX Shell Scripting, Hadoop Eco tools, Spark, XML, JSON, SQL, Python, CICD, DevOps & Cloud services (GCP) specially using BQ, Airflow etc.
Building domain SME with good Data understanding & leading the Business calls for data layers. Bringing in innovation, Industry standards, and improving existing data pipelines by simplifying and increasing performance, Query tuning for Cost optimization on BQ etc. Performing a variety of ETL/ELT development activities with adequate technical & functional skills having niche skill set like very good experience in Cloud Enablement using GCP, Hadoop tool stack, UNIX shell scripting, Python, Spark processing, Streaming tools like Storm, Kafka, nifi, CI/CD Deployment & well versed with DEVOPS concepts & tools etc.
Defining & Driving the Quality/Testing capabilities in the ETL Pipelines working with validation team, As well working with Governance team for Data Cataloguing, Classification implementation in the ETL Data Layer • Designing, building, and deploying new/existing data pipelines within Teradata, GCP or Big Data Eco-Systems with large amounts of structured and unstructured data, including integrating data from multiple sources.
Contact:
Please send your profile to priya@lionandelephants.com with the following details
• Notice Period
• Current Annual Package (including AWS/Bonus)
• Expected Annual Package
• Resident Status (Citizen / SPR / EP)
• Any offers in hand
Accepting only locals in Singapore (Citizen, PR
