**Job Summary**:
• *Salary**
S$10,000 - S$20,000 / Monthly
• *Job Type**
• *Seniority**
Senior
• *Years of Experience**
At least 5 years
• *Tech Stacks**
Dataiku Pandas Apache Databricks Spark NoSQL SQL Scala Python
• *_
Responsibilities_**
You will design, develop, test, modify, deploy, and document solutions and services in both local and cloud-based deployments of our Big Data infrastructure. Create solutions using current programming languages and tools and interact with team members, customers, and partners to define requirements. Collaborate with stakeholders and data scientists to analyze, extract, and report meaningful insights from data collected.
A senior data engineer:
- Provides core contributions to multiple products, projects, solutions and processes through all stages of the development lifecycle including but not limited to design, analysis, coding, testing and integration.
- Is a highly skilled technical leader responsible for key system areas and ensures that changes are delivered with high quality and that best practices are used.
- Provides domain-specific expertise and overall software leadership and perspective to cross-organization projects, programs, and activities.
- Provides guidance and mentoring to less-experienced staff members.
- Participates in analyzing requirements and high-level designs.
- Implements, tests, and maintains software modules created.
- Participates in code reviews.
- Gives input to management on task duration estimates, technical information, and issue resolution.
- Provides domain-specific expertise and perspective to partners.
- Maintains awareness of new tools, environments, and methodologies being used in the Big Data space.
- Recommends ways to improve data reliability, efficiency, and quality.
- Develops processes for data modeling, mining, and reporting.
- Researches opportunities for acquiring new data and new uses for existing data.
• *_Qualifications_**
- Typically 5+ years of experience in software or data engineering.
- Extensive experience in data modeling, data integration and processing of structured and unstructured data.
- Proficient in one or more programming languages (Python preferred).
- Strong SQL proficiency (experience with NoSQL - advantage).
- Experienced with Apache Spark
- Excellent communication skills; mastery in English and local language.
- Ability to effectively communicate product architectures, design and change proposals.
• *_Additional preferred qualifications / advantages_**
- Databricks
- Pandas
- Dataiku
- Familiar with best practices of the data and software engineering lifecycle and/or best practices of the above platforms and tools.
- Scala
