Position: Data Engineer ( Spark & Hive)
Overview
We are seeking a skilled Data Engineer to join our team in Singapore. The ideal candidate will have strong expertise in SQL, Python, Spark, and Hive
, with hands-on experience building scalable data pipelines, data models, and analytical solutions. You will work closely with data scientists, analysts, and business stakeholders to deliver high-quality data solutions that support business decision-making.
Key Responsibilities
• Design, develop, and maintain robust, scalable data pipelines and ETL processes.
• Optimize data storage, retrieval, and processing using SQL, Spark, and Hive.
• Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
• Implement data quality, validation, and monitoring processes to ensure reliability.
• Support data modeling, warehousing, and integration for analytics and reporting.
• Write clean, efficient, and reusable Python code for automation and data processing.
• Ensure data security, compliance, and governance across all solutions.
Qualifications
• Bachelor’s degree in Computer Science, Engineering, or related field.
• 4–7 years of experience as a Data Engineer (or similar role).
• Strong proficiency in SQL, Python, Spark, and Hive
.
• Experience with distributed data processing and big data ecosystems.
• Hands-on experience with data pipeline tools (e.g., Airflow, NiFi, or similar) is a plus.
• Familiarity with cloud platforms (AWS, Azure, or GCP) is advantageous.
• Strong problem-solving and communication skills.
#J-18808-Ljbffr
