Roles & Responsibilities
The developer is responsible to:
• Analyse the Authority's data needs and document the requirements.
• Refine data collection/consumption by migrating data collection to more efficient channels
• Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.
• Develop test plan and scripts for system testing, support user acceptance testing.
• Work with the Authority's technical teams to ensure smooth deployment and adoption of new solution.
• Ensure the smooth operations and service level of IT solutions.
• Support production issues
Skills Required:
• Good understanding and completion of projects using waterfall/Agile methodology.
• Analytical, conceptualisation and problem-solving skills.
• Good understanding of analytics and data warehouse implementations
• Hands-on experience in big data engineering jobs using Python, Pyspark, Java
• Strong SQL and data analysis skills
Tell employers what skills you have
PySpark
Data Analysis
Big Data
System Testing
Service Level
Data Engineering
SQL
Python
User Acceptance Testing
Java