Data Engineer

Hong Kong 22 months agoFull-time External
Negotiable
The Job You will: • Implement the best practice of data and machine learning engineering into the division • Work with data scientists to define project objectives and scopes with data and machine learning mindsets • Write codes in different languages to run queries and support data analysis work • Assist with the implementation of data pipelines within the Division with regard to suitable hardware and infrastructure; • Ensure that the Team delivers solutions to Data and Analytics (and more widely if relevant) efficiently and with increased automation • Oversee and manage the workflow of data quality management, data cleansing and data exchanges processes • Generate reports of deployed models and analyze any data irregularities • Monitor deployed models in production and report any abnormality.in data or models • Work with data scientists to build data pipelines, model training pipelines to ensure reproducibility & robustness • Work with IT for transforming machine learning models into APIs that can be integrated with other applications • Assist in the development of a centralized data warehouse for different data usages • Assist in the development of data ingestion and data transformation architecture • Ensure the data within the Division is accurate, consistent and on-time • Research, build, and design self-running software to automate machine learning operations. • Research, build, and design cloud infrastructure and solutions to meet the demands in data and machine learning engineer • Assist in the deployment of data science solutions in the Division • Promote appropriate tools and processes in the areas of cloud computing, big data and machine learning. • Design machine learning systems to help develop high-performance machine learning models. • Design and implement rules and procedures for data management within the Division • Drive the standard patterns for data engineering and data management within the Division. • Ensure machine learning systems is compliant with IT security rules • Identify and train team member’s skills in data and machine learning engineer • Ensures compliance with Responsible Gambling Policy (RGP) and all stipulated legal requirements pertaining to wagering, thereby protecting the integrity of the Club’s business • Undertakes other duties as assigned by Line Manager About You You should have: • Master degree in quantitative discipline such as Data Science, Statistics, AI, Computer Science, Engineering or a related discipline. • Strong computational background, with significant production-level programming and scripting experience. • Solid experience on Data Management or Data Engineering. • Solid experience in relational databases (SQL Server), as well as working familiarity with a variety of databases • Solid experience in object-oriented programming (C#, Java, C++), as well as other scripting languages (Python, Matlab,R, VBA) • Knowledge of container techniques and concepts (e.g. Docker, Kubernetes) • Knowledge of Big Data and associated techniques and methodologies to underpin applications of Machine Learning and AI. Experience of Cloud technologies a plus