Responsibilities
• Lead the one-time migration of historical licence data from OneILS (Pega SaaS) into an organisation-managed database.
• Design, build, and maintain reliable data pipelines for continuous extraction from OneILS to the central database.
• Develop the strategy and implementation roadmap for a centralised Licence Data Warehouse.
• Collaborate with internal teams and external vendors to ensure data quality, consistency, and integrity across all reporting needs.
• Support evolving business requirements, including new reporting formats and analytics needs.
• Advise on and execute integration strategies using platforms such as Databricks to enable scalable, self-service business reporting.
• Conduct daily monitoring, tuning, and maintenance of databases and ETL systems, including capacity planning, issue diagnosis, and preventive actions to ensure high system availability.
• Build, test, and maintain reusable and efficient data models based on end-user needs.
• Develop secure data access mechanisms for both end users and integrated systems.
• Research, evaluate, and implement new technologies to continuously enhance data infrastructure and processes.
• Collaborate with data stewards to establish and enforce data governance policies, standards, and best practices.
• Maintain a comprehensive data catalogue covering metadata, lineage, and key data assets.
• Implement data quality checks and validation processes to maintain high data accuracy and reliability.
• Enforce data security best practices, including access controls, encryption, and data masking, to protect sensitive data.
Requirements
• Proven experience with large-scale data migration and ETL projects, ideally in regulated or complex environments.
• Strong SQL skills and hands-on experience with modern ETL tools.
• Proficiency in building data pipelines using Python, Java, or Scala.
• Familiarity with legacy platforms (e.g., Pega) and modern databases such as PostgreSQL or SQL Server.
• Experience working with Databricks.
• Demonstrated ability to operationalise and support data warehouse solutions.
