Responsible for the understanding and documenting the business requirements
- Manage Data & ML Engineering and Data Ops teams
- Design and develop the Big Data architecture
- Deep understanding of ETL methodologies, Big Data, API and Data Warehousing principles, approaches, technologies, and architectures including the concepts, designs and usage of data warehouses and data marts
- Works closely with business and technical teams to understand, document, design, develop, code, and test ETL processes
- Work with Agile methodologies, CI/CD and DevOps strategy
- Design the data flow strategy ensuring data governance policies are followed
- Design, develop and orchestrates Databricks jobs including coding in python and SQL
- Write, implement, and maintain appropriate ETL processes
- Writing the Unite test, UAT test and validating it with the business users
- Responsible for the Integrity, Maintenance, and changes to the databases.
• *To be considered for this role, you will need to have**:
- Bachelor's degree in Business Administration/Informatics or any relevant field or equivalent work experience accepted
- Microsoft certification in Big Data '“ Azure or similar
- **8+ years **of experience within particular area of expertise
- **5+ years **of experience in Big Data architecture and tools
- **5+ years **of experience in ETL tools (Talend, Azure DF or similar)
- **3+ years **of experience in Azure Databricks
- **3+ years **of experience of development using Python, SQL and/or Java
- **3+ years **of experience of data science delivery (Azure ML, Databricks and/or python)
- Strong knowledge and expertise in Big Data tools (Databricks, Hadoop, Spark, Azure Data Lake, Hive, Pig, etc)
- Demonstrable, strong analysis skills are necessary
- Programming skills utilizing Python, SQL
- Experience with data science solutions (Azure ML, Databricks and/or python)
- Experience with Microsoft Azure Data Factory
- Demonstrable, strong expertise in data modeling
- An understanding of utilizing Visual Studio and Team Foundation Server\GitHub
- Experience with MS Azure Cloud
- Experience with data modeling tools such as Erwin
- Experience with customer profiling and MDM solutions
- Good communication skills
- Project management and delivery skills
- Leadership and team management skills
• *Desirable**:
- Master's degree in Business Administration/Informatics or any relevant field or equivalent work experience is desirable
- Certification in Talend and/or Azure DF
- 10+ years of experience within particular area of expertise
- 3+ years of experience in Data Visualization tools (Tableau or similar)
- 3+ years of experience leading development team as a manager or team lead
- Experience with Tableau
