Position : Data Engineer-Permanent-Hybrid
Location : London, Hybrid(Monday,Tuesday & Thursday from Office)
Job Type : Permanent
About Role:
As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data architecture and infrastructure. The successful candidate should possess a strong foundation in Python, pyspark, SQL, and ETL processes, with a demonstrated ability to implement solutions in a cloud environment.
Mandatory Skills:
• Design, build and maintain data pipelines and ETL Process using Python, PySpark and SQL
• Develop and maintain ETL processes to move data from various data sources to our Data warehouse on AWS/Azure/GCP cloud.
• Collaborate with data scientists, business analysts to understand their data needs & develop solutions that meet their requirements.
• Develop & maintain data models and data dictionaries for our data warehouse.
• Develop & maintain documentation for our data pipelines and data warehouse.
• Continuously improve the performance and scalability of our data solutions.
Qualifications:
• Overall 6+ yrs of experience into IT
• Min 4 years of Strong Programming with Python, Spark/ Pyspark, SQL
