Job Description
```Duties```
As a Data Engineer, you will be responsible for the following duties:
• Designing, developing, and maintaining data pipelines and ETL processes
• Collaborating with cross-functional teams to gather requirements and understand data needs
• Building and optimizing data models and databases for efficient storage and retrieval
• Writing complex SQL queries to extract, transform, and load data from various sources
• Developing scripts and automation tools to support data integration and processing
• Implementing data quality checks and ensuring data integrity and accuracy
• Performing data analysis to identify trends, patterns, and insights
• Troubleshooting and resolving data-related issues in a timely manner
```Skills```
To excel in this role, you should possess the following skills:
• Strong proficiency in SQL for data manipulation and analysis
• Experience with programming languages such as Java or Python for scripting and automation
• Knowledge of ETL tools like Informatica for data integration and transformation
• Familiarity with data warehousing concepts and methodologies
• Understanding of big data technologies like Hadoop or Spark for large-scale data processing
• Hands-on experience with cloud platforms like AWS for deploying and managing data infrastructure
• Proficiency in Shell scripting for automating tasks and workflows
• Ability to analyze complex datasets and derive meaningful insights
• Strong problem-solving skills with attention to detail
• Capital markets experience must
