Are you an experienced data engineer with a passion for utilizing cutting-edge technologies to drive innovation? Do you thrive in a fast-paced and collaborative environment? Look no further – Capital One is seeking a highly skilled Senior Data Engineer with expertise in Python, Scala, or Spark to join our dynamic team. In this role, you will have the opportunity to leverage your technical skills to build and maintain robust data pipelines, enabling data-driven decision making across the organization. We are seeking a driven and self-motivated individual with a strong foundation in data engineering principles and a desire to continuously learn and grow. If you are ready to take on a new challenge and make an impact at a leading financial institution, we want to hear from you!
Design and implement data pipelines using Python, Scala, or Spark to extract, transform, and load large datasets from various sources.
Collaborate with cross-functional teams to understand business needs and translate them into technical requirements for data solutions.
Utilize cutting-edge technologies to drive innovation and improve the efficiency and scalability of data pipelines.
Develop and maintain data warehousing and data modeling strategies to support data-driven decision making.
Troubleshoot and optimize data pipelines to ensure high quality, reliable, and timely data delivery.
Stay current with industry trends and best practices in data engineering to continuously improve processes and systems.
Mentor and provide technical guidance to junior data engineers on best practices and coding standards.
Work closely with data scientists and analysts to understand their data needs and provide support for data access and manipulation.
Identify and implement opportunities for automation and optimization of data processes.
Collaborate with data governance and security teams to ensure compliance with data privacy and security regulations.
Communicate effectively with stakeholders at all levels to provide updates on project status and data engineering initiatives.
Take ownership of data engineering projects and drive them to successful completion within tight deadlines.
Continuously monitor and improve the performance and reliability of data pipelines.
Maintain documentation and version control for data pipelines and related processes.
Participate in agile development processes and contribute to team discussions and decision-making.
Capital One is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.
