Data Engineer: Spark, Kafka

San Francisco 3 days agoFull-time External
Negotiable
About the Role We are seeking a skilled Data Engineer to join our team. This individual will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark and Kafka. The ideal candidate will have hands-on experience with Scala, Spark, Kafka, and Cassandra. They should possess excellent problem-solving skills, be able to work in a fast-paced environment, and collaborate effectively with cross-functional teams. Key Responsibilities: • Design and develop scalable data pipelines using Apache Spark and Kafka • Develop and maintain high-quality, efficient code using Scala and Cassandra • Collaborate with data scientists and analysts to implement data-driven solutions • Ensure data consistency, integrity, and security across multiple systems