Big Data Engineer

San Francisco 2 days agoFull-time External
Negotiable
Job Responsibilities: • Work with tech and product teams to develop new tools and systems to support the growth of the business • Create and optimize our data pipeline architecture • Build data access platform for our data science and tech teams • Design and implement modernized ETL through cloud-based solutions • Design and develop large-scale data structures for business intelligence analytics by using data mining tools • Write reliable software to ingest, transform and distribute data into our internal applications. • Support infrastructure and database processes • Add and improve logging and monitoring to current solutions • Provide ad-hoc queries and analysis as needed. Job Skills: • Similar and 5+ years of professional experience, or MS and 3+ years • Strong experience with databases, SQL, writing and debugging • Professional experience with Python development • Working knowledge of bash scripting and/or JavaScript • Experience working with MongoDB, Redis, and PostgreSQL • Experience with cloud-based data solutions (AWS preferred) • Experience with automation/configuration management/enterprise schedulers • System monitoring and alerting, dashboarding experience • Working understanding of code and script (Java, Python, JavaScript, bash)