Senior Databricks Data Architect (AWS)

New York 4 days agoContractor External
Negotiable
Role: Senior Databricks Data Architect (AWS) Location: Ridgefield Park, New Jersey 07660 12 Contract onsite position - This role requires 100% onsite presence Monday through Friday and will cover core business hours based on the EST time zone. JOB DESCRIPTION JOB TITLE: Senior Databricks Data Architect (AWS) - Hands-On Technical Lead PURPOSE OF THE JOB: • Lead the strategic design and architectural roadmap of the Enterprise Data Platform on Databricks/AWS while remaining actively hands-on in design, prototyping, coding, and performance tuning. • To provide high-level technical consultancy and solution design to internal business stakeholders and external partners, acting as the bridge between complex business requirements and technical implementation. • To govern the technical quality of the platform by establishing design standards, conducting code reviews, and guiding the engineering team on best practices for Databricks Serverless and AWS integration. • As part of the role, you will be required to provide technical assurance for all major data initiatives, ensuring that solutions are robust, cost-effective, and compliant with enterprise security standards. EDUCATION: • Educated to degree level in Computer Science, Engineering, or equivalent (Master’s degree preferred) SKILLS AND ATTRIBUTES: Essential – • Exceptional "Customer Facing" skills: proven ability to lead workshops, manage stakeholder expectations, and present complex technical solutions to non-technical audiences. • Minimum 8-10 years’ experience in Data Engineering/Architecture, with at least 4 years specialized in Databricks and AWS. • Expert-level knowledge of Data Lakehouse Architecture, Delta Lake internals, and Spark optimization strategies. • Proven experience in Data Modeling (Dimensional, Vault, Relational) and designing complex ETL/ELT pipelines. • Advanced hands-on coding proficiency in Python and SQL, with the ability to write clean, production-ready, and testable code. • Strong experience with Databricks Serverless architecture, Unity Catalog implementation, and security patterns. • Deep understanding of Cloud Architecture (AWS Well-Architected Framework), including networking, storage (S3), and IAM. • Experience in Design Review and Code Review processes, capable of constructive critique and enforcing standards. • Detailed knowledge of DevOps principles (IaC with Terraform, CI/CD pipelines). • Knowledge of the MS Office suite (Word, Excel, PowerPoint, Outlook) – specifically for creating architectural diagrams and presentations. • Very strong relationship building and influencing skills at a senior level. • Strategic thinking with the ability to balance immediate business needs with long-term architectural vision. EXPERIENCE: Essential - • 8+ years of experience in Data Architecture and Engineering. • Extensive experience designing solutions on the Databricks platform. Advantage - • Strong experience working with large-scale enterprises or as a Consultant for big agencies. • Certified Databricks Data Architect or AWS Solutions Architect (Professional). • Excellent organizational and planning skills, with an ability to manage architectural backlogs. • A best-in-class technical leader proactively driving business innovation and process improvements. • Languages: Python, SQL, Scala. • Experience designing APIs for data consumption. • Experience with Enterprise Architecture frameworks (TOGAF).