Dice is the leading career destination for tech experts at every stage of their careers. Our client, AIT Global, Inc., is seeking the following. Apply via Dice today!
Job Title: Databricks Resident Solutions Architect
Location: Chicago, IL
Roles & Responsibilities:
As a Databricks Resident Solutions Architect (RSA), you will lead the design, development, and deployment of scalable data and AI solutions using the Databricks platform. You'll collaborate directly with customer teams to enable successful lake house implementations and ensure long-term value realization.
Core Responsibilities:
• Architect and implement Lakehouse solutions leveraging Delta Lake, Unity Catalog, and Spark
• Lead migration efforts from legacy systems (e.g., HDFS, Talend) to Databricks
• Design and develop high-performance Spark jobs for batch and streaming pipelines
• Enforce data security and governance using Unity Catalog and fine-grained access control
• Guide CI/CD and DevOps integration for data workflows and ML model deployments
• Provide technical leadership through workshops, hands-on labs, and architectural reviews
• Integrate Databricks with enterprise tools including Power BI, Kafka, ADLS, and orchestration platforms
• Drive optimization strategies for pipeline scalability, reliability, and cost-efficiency
Required Experience & Expertise:
• 10+ years in consulting with 7+ years in data engineering, analytics, and platform delivery
• Proven hands-on delivery experience using Databricks on AWS, Azure, or Google Cloud Platform
• Deep expertise in Apache Spark, including knowledge of runtime internals
• Familiarity with CI/CD pipelines, MLOps, and production-grade deployments
• Up-to-date knowledge of Databricks features and ecosystem integrations
• Strong understanding of distributed computing, performance tuning, and job optimization
• Certified Databricks Data Engineering Professional with supporting coursework
