Dice is the leading career destination for tech experts at every stage of their careers. Our client, Pristine Resource, is seeking the following. Apply via Dice today!
Need 15+years Experience
AI ML Architect with AWS Databricks
Key Responsibilities
Data Science & Machine Learning
• Develop, train, and optimize machine learning and statistical models using Databricks, Python, PySpark, and MLflow.
• Perform exploratory data analysis (EDA) to identify trends, patterns, and insights in large datasets.
• Deploy ML models into production using Databricks MLflow, Delta Live Tables, or other MLOps pipelines.
• Conduct A/B testing, forecasting, segmentation, anomaly detection, or recommendation systems as required by the business.
Data Engineering & Databricks Platform
• Build scalable, high-performance ETL/ELT pipelines using PySpark, SQL, and Databricks workflows.
• Work with Delta Lake to ensure high-quality, reliable, and performant data.
• Optimize cluster usage and job performance within the Databricks environment.
• Collaborate with data engineers to ensure high-quality data availability for modeling.
Business Collaboration
• Translate business problems into analytical solutions and present findings to non-technical stakeholders.
• Partner with product, engineering, and business teams to drive data-informed decisions.
• Communicate complex statistical concepts in a clear and concise manner.
Required
Skills & Qualifications
• Bachelor’s degree or higher in Computer Science, Data Science, Mathematics, Statistics, Engineering, or related field.
• 3+ years of experience in data science or machine learning roles.
• Advanced knowledge of Databricks, including:
• PySpark / Spark SQL
• Databricks notebooks
• Delta Lake
• MLflow
• Databricks Jobs & Workflows
• Strong programming skills in Python (pandas, numpy, scikit-learn).
• Experience working with large-scale data processing.
• Solid understanding of machine learning algorithms and statistical techniques.
Preferred
• Experience deploying models in production using MLOps frameworks.
• Knowledge of Azure Databricks or AWS Databricks environments.
• Understanding of CICD pipelines and DevOps concepts (Azure DevOps, GitHub Actions, etc.)
• Familiarity with deep learning frameworks (TensorFlow, PyTorch) is a plus.
Key Competencies
• Strong analytical and problem-solving skills
• Ability to work in a fast-paced, collaborative environment
• Excellent communication and presentation skills
• Self-driven with high attention to detail
