Java & Spark Engineer
12 month contract
Hybrid - London (3 days per week in the office)
INSIDE IR35
AM Analytics offers a scalable, ML-ready platform for rapid portfolio model development and deployment. It combines data governance, Big Data, and AI-including GenAI capabilities- to boost alpha generation, enhance client services, and ensure regulatory compliance, while improving data quality and cost efficiency.
Join a strong Pune/US team to migrate from an IaaS Big Data platform to Azure-native Databricks. Responsibilities include:
• migrating and optimizing 500+ jobs using Databricks optimization techniques,
• managing 12 TB of data,
• tuning models for Azure with Java Spark and Delta tables,
• and addressing vulnerabilities through library version updates.
Current Tech Stack:
Python, Data Science, Gen AI (GPT, Embeddings, Document Intelligence), Java Spark- ETL, PostgreSQL, Cassandra, Service Bus, AKS (Azure Kubernetes), Terraform, Gitlab CICD, Autosys
Your expertise
You enjoy contributing collaboratively as part of a team as well as being recognized for your contribution and you have a pragmatic approach to challenges. You can listen as well as advise and guide others. You keep abreast of technical development in the industry and are keen to learn and develop.
• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
• Worked as a software engineer for ideally 8+ years
• Experience with Java programming language
• Proficiency in Spark, Databricks, ETL tools and processes, and APIs.
• Strong knowledge of SQL and experience with data modeling and database design
• Strong knowledge of Microsoft Azure, e.g., SQL, ADF, ADLS, APIM, Functions
• Strong communication and collaboration skills
