Required Technical Skills
Experience designing and building data platforms integrating disparate data sources
Expertise in Azure Implementation: Data Lake, Databricks, ADX, Azure SOL
Knowledgeable in the Databricks take House platform
Expertise developing dataflows using Databricks, Azure Data Factory, Spark in Scala and sol
- Having also Delta Live Table (DLT) experience would be a bonus,
- Advanced, hands-on in implementing large scale Datawarehouse and data lakes
Advanced, hands on experience in Spark architecture and implementation
Experience in working with Distributed Message Systems Ike Kalka
Hands on experience on development in Scale, SOL, Python, and lava
Beneficial Technical Skills
Experience developing Microservices
Some basic knowledge on Linux shell script.
Some general knowledge on Cloudera Big Data platform:
- D HDP: HDFS, Oozie, Hive, Spark
- HDF: Storm, Nifi, Kafka
• *Job Types**: Full-time, Fixed term contract
Contract length: 6 months
• *Salary**: $60.00-$65.00 per hour
Schedule:
- 8 hour shift
Ability to commute/relocate:
- Montréal, QC: reliably commute or plan to relocate before starting work (required)
