The Data Engineer – IoT & Vehicle Telematics is responsible for designing, building, and operating scalable data pipelines and streaming infrastructure to ingest, process, and store real-time and near-real-time IoT data from vehicles, including GPS, telematics, sensors, and on-board systems.
The role focuses on enabling reliable IoT data streaming, integration with enterprise data platforms, and supporting analytics, monitoring, and advanced use cases across transportation, fleet management, leasing, and maintenance operations.
The ideal candidate brings strong hands-on experience in IoT data ingestion, streaming architectures, cloud-native data platforms, and working with high-volume, time-series data.
Key Responsibilities
IoT Data Ingestion & Streaming
• Design and implement real-time and near-real-time IoT data ingestion pipelines for vehicle GPS, telematics, and sensor data.
• Build and manage streaming data architectures to ingest high-velocity IoT data reliably and at scale.
• Integrate data from vehicle devices, gateways, and third-party IoT platforms into the enterprise data platform.
• Ensure raw IoT data is captured with full fidelity and landed in the data lake for downstream processing.
IoT Platform & Infrastructure Setup
• Set up and manage cloud-based IoT and streaming infrastructure to support data ingestion, buffering, processing, and storage.
• Configure message brokers, event streams, and data processors to handle large-scale vehicle data flows.
• Ensure scalability, fault tolerance, and low-latency processing for mission-critical IoT use cases.
• Implement monitoring, logging, and alerting for IoT data pipelines and streaming services.
Data Processing & Integration
• Process, enrich, and standardize IoT data for analytics, reporting, and operational monitoring.
• Integrate IoT data with enterprise systems such as fleet management, maintenance, ERP, and analytics platforms.
• Support batch and streaming data processing patterns as required by business use cases.
• Collaborate with analytics and data science teams to enable use cases such as route optimization, driver behaviour analysis, predictive maintenance, and fuel optimization.
Data Quality, Device Health & Monitoring
• Implement IoT data quality checks to validate completeness, accuracy, timeliness, and consistency of streaming vehicle data (e.g., GPS, telematics, sensor signals).
• Design and maintain device health monitoring to track connectivity status, heartbeat signals, data latency, and data drop-offs from vehicles and IoT devices.
• Detect and alert on device disconnections, inactive devices, abnormal data patterns, and delayed or missing data streams.
• Monitor ingestion pipelines and streaming services to ensure reliable end-to-end data flow from device to platform.
• Collaborate with operations and IoT vendors to investigate and resolve device, connectivity, or data transmission issues.
• Maintain dashboards, logs, and alerts to provide visibility into fleet-wide IoT data health and availability.
Qualifications
• Bachelor’s degree in Computer Science, Data Engineering, Electronics Engineering, or a related technical field.
• Master’s degree in a related field is a plus.
• Minimum of 6–8 years of experience in data engineering, with strong focus on IoT and streaming data platforms.
• Proven hands-on experience ingesting and processing vehicle IoT data such as GPS, telematics, CAN bus, sensors, or video metadata.
• Strong experience with streaming and event-driven technologies, such as:
• Kafka or equivalent streaming platforms
• Experience with cloud-based data platforms and data lakes (preferably Microsoft Azure).
• Proficiency in Python and SQL for data processing and transformation.
• Experience working with time-series data, high-volume data streams, and real-time analytics.
• Understanding of IoT architectures, edge-to-cloud data flows, and device-to-platform integrations.
• Familiarity with data quality, monitoring, and operational reliability for streaming systems.
• Strong problem-solving skills and ability to work with cross-functional teams.
• Domain experience in transportation, fleet management, leasing, or vehicle maintenance is a strong asset.