About the Company
✨ Strong work-life balance✨ Stable and low-turnover team✨ Positive team culture
About the Role
This is a role in a newly established team within our Big Data organization to drive multiple greenfield initiatives. A primary focus is developing a data fabric platform that delivers unified API access across disparate data stores, supporting high-concurrency workloads with sub-second latency requirements at scale.
Responsibilities
• Architect and implement the core routing and query execution engine for the data fabric platform
• Develop robust connection management infrastructure spanning heterogeneous data stores (Kafka, MySQL, Flink, Delta/Iceberg)
• Engineer end-to-end request pipelines optimized for P99 latency targets and high-throughput requirements
• Design and implement fault-tolerant systems including error handling, retry mechanisms, and circuit breaker patterns
• Establish comprehensive observability framework incorporating structured logging, distributed tracing, and metrics collection
• Drive API design decisions and define service contracts in collaboration with cross-functional stakeholders
Qualifications
• Minimum 3 years of professional experience developing low-latency, high-throughput services using C++, Go, or Rust in production environments
• Demonstrated expertise in concurrency patterns, asynchronous I/O, connection pool management, and backpressure handling mechanisms
• Production-level experience with Kafka, MySQL, Apache Flink, Delta Lake/Iceberg
• Proven track record optimizing systems for low-latency requirements (P99)
• Extensive experience designing and implementing services using gRPC, Protocol Buffers, or equivalent RPC frameworks at scale
• Demonstrated experience deploying and operating services managing 100K+ concurrent connections with comprehensive observability infrastructure
Preferred Skills
• Experience with query parsing, optimization, and abstract syntax tree (AST) manipulation
• Implementation experience with adaptive rate limiting or circuit breaker patterns
• Knowledge of zero-copy techniques, memory-mapped I/O, or other advanced performance optimization strategies
• Background in stream processing frameworks and real-time data pipeline architectures
