Founding Engineer – Rust / Systems
We’re supporting a stealth-stage AI startup backed by world-class investors and led by a highly technical founding team. Their mission is to transform how developers train, deploy, and optimize large language models — building the infrastructure that powers AI in the real world.
They're looking for a Founding Engineer with deep Rust experience to help architect and scale the backend systems of a next-gen LLM developer platform - focused on performance, observability, and modularity.
What You’ll Be Building:
• Core backend services written in Rust for high-throughput, low-latency LLM interaction
• Infrastructure that supports dynamic in-context learning, prompt evaluation, and fine-tuning orchestration
• Scalable APIs and serverless components using AWS Lambda, ECS, and S3
• Real-time logging, metrics, and evaluation pipelines to surface model behavior and performance
• Modular systems that can evolve into an open-source foundation for the LLM infra ecosystem
Tech Stack:
• Languages: Rust (heavily), TypeScript (frontend), Python (light)
• Infra: AWS (Lambda, ECS, S3), Docker, Terraform
• Datastores: MySQL, Postgres, S3
• Frontend: Svelte, Tailwind (you'll collaborate, not build here)
• LLM Integrations: OpenAI, fine-tuning, prompt chaining, eval harnesses
Why You Should Join:
• Founding team impact — define the backend architecture, roadmap, and engineering culture
• Modern, open tooling — much of the platform is designed to be open-source and community-facing
• Well-capitalized — backed by elite investors with years of runway
• Mission-aligned — build the infrastructure that helps AI become more transparent, reliable, and usable
