Senior Software Engineer (TypeScript / React / LLM Systems)
AI Infrastructure • $160,000 - $240,000 W-2 • Hybrid (2 days/week) • New York, NY
Must be based in NYC & the role requires US Citizenship due to regulatory constraints. No sponsorship/visas/Green Card.
About the Role
We’re hiring a Senior Software Engineer to help build production-grade LLM-powered systems used in high-impact, real-world workflows.
This is a true SWE + ML role. You’ll sit at the intersection of frontend UX, backend systems, and applied machine learning - owning features end to end. That includes React-heavy user interfaces, TypeScript services, and the pipelines that power LLM reasoning, retrieval and fine-tuning behind the scenes.
You’ll work closely with product, design and ML engineers to ship tools where reliability, clarity and user experience matter just as much as model quality.
Why You’ll Love It:
Own real systems: From UX flows to LLM pipelines running in production.
Engineering-first culture: Practical ML, not research theatre. Everything ships.
High-impact UX: Build interfaces used daily by technical and non-technical users.
Move fast: Small teams, short cycles, minimal process overhead.
Serious problems: Latency, hallucination control, evaluation, observability and scale.
What You’ll Do
• Design and build TypeScript services that power LLM workflows including RAG pipelines, prompt orchestration and fine-tuning flows.
• Develop rich, intuitive React interfaces for AI-driven products - heavy focus on UX, clarity and usability.
• Implement retrieval systems using vector databases, hybrid search and structured data sources.
• Work hands-on with LLM APIs and open-source models (OpenAI, Anthropic, open-weight models).
• Collaborate with ML engineers on evaluation, fine-tuning strategies and production rollout.
• Own backend architecture across Node.js services, async pipelines and model-facing APIs.
• Improve system reliability through logging, monitoring, tracing and failure handling.
• Mentor engineers and contribute to design and architecture decisions across the platform.
Tech Stack
Frontend: React, TypeScript, Next.js, Tailwind CSS, Storybook
Backend: Node.js, TypeScript, REST, GraphQL
LLM Systems: RAG pipelines, fine-tuning workflows, prompt orchestration
Data & Retrieval: PostgreSQL, Vector DBs (Pinecone, Weaviate, pgvector), Redis
Infrastructure: AWS, Docker, Kubernetes, Terraform
Observability: OpenTelemetry, Prometheus, Grafana, Sentry
Nice to Have
• Experience building production LLM systems beyond prototypes
• Hands-on fine-tuning experience (LoRA, adapters, evaluation pipelines)
• Background in ML engineering or applied NLP
• Experience designing complex frontend UX for data-heavy or AI-driven products
• Familiarity with model evaluation, guardrails and hallucination mitigation
Interview Process
• Intro Call with Open Talent (30 mins)
• Technical Deep-Dive (TypeScript / React + LLM systems, 60 mins)
• System Design & Architecture (45 mins)
• Leadership Chat with CTO (30 mins) → Offer
What We Offer
Comp: $160K-$240K W-2 (+ meaningful equity)
Benefits: Health, dental, vision, 401(k)
Time Off: Flexible PTO + company holidays
Growth: Conference budget, learning allowance
Environment: Hybrid (2 days NYC office), flexible notice period
Equal Opportunity
We're hiring for an Equal Opportunity Employer.
Due to strong market interest, please apply early or email sufy@opentalent.uk to avoid missing out.
All NYC roles posted here first:
linkedin.com/in/sufyanbashir/
