Job Description:
We are seeking multiple Tech Leads (Coders) to help lead our GenAI code initiatives as hands-on experts.
You’ll write and refine code, design automated evaluation frameworks, and partner with research, engineering, and product to improve code-centric LLM performance and reliability.
• To Note: This is for an immediate project need. Project is approved for 3-months initially, with possibility to extend based on project/client demands.
Responsibilities:
• Write, evaluate, and rewrite code to solve complex, real-world problems (hands-on).
• Build frameworks, test suites, and benchmarks to validate model-generated code.
• Analyze and improve correctness, efficiency, and security of human- and AI-written code.
• Define and track code quality metrics.
• Collaborate cross-functionally to integrate feedback and drive model improvements.
• Accelerate validation and refinement of code-generating models; ensure production readiness; drive innovation in GenAI use cases.
Requirements:
• 5+ years building and shipping complex software solutions.
• Strong proficiency in at least one: Python, Java, C, C++, JavaScript.
• Experience creating test harnesses; evaluating code for correctness, efficiency, security.
• Familiarity with LLMs for code (generation, fine-tuning, evaluation) preferred.
• Preferred: STEM/domain expertise; data analysis/visualization; SQL/databases; JSON, HTML, Markdown; web viz platforms; data libraries.
• Senior/tech-lead level; comfortable with smaller, high-complexity datasets.
• Nice-to-have: “technical raters” with strength in JavaScript/JSON, HTML, Markdown.