We are seeking a hands-on AI Gateway Developer to join a forward-thinking team working on a critical AI infrastructure project. You will be responsible for designing, building, and maintaining scalable API and service gateways that form the backbone of our AI service orchestration platform. This role is ideal for a developer who excels at creating robust, secure, and high-performance integration layers and has a keen interest in the unique challenges of AI/ML service delivery.
Key Responsibilities:
• Design & Development: Architect, code, and deploy scalable API gateways and service mesh components to manage, secure, and route traffic to various AI/ML models and services.
• AI Service Integration: Build connectors and integration logic for interacting with external AI APIs (e.g., OpenAI, Anthropic, Azure AI) and internal machine learning models, ensuring reliable and efficient communication.
• Security & Governance: Implement authentication (OAuth2, JWT, API Keys), authorization (RBAC), rate limiting, logging, and monitoring within the gateway layer to ensure secure and compliant access to AI resources.
• Performance Optimization: Optimize gateway performance for AI-specific patterns, such as handling streaming responses, long-running inference requests, and high-volume traffic.
• Collaboration: Work closely with AI/ML engineers, platform teams, and product owners to understand requirements and translate them into technical solutions.
Must-Have Skills & Qualifications:
• 5+ years of hands-on software development experience with a strong focus on backend and integration systems.
• Proven experience in API Gateway development using technologies such as Kong, Apigee, AWS API Gateway, Azure API Management, or Envoy Proxy.
• Solid programming skills in one or more of: Go, Python, Java, or Node.js.
• Experience with REST, GraphQL, and gRPC API design, development, and consumption.
• Hands-on experience with cloud platforms (AWS, Azure, or GCP) and deploying services in containerized environments (Docker, Kubernetes).
• Understanding of API security best practices (TLS/mTLS, secrets management, threat protection).
