• 3-month contract, renewable
• Government project
• Hybrid work arrangement
The project aims to enhance multiple mental health services by deploying advanced AI technologies to assist counsellors and helpline operators with real-time guidance, triaging high-risk cases, and offering virtual training modules.
We are seeking a Senior Software Engineer to refine this tool and support its further development and deployment.
Key Responsibilities
• Refine and deploy AI assistant functionalities, including integration into a commercial-grade, well-documented API.
• Support and enhance an existing React-based UI for evaluation purposes.
• Manage databases containing evaluation metrics.
• Ensure reliability, scalability, and seamless integration into operational environments across various applications.
• Expand the generalisation capabilities of the AI Assistants for future deployment across other mental health and social service agencies.
• Implement security enhancements and fix issues as they arise.
• Oversee operations and maintenance of the solution.
• Conduct requirements engineering and stakeholder analysis with project management, design, and development teams.
• Maintain clear, comprehensive technical documentation.
• Monitor and manage security incidents and compliance.
Requirements
• Demonstrated experience in developing applications using Large Language Models (LLMs).
• Familiarity with state-of-the-art evaluation methods for LLM applications, including benchmarking, interpretability, and fine-tuning metrics.
• Proven understanding of implementing guardrails and safeguards to ensure ethical and safe use of LLM-based products.
• Track record in deploying commercial-grade ML/AI APIs with strong scalability and reliability.
• Comprehensive understanding of frameworks and technologies relevant to LLM applications.
• Ability to produce and maintain detailed and accessible technical documentation.
• Capability to understand user stories, use cases, and process flows aligned with business requirements.
• Proficiency in defining acceptance criteria and developing test cases.
