At CoinMarketCap, we are looking for a Quality Engineer to join our team.
Job Description
As a Quality Engineer at CoinMarketCap, you will be responsible for conducting daily quality assurance on AI Chatbot responses through manual sampling and user feedback. You will assess accuracy, relevance, and naturalness of the responses and identify areas for improvement.
You will collaborate with engineering teams to optimize AI models by participating in data annotation, parameter adjustment, and other enhancement tasks to boost performance and answer quality.
You will collect and analyze user-conversation data to uncover user needs and pain points, providing data-driven insights for optimization.
You will refine quality-control workflows to increase efficiency and ensure standardization of QA and tuning processes.
Responsibilities
• Conduct daily quality assurance on AI Chatbot responses through manual sampling and user feedback.
• Detect response-quality issues promptly; document root causes, propose actionable improvements, and follow through to closure.
• Collaborate with engineering teams to optimize AI models by participating in data annotation, parameter adjustment, and other enhancement tasks to boost performance and answer quality.
• Collect and analyze user-conversation data to uncover user needs and pain points, providing data-driven insights for optimization.
• Refine quality-control workflows to increase efficiency and ensure standardization of QA and tuning processes.
Requirements
• Solid understanding of AI Chatbot mechanisms and quality-evaluation criteria.
• Basic data-analysis skills; proficient in SQL, Excel, and related tools.
• Foundational knowledge of Natural Language Processing (NLP) and Machine Learning.
• 2+ years of relevant experience; prior optimization experience with AI or conversational products is preferred.
• Experience with industry-leading AI Chatbot products is a strong plus.
We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
