Senior Voice AI Engineer, Evaluation and Reliability

We are looking for a Senior Voice AI Engineer to join a German-based product company designing eHealth solutions for hospitals. You will own the evaluation and reliability of a voice assistant system that interacts with patients, ensuring it is safe and effective. The role focuses on measuring and improving conversation quality, response times, and speech recognition accuracy using a third-party voice platform.

• Own the conversation and the evidence about it: how the assistant behaves when a caller interrupts, corrects themselves or won't answer
• Measure how fast the whole thing responds once a round trip to our backend is in the loop
• Build and maintain the body of test cases we run before every change
• Tune voice system settings (end-of-speech detection, barge-in, wait times) against a vendor's platform
• Develop a replay harness, scored scenario set, or similar testing methodology for conversation changes

• 4+ years of experience in AI/ML
• 2+ years of experience in IP-telephony
• 2+ years of experience with Voice AI Agent
• Experience running a phone or voice assistant that took real calls from real users
• Knowledge of what to measure for voice system response time and how to measure it
• Experience tuning a voice system: end-of-speech detection, barge-in, wait times
• Understanding of speech recognition accuracy on phone audio vs good microphone
• A way of testing conversation changes that doesn't rely on listening to a few calls
• Enough Python to build a harness and tooling
• English C1 – Advanced
• Ukrainian – Native

• Work on a stable healthcare product
• Remote work format
• Work through Ukrainian FOP