Evaluation Infrastructure Engineer

Genesys empowers organizations of all sizes to improve loyalty and business outcomes by creating the best experiences for their customers and employees. Through Genesys Cloud, the AI-powered Experience Orchestration platform, organizations can accelerate growth by delivering empathetic, personalized experiences at scale to drive customer loyalty, workforce engagement, efficiency and operational improvements.

We employ more than 6,000 people across the globe who embrace empathy and cultivate collaboration to succeed. And, while we offer great benefits and perks like larger tech companies, our employees have the independence to make a larger impact on the company and take ownership of their work. Join the team and create the future of customer experience together.

Job Title: Evaluation Infrastructure Engineer (Conversational AI)
Department & Team: Conversational AI, Language Engineering 
Location: Hyderabad, India (flexible) 

Summary:

About the Conversational AI Team 
At Genesys, we believe that exceptional customer experiences are built on the foundation of intelligent, empathetic technology. Our Conversational AI team is at the forefront of this revolution, developing cutting-edge language technologies that power millions of customer interactions daily.  They span detecting intents and entities, finding information and answering questions, summarizing, and naturally guiding conversations, all across a wide range of languages and channels. 

About the Role 
We are seeking a Senior Data Engineer to serve as a technical force multiplier for our Language Engineering team. You will architect and build the tooling, automation frameworks, and end-to-end evaluation systems that enable our team to thoroughly and efficiently assess conversational AI capabilities built by our engineering teams. This role combines deep technical expertise in data engineering with specialized knowledge of language technologies and AI/ML systems. Your work will directly impact how we measure success and drive improvements in our AI systems. 

Key Responsibilities 
* Collaborate with computational linguists, AI/ML researchers, and product teams to translate research requirements into scalable technical solutions 
* Design and implement automated benchmarking infrastructure for conversational AI evaluation across a range of features, modalities, and languages 
* Create intuitive tooling, APIs, and basic frontend interfaces (e.g. internal dashboards) that enable team members to easily configure, execute, and analyse complex benchmarking scenarios 
* Establish automated reporting and visualization capabilities that make evaluation results accessible to stakeholders 
* Build and implement robust data storage solutions supporting diverse language data types (text, speech, structured annotations) across multiple locales 
* Champion automation-first practices while mentoring team members on tooling, code quality, and engineering standards 

Required Qualifications 
* Bachelor's degree in Computer Science, Data Science, Computational Linguistics, Human Language Technology, or a related field  
* 3+ years of experience building software tooling, data pipelines and evaluation systems 
* Advanced Python skills with expertise in data management, analysis, and visualization libraries (pandas, NumPy, matplotlib, plotly) 
* Hands-on expertise architecting CI/CD pipelines, managing Git workflows, and deploying AWS infrastructure.
* Demonstrated experience owning technical projects end-to-end.
* Comfortable working in a fast paced, highly collaborative, dynamic work environment.

Preferred Background 
* MS or Advanced degree in Computer Science, Data Science, Computational Linguistics, Human Language Technology, or a related field
* Professional experience in NLP and data science 
* Understanding of LLM fundamentals (tokenization, context windows, model behavior including reasoning, factual accuracy, and response quality evaluation) 
* Familiarity with quantitative evaluation metrics and standardized benchmarking frameworks for language models 
* Strong understanding of scalable system design and APIs with experience contributing to technical architecture decisions 
* Experience developing simple web-based dashboards (e.g., using React or Python-based frameworks) is a plus
* Enthusiasm for fostering supportive team dynamics in a global, multicultural environment 

LI-GR1

#LI-Hybrid

If a Genesys employee referred you, please use the link they sent you to apply.

About Genesys:

Genesys empowers more than 8,000 organizations worldwide to create the best customer and employee experiences. With agentic AI at its core, Genesys Cloud is the AI-Powered Experience Orchestration platform that connects people, systems, data and AI across the enterprise. As a result, organizations can drive customer loyalty, growth and retention while increasing operational efficiency and teamwork across human and AI workforces. To learn more, visit 

Reasonable Accommodations:

If you require a reasonable accommodation to complete any part of the application process, or are limited in your ability to access or use this online application and need an alternative method for applying, you or someone you know may contact us at

You can expect a response within 24–48 hours. To help us provide the best support, click the email link above to open a pre-filled message and complete the requested information before sending. If you have any questions, please include them in your email.

This email is intended to support job seekers requesting accommodations. Messages unrelated to accommodation—such as application follow-ups or resume submissions—may not receive a response.

Genesys is an equal opportunity employer committed to fairness in the workplace. We evaluate qualified applicants without regard to race, color, age, religion, sex, sexual orientation, gender identity or expression, marital status, domestic partner status, national origin, genetics, disability, military and veteran status, and other protected characteristics.

Please note that recruiters will never ask for sensitive personal or financial information during the application phase.