Software Development Engineer I
1 week ago
While headquartered in Seattle, Highspot has expanded its footprint across America, Canada, the UK, Germany, Australia, and now India, solidifying its presence in the Asia Pacific markets.
About The Role You will safeguard the quality of our AI and GenAI features by evaluating model outputs, creating "golden" datasets, and guiding continuous improvements in collaboration with data scientists and engineers. Be the guide to the team as the team creates a robust methodology and framework that will drive evaluation of hundreds of AI agents. Responsibilities
- Evaluation Frameworks – Develop reusable, automated evaluation pipelines using frameworks such as Raagas; integrate LLM-as-a-judge methods for scalable assessments.
- Golden Datasets – Build and maintain high-quality benchmark datasets in collaboration with subject matter experts.
- AI Output Validation – Evaluate results across text, documents, audio, and video, using both automated metrics and human-in-the-loop judgment.
- Metric Evaluation – Implement and track metrics such as precision, recall, F1 score, relevance scoring, and hallucination penalties.
- RAG & Embeddings – Design and evaluate retrieval-augmented generation (RAG) pipelines, vector embedding similarity, and semantic search quality.
- Error & Bias Analysis – Investigate recurring errors, biases, and inconsistencies in model outputs; propose solutions.
- Framework & Tooling Development – Build tools that enable large-scale model evaluation across hundreds of AI agents.
- Cross-Functional Collaboration – Partner with ML engineers, product managers, and QA peers to integrate evaluation frameworks into product pipelines.
- 4+ years of experience as a Software Development Engineer in AI/ML systems.
- Strong coding skills in Python (evaluation pipelines, data processing, metrics computation).
- Hands-on experience with evaluation frameworks (Ragas or equivalent).
- Knowledge of vector embeddings, similarity search, and RAG evaluation.
- Familiarity with evaluation metrics (precision, recall, F1, relevance, hallucination detection).
- Understanding of LLM-as-a-judge evaluation approaches.
- Strong analytical and problem-solving skills; ability to combine human judgment with automated evaluations.
- Bachelor's or Master's degree in Computer Science, Data Science, or related field.
- Strong English written and verbal communication skills.
- Good to Have: Experience in data quality, annotation workflows, dataset curation, or golden set preparation.
- Sales domain knowledge is a strong plus.
Equal Opportunity Statement We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of age, ancestry, citizenship, color, ethnicity, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or invisible disability status, political affiliation, veteran status, race, religion, or sexual orientation.
Did you read the requirements as a checklist and not tick every box? Don't rule yourself out If this role resonates with you, hit the 'apply' button.
-
Software Engineer I
7 days ago
Hyderabad, Telangana, India Spacelabs Healthcare Full time US$ 80,000 - US$ 1,20,000 per yearOverviewSoftware Engineer-I will be involved in the development of software technologies for medical devices. The right candidate will be proactive, with great communication skills, demonstrate attention to details, have a passion for technology, and an excitement to produce great products. Software Engineer-I shall be responsible for the development of...
-
Software Development Engineer in Test I
2 weeks ago
Hyderabad, Telangana, India Amgen Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per yearABOUT THE ROLEWe are seeking an entry-level SDET to join our Industrial IoT team, collaborating with developers and technical specialists. This position plays a critical role in the development, implementation, and maintenance of our IoT platform, supporting our strategy for modernizing industrial systems. As part of our Technology organization, you will...
-
Software Development Engineer I
2 weeks ago
Hyderabad, Telangana, India Ivy Full time ₹ 6,00,000 - ₹ 18,00,000 per yearCompany DescriptionEntain India is the engineering and delivery powerhouse for Entain, one of the world's leading global sports and gaming groups. Established in Hyderabad in 2001, we've grown from a small tech hub into a dynamic force, delivering cutting-edge software solutions and support services that power billions of transactions for millions of users...
-
Software Test Engineer I
5 days ago
Hyderabad, Telangana, India Medtronic Full time ₹ 5,00,000 - ₹ 20,00,000 per yearAt Medtronic you can begin a life-long career of exploration and innovation, while helping champion healthcare access and equity for all. You'll lead with purpose, breaking down barriers to innovation in a more connected, compassionate world.A Day in the LifeThe Software V&V Engineer I, based in Hyderabad - will focus on supporting medical device software...
-
Software Engineer I A
4 days ago
Hyderabad, Telangana, India Bank of America Full time ₹ 4,00,000 - ₹ 12,00,000 per yearJob Description:Overview (Bank of America overview, BA Continuum India overview, Business Overview)Bank of America is one of the world's leading financial institutions, serving individual consumers, small and middle-market businesses and large corporations with a full range of banking, investing, asset management and other financial and risk management...
-
Software Development Engineer I
7 days ago
Hyderabad, Telangana, India Ivy Full time ₹ 8,00,000 - ₹ 12,00,000 per yearCompany DescriptionEntain India is the engineering and delivery powerhouse for Entain, one of the world's leading global sports and gaming groups. Established in Hyderabad in 2001, we've grown from a small tech hub into a dynamic force, delivering cutting-edge software solutions and support services that power billions of transactions for millions of users...
-
Software Engineer I
7 days ago
Hyderabad, Telangana, India NCR Voyix Full time ₹ 5,00,000 - ₹ 15,00,000 per yearAbout NCR VOYIXNCR Voyix Corporation (NYSE: VYX) is a leading global provider of digital commerce solutions for the retail and restaurant industries. NCR Voyix transforms retail stores and restaurant systems with comprehensive, platform-led SaaS and services capabilities. NCR Voyix is headquartered in Atlanta, Georgia, with customers in more than 35...
-
Software Engineer I A
5 days ago
Hyderabad, Telangana, India Bank of America Full time ₹ 4,00,000 - ₹ 12,00,000 per yearJob Description:Overview (Bank of America overview, BA Continuum India overview, Business Overview)Bank of America is one of the world's leading financial institutions, serving individual consumers, small and middle-market businesses and large corporations with a full range of banking, investing, asset management and other financial and risk management...
-
Engineer I, Software
1 week ago
Hyderabad, Telangana, India RPA,Power Automate Full time ₹ 3,00,000 - ₹ 6,00,000 per yearJob Title: Engineer I, (RPA)Experience: 0-2 YearsJob Location: Remote, India Company Overview Ensemble Health Partners India, we're at the forefront of innovation, leveraging cutting-edge technology to drive meaningful impact in the Revenue Cycle Management landscape. Our future-forward technology combines advanced AI-driven analytics with tightly...
-
Hyderabad, Telangana, India S&P Global Full time ₹ 1,80,000 - ₹ 6,00,000 per yearAbout the Role:Grade Level (for internal use):11The Role: Lead I, Software Development Engineer in TestThe Team:The Quality Engineering team works in partnership with other Technology Functions and the Business to ensure quality delivery of our products. The team works in an Agile environment and is located globally. The team is independent in driving all...
