sdet- ii

1 week ago

Pune, Maharashtra, India Mindtickle Full time
Job Description

Who we are

Mindtickle is the market-leading revenue productivity platform that combines on-the-job learning and deal execution to get more revenue per rep. Mindtickle is recognized as a market leader by top industry analysts and is ranked by G2 as the #1 sales onboarding and training product. Were honoured to be recognized as a Leader in the first-ever Forrester Wave: Revenue Enablement Platforms, Q3 2024

Whats in it for you?
  • Own the end-to-end qualification lifecycle for AI/LLM systems from ideation and implementation to CI/CD integration.
  • Design and implement scalable automated test suites across unit, integration, regression, and system levels.
  • Build and enhance frameworks to test, evaluate, and continuously improve complex AI and LLM workflows.
  • Lead the design and automation of LLM-powered features, including prompt pipelines, RAG workflows, and AI-assisted developer tools.
  • Develop evaluation pipelines to measure factual accuracy, hallucination rates, bias, robustness, and overall model reliability.
  • Define and enforce metrics-driven quality gates and experiment tracking workflows to ensure consistent, data-informed releases.
  • Collaborate with agile engineering teams, participating in design discussions, code reviews, and architecture decisions to drive testability and prevent defects early (shift left).
  • Develop monitoring and alerting systems to track LLM production quality, safety, and performance in real time.
  • Conduct robustness, safety, and adversarial testing to validate AI behavior under edge cases and stress scenarios.
  • Continuously improve frameworks, tools, and processes for LLM reliability, safety, and reproducibility.
  • Mentor junior engineers in AI testing, automation, and quality best practices.
  • Measure and improve Developer Experience (DevEx) through tools, feedback loops, and automation.
  • Champion quality engineering practices across the organization, ensuring delivery meets business goals, user experience, cost of operations etc.
Wed love to hear from you, if you:
  • LLM testing & evaluation tools: MaximAI, OpenAI Evals, TruLens, Promptfoo, LangSmith
  • Building LLM-powered apps: prompt pipelines, embeddings, RAG, AI workflows
  • CI/CD design for application LLM testing
  • API, performance, and system testing
  • Git, Docker, and cloud platforms (AWS / GCP / Azure)
  • Bias, fairness, hallucination detection & AI safety testing
  • Mentorship and cross-functional leadership
Preferred Qualifications
  • Bachelors or Masters in Computer Science, Engineering, or equivalent.
  • 4 years in software development, SDET, or QA automation.
  • Proficiency in GoLang, Java, or Python.
  • Proven experience building test automation frameworks.
  • Proven ability to design CI/CD pipelines with automated regression and evaluation testing.
  • Hands-on exposure to LLMs, GenAI applications.
  • 2 years of hands-on experience with LLM APIs and frameworks (OpenAI, Anthropic, Hugging Face).
  • Proficient in prompt engineering, embeddings, RAG, and LLM evaluation metrics.
  • Strong analytical, leadership, and teamwork skills.
  • Excellent communication and collaboration across teams.
Our culture & accolades

As an organization, its our priority to create a highly engaging and rewarding workplace. We offer tons of awesome perks and many opportunities for growth.

Our culture reflects our employee's globally diverse backgrounds along with our commitment to our customers, and each other, and a passion for excellence. We live up to our values, DAB, Delight your customers, Act as a Founder, and Better Together.

Mindtickle is proud to be an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, national origin, disability, protected veteran status, or any other characteristic protected by law.

Your Right to Work

In compliance with applicable laws, all persons hired will be required to verify identity and eligibility to work in the respective work locations and to complete the required employment eligibility verification document form upon hire.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Apply for this job

Locations: Pune, Maharashtra

  • sdet- ii

    2 weeks ago

    Pune, Maharashtra, India Mindtickle Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Who we are Mindtickle is the market-leading revenue productivity platform that combines on-the-job learning and deal execution to get more revenue per rep. Mindtickle is recognized as a market leader by top industry analysts and is ranked by G2 as the #1 sales onboarding and training product. We're honoured to be recognized as a Leader in the first-ever...

  • sdet- ii

    2 weeks ago

    Pune, Maharashtra, India MindTickle Full time ₹ 10,000 - ₹ 25,000 per year

    Who we areMindtickle is the market-leading revenue productivity platform that combines on-the-job learning and deal execution to get more revenue per rep. Mindtickle is recognized as a market leader by top industry analysts and is ranked by G2 as the #1 sales onboarding and training product. We're honoured to be recognized as a Leader in the first-ever...

  • Lead II

    2 weeks ago

    Pune, Maharashtra, India UST Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    7 - 9 Years2 OpeningsPuneRole descriptionJob Title: SDET Senior Summary of This Role: Drive the quality assurance and testing efforts for payment solutions by designing, developing, and implementing robust automation and manual test strategies.Utilize strong expertise in API, UI, and protocol testing to ensure delivery of reliable and scalable software...

  • Software Engineer II

    1 week ago

    Pune, Maharashtra, India Mastercard Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...

  • Software Engineer II, Perforce QAC

    6 days ago

    Pune, Maharashtra, India Perforce Software Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Perforce is a community of collaborative experts, problem solvers, and possibility seekers who believe work should be both challenging and fun. We are proud to inspire creativity, foster belonging, support collaboration, and encourage wellness. At Perforce, you'll work with and learn from some of the best and brightest in business. Before you know it, you'll...

  • Java Automation Lead II

    2 weeks ago

    Pune, Maharashtra, India UST Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    7 - 9 Years1 OpeningKochi, Pune, TrivandrumRole descriptionRole Proficiency:Create and Organise testing process based on project requirement and manage test activities within teamOutcomes:Test Estimates and Schedules-. Ensure Test CoverageProduce test results defect reports test logs and reports to evidence for testingPublish RCA reports and preventive...

  • Software Engineer

    1 day ago

    Pune, Maharashtra, India Perforce Software Private Limited Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Software Engineer II (Python Automation), Perforce QACPerforce is a community of collaborative experts, problem solvers, and possibility seekers who believe work should be both challenging and fun. We are proud to inspire creativity, foster belonging, support collaboration, and encourage wellness. At Perforce, you'll work with and learn from some of the best...

  • Software Test Engineer

    6 days ago

    Pune, Maharashtra, India Uplers Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Software Engineer II (Python Automation)Experience: 4-6 Years ExpSalary: CompetitivePreferred Notice Period: Within 30 DaysOpportunity Type: Hybrid(Pune)Placement Type: Full-time(*Note: This is a requirement for one of Uplers' Clients)Must have skills: Python AND API Testing AND SeleniumPerforce Software (One of Uplers' Clients) is looking for:About Perforce...

  • Sdet-ii

    2 weeks ago

    Pune, India TraceLink, Inc. Full time

    : Who you are: Tracelink is looking for talented full-time software engineers to build products at one of the fastest growing companies in the Pune area. If you’re self - motivated, intellectually curious and motivated by designing and developing innovative products for global organizations, you could be a good fit for our team. Responsibilities: -...

  • Software Engineer In Test Ii

    4 days ago

    Pune, Maharashtra, India TraceLink Full time

    Company overview TraceLink s software solutions and Opus Platform help the pharmaceutical industry digitize their supply chain and enable greater compliance visibility and decision making It reduces disruption to the supply of medicines to patients who need them anywhere in the world Founded in 2009 with the simple mission of protecting patients today...

  • Perforce Software

    7 days ago

    Pune, India Perforce Full time

    We are looking for a test engineer to join the Perforce QAC team. Your main focus is on functional testing of the Perforce QAC Static Analysis tool. This includes new feature testing, regression testing, production defects verification, and updating test cases for the analysis engines within Perforce QAC, management portals, and various other plugins within...

  • TechBulls SoftTech

    2 weeks ago

    Pune, India TechBulls SoftTech Pvt Ltd Full time

    About the Role : We are looking for a skilled and motivated SDET 2 (Software Development Engineer in Test) to join our team in Pune. This is not a traditional testing role we are seeking a strong developer with a testing mindset, preferably with experience in both Java and Go (Golang). If you are passionate about building test frameworks, automating...

  • Quality Assurance Automation Engineer

    2 weeks ago

    Pune, India Uplers Full time

    Job Description Software Engineer II (Python Automation) Experience: 4 - 6 Years Exp Salary : Competitive Preferred Notice Period: Within 30 Days Opportunity Type: Hybrid (Pune) Placement Type: Permanent (*Note: This is a requirement for one of Uplers Clients - Perforce Software) Must have skills : Python, API Testing, Selenium Position Summary: We are...

  • Software Engineer Test II

    1 week ago

    Pune/Pimpri-Chinchwad Area, India TraceLink Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Company overview:TraceLink's software solutions and Opus Platform help the pharmaceutical industry digitize their supply chain and enable greater compliance, visibility, and decision making. It reduces disruption to the supply of medicines to patients who need them, anywhere in the world.Founded in 2009 with the simple mission of protecting patients, today...

  • ▷ [Only 24h Left] Software Engineer Test Ii

    2 weeks ago

    Pune, Maharashtra, India TraceLink Full time

    Company overview TraceLink s software solutions and Opus Platform help the pharmaceutical industry digitize their supply chain and enable greater compliance visibility and decision making It reduces disruption to the supply of medicines to patients who need them anywhere in the world Founded in 2009 with the simple mission of protecting patients today...

  • Quality Assurance Engineer

    3 weeks ago

    Pune, India Uplers Full time

    Job Description Software Engineer II (Python Automation) Experience: 4-6 Years Exp Salary: Competitive Preferred Notice Period: Within 30 Days Opportunity Type: Hybrid(Pune) Placement Type: Full-time (*Note: This is a requirement for one of Uplers Clients) Must have skills: Python AND API Testing AND Selenium Perforce Software (One of Uplers Clients) is...