Gen AI Python Test Engineer

6 days ago

Pune Maharashtra India, Maharashtra Fractal Full time

Job Description:

Quality Assurance (QA) Engineer is a professional responsible for ensuring the quality and reliability of software applications by developing, executing, and maintaining automated test scripts. Their primary focus is on using automated testing tools and frameworks to create tests that can be run automatically to validate the functionality, performance, security, and usability of genAI products.


Responsibilities

· Test Automation Development:

o Design, develop, and maintain automated test scripts using various tools and frameworks (e.g., Selenium, Cypress, Appium, JUnit, TestNG).

o Implement automated tests for different aspects of the software, such as functional, regression, integration, and performance testing.

· Conversational Flow Testing:

o Experience in testing GenAI based applications.

o Evaluate the conversational flow and user interactions to ensure natural and intuitive user experiences.

o Analyse model outputs to identify and mitigate potential biases across different demographics and data segments.

· Test Planning & Strategy:

o Collaborate with development and product teams to understand application features and requirements.

o Develop comprehensive test plans and strategies that incorporate both manual and automated testing approaches.

· Framework Development & Maintenance:

o Build and maintain test automation frameworks to support automated testing efforts.

o Ensure that the automation framework is scalable, reusable, and capable of accommodating new features and updates.

· Continuous Integration & Continuous Deployment (CI/CD):

o Integrate automated tests into CI/CD pipelines (Azure DevOps) to ensure that automated tests are executed as part of the build process.

o Work closely with DevOps teams to maintain and optimize automated testing in the deployment cycle.

· Test Execution & Reporting:

o Execute automated test scripts, analyze results, and report any defects or issues found.

o Provide detailed documentation and reports on test coverage, test results, and any identified issues.

· Defect Identification & Analysis:

o Identify, log, and track software defects to resolution.

o Work with development teams to troubleshoot and resolve issues found during automated testing.

· Tool & Technology Evaluation:

o Stay up-to-date with the latest trends in test automation tools and frameworks.

o Evaluate and recommend new tools and practices to improve the efficiency and effectiveness of the testing process.

Technical requirements

· Programming Languages: Proficiency in programming languages such as Python (mandatory), Java, C#, or JavaScript.

· LLM – Azure openAI, Gemini, Llama knowledge, NLP, Must have

· Testing Tools & Frameworks: Experience with automated testing tools and frameworks like Selenium, Appium, Cypress, JUnit, TestNG, and others.

· CI/CD Tools: Familiarity with CI/CD tools like Jenkins, GitLab CI, CircleCI, or Azure DevOps.

· Version Control: Proficiency with version control systems such as Git.

· APIs & Web Services: Experience in testing APIs and web services using tools like Postman or REST Assured.

· Agile Methodology: Understanding of Agile methodologies and experience working in Agile environments.

  • Gen Ai Testing

    1 day ago

    Pune, Maharashtra, India Zensar Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We're looking for a seasoned Gen AI QA Engineer with -7-9 years of experience in testing full-stack and backend-heavy systems.You'll define test strategies, develop automation frameworks, and test AI-enabled workflows, APIs, and microservices.Strong experience in API test automation, microservices testing, and CI/CD pipelines is required.

  • Gen AI

    5 days ago

    Pune, Maharashtra, India Reveille Technologies,Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're Hiring – Gen AI | Agentic AI | Python ExpertsSkill Set: Gen AI, Agentic AI, PythonExperience: 10+ Years notice period : 0 to 30 Days serving onlyLocations: AllHexawarelocationsexcept HyderabadWe're looking for senior AI professionals who are passionate about building next-gen intelligent systems. If you're

  • Gen AI Engineer

    2 weeks ago

    Pune, Maharashtra, India Chat360 Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionChat360 is a leading Conversational AI Platform that helps businesses automate customer support, boost engagement, and drive sales with AI-powered chatbots. We provide seamless customer interactions across multiple channels, including WhatsApp, Instagram, Facebook, Websites, and CRM integrations, ensuring 24/7 support without the need for...

  • Gen AI Engineer

    1 day ago

    Pune, Maharashtra, India Apex One Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position: Gen AI Engineer (React + Node)Experience: 6-8 YearsLocation: Pune HybridResponsibilities: Design & deliver AI-first features (contract summarization, semantic search, guided workflows). Integrate LLMs (OpenAI, Anthropic, Mistral) using LangChain, LlamaIndex, or custom orchestration. Build RAG pipelines & embedding-based search with vector DBs...

  • gen ai architect

    2 weeks ago

    Pune, Maharashtra, India Irizpro Learning Solutions Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    Job Title: Gen AI Developer (Fresher – 0 to 1 Year Experience)Location: Kharadi, PuneJob DescriptionWe are looking for a passionate and motivated fresher to join our team as a Gen AI Developer. The ideal candidate should have basic knowledge of Python programming and a keen interest in Artificial Intelligence, Machine Learning, and Generative AI...

  • AI & ML (Gen AI) with Python

    2 weeks ago

    Pune, Maharashtra, India Onelab Ventures Full time ₹ 80,00,000 - ₹ 2,00,00,000 per year

    AIJobs | Build, Innovate, and Transform the Future with AI & Design Job Details:Title:AI & ML (Gen AI) with PythonLocation:On-site – Pune, MaharashtraEmployment Type:Full-TimeExperience:1–4 yearsCTC:As per company norms Preferences: Immediate Joiners only Candidates from Maharashtra preferred 2+ years in the same organization preferred Local Pune...

  • Developer (Gen AI)

    2 weeks ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Must-Have:A fundamental understanding of ML and DL principles, algorithms, and neural network architectures is critical.Proficient in Python and experienced with AI development tools like TensorFlow and PyTorch.Familiarity with techniques like Generative Adversarial Networks and Variational Autoencoders, and specific applications in text (NLP) and image...

  • Sr Python

    2 weeks ago

    Pune, Maharashtra, India, Maharashtra 7N Full time

    7N is hiring!!We are currently looking for Sr Consultants with expertise in Python programming along with experience in Gen AI.Job Title : Sr Python developer with Gen AILocation : Pune (Hybrid mode)Experience : 7+ yearsRequirements:Python,LangChain, LangGraph,Backend development (API frameworks like FastAPI, flask, others), Nice-to-have: AWS cloud...

  • Gen AI Developer

    1 day ago

    Pune, Maharashtra, India e Zest Full time ₹ 7,00,000 - ₹ 18,00,000 per year

    Gen AI Developer Mid-Level (2–6 years)Key ResponsibilitiesBuild and deploy applications using LLM APIs.Implement LLM chaining and agentic AI workflows.Develop, test, and optimize Gen AI solutions.Integrate AI modules with broader application ecosystems.Mentor junior developers.RequirementsHands-on experience implementing Gen AI applications.Experience with...

  • Gen AI

    24 hours ago

    Pune, Maharashtra, India Apex One Full time ₹ 15,00,000 per year

    Position: Gen AI Engineer (React + Node)Experience: 6–8 YearsLocation: Pune – HybridResponsibilities:Design & deliver AI-first features (contract summarization, semantic search, guided workflows).Integrate LLMs (OpenAI, Anthropic, Mistral) using LangChain, LlamaIndex, or custom orchestration.Build RAG pipelines & embedding-based search with vector DBs...