Engineering QA

Job Description Engineering QA & Testing - AI, AS Position Overview Job Title- Engineering QA & Testing - AI, AS Location- Pune, India Role Description - The Deutsche India is seeking a talented Engineer QA & Testing- AI to join our growing team. At the Service Solutions and AI Domain, our mission is to revolutionize our Private Bank process landscape by implementing holistic, front-to-back process automation. And being a Private Bank AI Centre of Excellence we are responsible for strategy building and execution of AI innovation, governance, and delivery across Private Bank, ensuring standardization, compliance, and accelerated adoption of AI solutions. We are dedicated to leveraging the power of data to drive innovation, optimize operations, and deliver exceptional value to our customers. We are committed to enhancing efficiency, agility, and innovation, with a keen focus on aligning every step of our process with the customer's needs and expectations. Our dedication extends to driving innovative technologies, such as AI & workflow services, to foster continuous improvement. We aim to deliver best in class solutions across products, channels, brands, and regions, thereby transforming the way we serve our customers and setting new benchmarks in the industry. - As an Engineer QA & Testing - AI, you will be a key contributor to ensuring the quality and reliability of our cutting-edge AI-driven automation solutions. You will be involved throughout the software development lifecycle, from analyzing requirements and designing test cases to developing automation features and executing tests across various environments. Your work will directly support the delivery of robust, scalable, and customer-centric solutions for Private Bank, helping to establish new benchmarks in technological excellence and user satisfaction. Join us in shaping the future of banking through innovative technology and a commitment to quality. What we'll offer you As part of our flexible scheme, here are just some of the benefits that you'll enjoy - Best in class leave policy - Gender neutral parental leaves - 100% reimbursement under childcare assistance benefit (gender neutral) - Sponsorship for Industry relevant certifications and education - Employee Assistance Program for you and your family members - Comprehensive Hospitalization Insurance for you and your dependents - Accident and Term life Insurance - Complementary Health screening for 35 yrs. and above Your key responsibilities - Test Planning & Design: - Test Strategy & Concept Adherence:Understand and apply defined test strategies and concepts aligned with sprint goals. - Test Case Development:Develop and maintain test cases, test plans, scripts, and datasets based on business and AI model requirements. - Documentation Support:Assist in maintaining QA-related documentation and ensuring traceability in tools like JIRA and Confluence. - Automation & Execution: - Automation Framework Utilization:Utilize and contribute to building and maintaining automation frameworks using Python, Pytest, Behave, and UnitTest. - Code Quality Application:Apply code quality checks using Black and integrate testing activities within CI/CD pipelines. - API & Performance Testing:Perform API automation testing and execute load/performance testing using Locust under guidance. - AI Model Validation Support:Validate AI models and workflows using metrics such as RAGAS, AgentEval, and BLEU score. - Observability & Analytics Integration:Support the integration of LangFuse for AI evaluation and monitoring. - Collaboration & Agile Engagement: - Agile Participation:Actively participate in Agile ceremonies (sprint planning, stand-ups, retrospectives, and refinements). - Team Collaboration:Collaborate with developers, analysts, product owners, and deployment managers to support the achievement of sprint objectives. - Quality Improvement:Contribute to and support the continuous improvement of testing processes within the squad. Your skills and experience - Educational Foundation: - A Bachelor's or Master's degree in Computer Science, IT, or an equivalent field. - Professional Experience: - Proven experience (4+ years) in a QA & Testing Engineer role, demonstrating successful application of QA & Testing techniques to solve real-world problems. - Core QA Fundamentals: - Demonstrated experience in requirements analysis, test case creation, and test execution. - Experience in utilizing and contributing to Python-based automation frameworks. - Technical Acumen: - Programming & Scripting:Proficiency in Python, Pytest, Behave, UnitTest, and Black for testing and code quality. - API & Performance Testing:Experience with API automation testing and performance testing using Locust. - AI Model Validation Familiarity:Familiarity with AI evaluation frameworks such as RAGAS and AgentEval and understanding of NLP metrics like BLEU. - AI Observability & Analytics Familiarity:Knowledge of LangFuse for AI observability and analytics. - Version Control & CI/CD:Understanding of CI/CD pipelines and Git for version control. - Desirable AI & Domain Knowledge: - AI/ML Workflow Exposure:Exposure to AI/ML workflows and prompt engineering concepts. - Banking Domain Familiarity:Familiarity with the banking domain and business-specific testing. - Professional Competencies: - Communication & Collaboration:Good communication and collaboration skills to work effectively within a team. - Analytical Problem-Solving:Strong analytical and problem-solving abilities. - Proactive & Team-Oriented:A proactive, team-oriented mindset with a focus on continuous improvement. How we'll support you - Training and development to help you excel in your career - Coaching and support from experts in your team - A culture of continuous learning to aid progression - A range of flexible benefits that you can tailor to suit your needs About us and our teams Please visit our company website for further information: We strive for a in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively. Together we share and celebrate the successes of our people. Together we are Deutsche Bank Group. We welcome applications from all people and promote a positive, fair and inclusive work environment.