Quality Engineer Ai Cloud- Lmts

To get the best candidate experience please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts Job Category Software EngineeringJob DetailsAbout SalesforceWere Salesforce the Customer Company inspiring the future of business with AI Data CRM Leading with our core values we help companies across every industry blaze new trails and connect with customers in a whole new way And we empower you to be a Trailblazer too xe2x80x94 driving your performance and career growth charting new paths and improving the state of the world If you believe in business as the greatest platform for change and in companies doing well and doing good youve come to the right place Einstein products platform democratize AI and transform the way Salesforce builds trusted machine learning and AI products - in days instead of months It augments the Salesforce Platform with the ability to easily create deploy and manage Generative AI and Predictive AI applications across all clouds We achieve this vision by providing unified configuration-driven and fully orchestrated machine learning APIs customer-facing declarative interfaces and various microservices for the entire machine learning lifecycle including Data Training Predictions scoring Orchestration Model Management Model Storage Experimentation etc We are already producing over a billion predictions per day Training 1000s of models per day along with 10s of different Large Language models serving thousands of customers We are enabling customers usage of leading large language models LLMs both internally and externally developed so they can leverage it in their Salesforce use cases Along with the power of Data Cloud this platform provides customers an unparalleled advantage for quickly integrating AI in their applications and processes About the team Join the AI Cloud Quality Engineering team and become a specialist on Salesforce s AI Platform and applications You will be a key member of the Quality Engineering team in India as we build the India organization while working with experts worldwide You ll get to work with latest technology in the AI space including generative AI and collaborate with the team and cloud to identify and run quality initiatives to support massive scale planned both in the short term and long term We are a small friendly team that has been working together for years - outside of quality we focus on volunteering and other shared interests Job description summary As a Quality Engineer for the Salesforce AI Cloud you will be responsible for leading the design development and execution of comprehensive test plans quality strategies with emphasis on automation You will collaborate closely with product engineering teams actively contributing to the quality of new features while ensuring successful execution of regression tests in various environments You will be working in a fast phased environment and will be expected to understand complex backend AI flow systems dependencies identifying potential risks and strategically plan and execute comprehensive testing efforts to ensure the stability reliability and quality of the feature and release Skills needed for role Strategic and Tactical leadership Experience leading analysis of coverage gaps and writing E2E and integration tests partnering with teams to drive service level test coverage Technical Expertise Technical excellence and leadership required in identifying developing and maintaining tests involving API databases and web UI tests Strong knowledge of automation tools and continuous automation systems Cross Team Collaboration Ability to work with stakeholders internal customers from multiple organizations that leverage our central platform for custom applications Collaborate with them to determine key shared usage patterns to prioritize test coverage of as well as provide guidance to these customers on how to proactively test their applications integration with the platform Strong knowledge and experience of Java Python Selenium CD pipeline configurations Excellent communication skills Experience generating reports presenting and holding the quality bar for new features release Experience working in Global teams Ability to work and partner with peers and other partner teams across timezones 8 years of QE experience and 2 years of experience leading projects and partnering leading junior members of the team Nice to have skillsets or skillsets expect to develop in this role Understanding of LLM Model hosting with Sagemaker Understanding LLM Finetuning and Inferencing Testing integrations with Cohere Anthropic Dolly Google etc as well as internal models Sagemaker GroundTruth integration for data labelling Bedrock for model serving Experience with Azure Open AI Experience with Tableau around creating dashboards for reporting What the team does Center of Excellence for Quality within the AI Platform teams driving excellence through automation tools and streamlined processes evangelizing shift left methodologies Building enhancing test frameworks tooling for the easy creation and maintenance of integration and end-to-end tests Proactively drive quality by monitoring and reporting of test stability metrics for pre-prod Prod environments through dashboards triaging and filing and follow up of bugs CUJs Critical User Journey test for cross-cloud integration and apps Configure tooling runners for automated tests used by scrum teams Configure various test environments such as setting up core test env hawking test env connectivity Define and measures Quality metrics code coverage endpoint coverage service coverage etc goals are met for the ML foundations Automation strategies and framework support for all kinds of testing Identify risks with releases deployments etc Support TAM expansion to multiple geographies and monitoring platform stability Daily management of Integration tests pass rates in Test App-Dev Stage Prod environments - bugs created assigned if failures not being addressed building test result dashboards and simplifying feedback debugging process for engineers AccommodationsIf you require assistance due to a disability applying for open positions please submit a request via this Posting StatementAt Salesforce we believe that the business of business is to improve the state of our world Each of us has a responsibility to drive Equality in our communities and workplaces We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay employee resource groups inclusive benefits and more Learn more about Equality at and explore our company benefits at is an Equal Employment Opportunity and Affirmative Action Employer Qualified applicants will receive consideration for employment without regard to race color religion sex sexual orientation gender perception or identity national origin age marital status protected veteran status or disability status does not accept unsolicited headhunter and agency resumes will not pay any third-party agency or company that does not have a signed agreement with xefxbbxbfSalesforce welcomes all