Global IT Platform Engineer Expert Senior Manager – Gen AI/ LLM

2 weeks ago


New Delhi, Delhi, India Boston Consulting Group Full time
WHAT YOU'LL DO
We are seeking a highly skilled and experienced Platform Engineer Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in platform engineering, cloud infrastructure, and DevOps/MLOps/LLMOps, with a passion for creating scalable, reliable, and efficient systems.
YOU'RE GOOD AT

* Being a great hands-on engineer passionate of building platform capabilities.
* Performing successfully in a fast-paced, multi-cultural and service-oriented environment
* Verbal and written communication at a business and technical level
* High level of initiative, self-motivation, resourcefulness, and collaboration
* Are passionate, intellectually curious, and enjoy learning new skills and capabilities.
* Building relationships and reliable team player, displaying consideration and respect for others
* Interpreting rules and guidelines flexibly to enhance the business and aligning with BCG’s values and culture
* Exhibiting ownership and accountability for the squad deliverables
* Servicing customer teams / platform users with a strong customer centricity
* Attention to detail, well organized, able to set priorities and take decisions
* Being flexible to be available outside of normal business hours for international calls as needed

YOU BRING (EXPERIENCE & QUALIFICATIONS)

* Bachelor’s degree in computer science engineering (or equivalent degree or experience)
* Proven Experience in Gen AI, Artificial Intelligence, Machine Learning, or Natural Language Processing
* 12+ years of relevant experience in delivering platform or complex technology solutions with strong technical background, preferably in global organization/ enterprise.
* 2+ years’ experience in experimenting and developing with LLM.
* 1+ years of experience developing with LLMs for production use case.  
* 8+years of experience in leading Enterprise scale software engineering/ platform engineering teams.
* Passionate expert in Modern Engineering, DevOps practices - Strong understanding of CI/CD, AI/ ML pipelines and automation tools.
*Experience & Skills (Mandatory)  *

* Strong knowledge and experience in Generative AI/ LLM based development.
* Strong experience working with key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/ OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex) 
* Experience with multi-agent frameworks and an understanding of multi-agent systems and their applications in complex, multi-step problem-solving scenarios. 
* Expertise in building enterprise grade, secure data ingestion pipelines for unstructured data – including indexing, search, and advance retrieval patterns. 
* Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets. 
* Proficiency in generating and working with text embeddings with understanding of embedding spaces and their applications in semantic search and information retrieval. 
* Knowledge and Experience in building knowledge graphs in production.
* Experience with RAG concepts and fundamentals (VectorDBs, AWS OpenSearch, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with Generative AI models. 
* Knowledge of training and fine-tuning Foundation Models, including multimodal inputs and outputs 
* Proficiency in Python, TypeScript, NodeJS, ReactJS (and equivalent) and all associated GenAI libraries and frameworks. 
* Experience with containerization and orchestration technologies (Kubernetes, Docker).
* Proficiency in cloud platforms (AWS, Azure, GCP) and infrastructure as code (Terraform).  
*Experience & Skills (Nice to have)  *

* Experience with LLM guardrails 
* Experience with security related to LLM integration
* Experience in LLM Testing and Evaluation
* LLM Security

YOU'LL WORK WITH

* Your Gen AI Platform Engineering chapter in Cloud and Platform Engineering Portfolio
* Product Owners, Chapter Leads and other squad members.
* Agile Coaches and Scrum Leads, that will ensure that you adopt agile principles, mindset and ways of working into your daily routine and who will coach you during the transformation.



  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a highly skilled and experienced Platform Engineer Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOTo realize our goal to build a GenAI platform capability that will power use cases across BCG functions, we are seeing passionate Gen AI Platform Chapter Lead who is passionate about designing, developing, and optimizing GenAI based products and solutions. You will also be committed to maintaining and developing your own expertise and...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOThis is a GenAI Quality Engineer Senior Manager position within BCG's Quality Engineering Center of Expertise (QE CoE). The QE CoE resides within BCG’s Cloud & Platform Engineering (CPE) Portfolio. The role of CPE includes developing and supporting new and enhanced applications, as well as integrating and configuring third party...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a highly skilled Gen AI/LLM Solution Architect Expert Senior Manager to join our team. This role is pivotal in building and accelerating solution delivery on our cloud-native Generative AI platform. The ideal candidate will possess a strong background in solution architecture, Gen AI and LLM-based solution delivery,...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOAs the Global IT Platform Engineer Senior Manager & Chapter Lead, you will blend your deep expertise in ServiceNow with a passion for managing, coaching, and developing people in your team. You will directly oversee a chapter of ServiceNow specialists, helping them grow and develop their technical skills, and ensuring alignment on the...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DO* Provide exceptional Level 3 technical support for enterprise AI tools, working closely with internal teams and vendors to ensure smooth operations and rapid problem resolution. * Drive the adoption of productivity tools within the organization by identifying and implementing enhancements that increase efficiency and user satisfaction. *...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOIn your role as the Global IT Software Engineer Senior Manager & Chapter Lead, you will lead the Quality Assurance (QA) chapter within the IT & Business Platforms team at BCG. This team manages critical platforms such as ServiceNow, Jira, Confluence, AdobeSign, UiPath, and Microsoft Power Apps. Embedded within our squad supporting HR...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOThe Expense to Pay squad is actively pursuing a full-stack Senior Software Engineer Manager to join our agile team. As a valued member of our dynamic squad, you will play a crucial role in developing and implementing technical solutions across the entire spectrum of BCG’s timesheet and expense systems. Your responsibilities will involve...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOAs Global IT Senior Infrastructure Developer, you will be responsible for development and technical support of BCG's new GenAI case team assistant.  You will work with a team of internal and external developers, product owners, solution architects and scrum masters to deliver on the roadmap. You will be expected to be hands-on with...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOIn your role as the Global IT Software Engineer Senior Manager & Chapter Lead, you will lead the Quality Assurance (QA) chapter within the IT & Business Platforms team at BCG. This team manages critical platforms such as ServiceNow, Jira, Confluence, AdobeSign, UiPath, and Microsoft Power Apps. Embedded within our squad supporting HR...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a strong candidate to fill the Global IT Infra/Cloud​ Engineer​ position in the Secure Data Squad focusing primarily on Cloud and Data Security. You will be working in a Security Engineering, Architecture and Automation capacity to drive and support improvements within our Secure Infrastructure Platform product portfolio....


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOThe Solution Architect is responsible for the architecture, design, and delivery of cohesive technical solutions across BCG business, primarily focusing on implementation of new solutions, solution enhancements, and system/data integration. The Solution Architect likely will be aligned with one or more business area, such that they can...


  • New Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOAs an IT Service Automation Product Manager, you’ll be responsible for supporting the end-to-end development lifecycle for the “Ava” Automated Virtual Agent GenAI chatbot among other Service Management capabilities. You will work in an Agile environment and directly support the Product Owner to deliver Initiatives with measurable...


  • Delhi, Delhi, India SEVEN CONSULTANCY Full time

    Apply for Senior AI Developer, Career Progress Consultants in Delhi ,Delhi/ NCR for 0 - 3 Year of Experience on


  • Delhi, Delhi, India Boston Consulting Group Full time

    WHAT YOU'LL DOAs a Product Owner delivering automation for IT Service, you'll be responsible for carrying out BCG's bold GenAI agenda to transform the IT customer experience at BCG. This domain is instrumental in realizing our IT & Business Platform's ambition to increase the speed and quality of support for BCG employees as an early adopter of latest tech...


  • Delhi, Delhi, India SEVEN CONSULTANCY Full time

    Apply for Senior AI Data Scientist, Career Progress Consultants in Delhi ,Delhi/ NCR for 0 - 3 Year of Experience on

  • Senior Engineer

    2 months ago


    New Delhi, Delhi, India Bechtel Full time

    Requisition ID: 273232 Relocation Authorized: National - Family Telework Type: Full-Time Office/Project Work Location: Various Bechtel Project Locations Company Overview:Since 1898, we have helped customers complete more than 25,000 projects in 160 countries on all seven continents that have created jobs, grown economies, improved the resiliency of the...


  • Delhi, Delhi, India timesjobs Full time

    # ## About the positionSenior Software Engineer - WebLocation: DelhiEmployment type: Full-timeApply for role: [Apply Now](link)## About usAt Accedo, we're not just a global video solutions provider; we're the architects of extraordinary, world-shaping video-centric experiencesPicture this: a seamless blend of innovation, expertise, and passion that powers...

  • Senior Engineer

    3 months ago


    New Delhi, Delhi, India Bechtel Full time

    Requisition ID: 273230 Relocation Authorized: National - Family Telework Type: Full-Time Office/Project Work Location: Various Bechtel Project Locations Company Overview:Since 1898, we have helped customers complete more than 25,000 projects in 160 countries on all seven continents that have created jobs, grown economies, improved the resiliency of the...