Enterprise AI Engineering Leader

3 days ago


Gurgaon, Haryana, India Boston Consulting Group Full time

About Us

Boston Consulting Group is a leading management consulting firm that pioneered strategy consulting more than 50 years ago.

We offer multiple career paths for the world's best talent to have a real impact on business and society.

As part of our team, you will benefit from the breadth and diversity of what we are doing today and where we are headed next.

We count on your authenticity, exceptional work, and strong integrity. In return, we are committed to supporting you in discovering the most fulfilling career journey possible - and unlocking your potential to advance the world.

Our Global Services Team

Our team called Global Services (GS) provides corporate support to business areas such as Finance, Legal, HR, Marketing, and IT.

This diverse team of experts, operators, and specialists represents all levels from Partner to entry-level staff, operating across the globe in multiple countries.

Global Services is in short, the backbone of BCG.


About the Role

We are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI/LLM expertise to join our Gen AI platform team.

This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development.

The ideal candidate will have a strong background in reusable software components, frameworks, microservices, and APIs, cloud infrastructure, and DevOps/MLOps/LLMOps, with a passion for creating scalable, reliable, and efficient systems.

  • Key Responsibilities
  • Being a great hands-on engineer passionate about building platform capabilities.
  • Performing successfully in a fast-paced, multi-cultural, and service-oriented environment.
  • Verbal and written communication at a business and technical level.
  • High-level initiative, self-motivation, resourcefulness, and collaboration.
  • Are passionate, intellectually curious, and enjoy learning new skills and capabilities.
  • Building relationships and reliable team player, displaying consideration and respect for others.
  • Interpreting rules and guidelines flexibly to enhance the business and aligning with BCG's values and culture.
  • Exhibiting ownership and accountability for the squad deliverables.
  • Servicing customer teams/platform users with a strong customer centricity.
  • Attention to detail, well-organized, able to set priorities and take decisions.
  • Being flexible to be available outside of normal business hours for international calls as needed.

Your Colleagues

You will work closely with your Gen AI Platform Engineering chapter in Cloud and Platform Engineering Portfolio Product Owners, Chapter Leads, and other squad members.

Agile Coaches and Scrum Leads will ensure that you adopt agile principles, mindset, and ways of working into your daily routine and who will coach you during the transformation.

About the Requirements

To be successful in this role, you will need:

Experience & Qualifications:

  • A Bachelor's degree in computer science engineering (or equivalent degree or experience).
  • Proven experience in Gen AI, Artificial Intelligence, Machine Learning, or Natural Language Processing.
  • 12+ years of relevant experience in delivering platform or complex technology solutions with a strong technical background, preferably in a global organization/enterprise.
  • 2+ years' experience experimenting and developing with LLMs.
  • 1+ year of experience developing with LLMs for production use cases.
  • 8+ years of experience leading Enterprise scale software engineering/platform engineering teams.
  • Passionate expert in Modern Engineering, DevOps practices - Strong understanding of CI/CD, AI/ML pipelines, and automation tools.
  • Strong knowledge and experience in Generative AI/LLM based development.
  • Strong knowledge and experience in building conversational agent-based UX.
  • Strong experience working with key LLM models APIs (e.g., AWS Bedrock, Azure Open AI/OpenAI) and LLM Frameworks (e.g., LangChain, LlamaIndex).
  • Experience with multi-agent frameworks and an understanding of multi-agent systems and their applications in complex, multi-step problem-solving scenarios.
  • Expertise in building enterprise-grade, secure data ingestion pipelines for unstructured data – including indexing, search, and advanced retrieval patterns.
  • Proficiency in generating and working with text embeddings with understanding of embedding spaces and their applications in semantic search and information retrieval.
  • Knowledge and experience in building knowledge graphs in production.
  • Experience with RAG concepts and fundamentals (VectorDBs, AWS OpenSearch, semantic search, etc.), expertise in implementing RAG systems that combine knowledge bases with Generative AI models.
  • Proficiency in Python, TypeScript, NodeJS, ReactJS (and equivalent) and all associated GenAI libraries and frameworks.
  • Experience with containerization and orchestration technologies (Kubernetes, Docker).

About Benefits and Compensation

We offer a competitive salary package, benefits, and opportunities for professional growth and development.

We strive to provide a collaborative, inclusive, and dynamic work environment.

We believe in recognizing and rewarding individual performance and contributions.

We provide equal opportunities for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity/expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable.

We are an E-Verify Employer and comply with all relevant employment laws and regulations.

Earning Potential: $175,000 - $250,000 per year



  • Gurgaon, Haryana, India Sprinklr Full time

    At Sprinklr, we are seeking a highly skilled AI Research Engineer to join our team of experts in developing cutting-edge artificial intelligence solutions.About the Role:We are looking for a talented individual with expertise in deep learning, machine learning engineering, and software development. As an AI Research Engineer at Sprinklr, you will be...


  • Gurgaon, Haryana, India Kookar AI Full time

    Kookar AI is a pioneering startup on a mission to disrupt the B2C landscape in India. We're developing an AI application that tackles a groundbreaking use case, pushing the boundaries of technology. Founded by industry experts from IIT Bombay and IIT Delhi with over a decade of startup experience, we foster a meritocratic environment where hustle and high...


  • Gurgaon, Haryana, India UnitedHealth Group Full time

    UnitedHealth Group is a global organization dedicated to improving health outcomes by connecting people with care, pharmacy benefits, data, and resources. We foster a culture of diversity and inclusion, offering comprehensive benefits, career development opportunities, and talented peers.The Principal AI/ML Engineer will develop and execute the vision for...


  • Gurgaon, Haryana, India Boston Consulting Group Full time

    About the RoleWe are seeking an experienced Enterprise Software Engineering Lead to join our Gen AI platform team at Boston Consulting Group. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development.Key ResponsibilitiesBecoming a subject matter expert in reusable...

  • AI Leader

    2 weeks ago


    Gurgaon, Haryana, India Axtria India Pvt. Ltd. Full time

    Job DescriptionWe are seeking a seasoned professional to lead our efforts in Generative AI solutions. As an AI Leader, you will be responsible for driving innovation and strategy in this cutting-edge field.

  • Lead AI Engineer

    1 week ago


    Gurgaon, Haryana, India Impetus Full time

    About ImpetusImpetus Technologies is a leading digital engineering company that specializes in delivering expert services and products to help enterprises achieve their transformation goals. Our team of experts solves complex analytics, AI, and cloud puzzles, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data...


  • Gurgaon, Haryana, India Wyzard Full time

    About the RoleAs an AI Engineering Director at Wyzard, you will be instrumental in shaping our engineering team and driving the development of cutting-edge AI solutions. We are seeking a seasoned leader with deep technical expertise and excellent leadership skills to join our team.


  • Gurgaon, Haryana, India Jivi AI Full time

    About Jivi AIJivi AI is a pioneering company leveraging generative AI to revolutionize primary healthcare for millions in India. Our interdisciplinary team comprises talented physicians, surgeons, data scientists, engineers, and designers, working together to harness AI's potential in transforming healthcare.


  • Gurgaon, Haryana, India Expertia AI Full time

    Job DescriptionWe are seeking a highly skilled Storage Infrastructure Specialist to join our team at Expertia AI. As a key member of our technical team, you will be responsible for providing expert-level support and guidance on our enterprise storage and backup platforms.Key Responsibilities:Administer, maintain, and troubleshoot large complex multi-platform...


  • Gurgaon, Haryana, India Kookar AI Full time

    About Kookar AIKookar AI is a cutting-edge startup on a mission to revolutionize the B2C landscape in India. We're building an innovative AI application that addresses a unique use case, something that's never been tackled before.Founded by experienced industry veterans from IIT Bombay and IIT Delhi with over a decade of startup experience, we foster a...


  • Gurgaon, Haryana, India Gloify Full time

    About GloifyGloify is revolutionizing the way technology is applied in the legal and tax sectors with its cutting-edge Generative AI platform. Our platform is designed by industry experts to enhance decision-making, streamline processes, and provide accurate information tailored for the legal domain.Job OverviewWe are seeking an experienced Senior...


  • Gurgaon, Haryana, India Kookar AI Full time

    About KookarKookar is a pioneering startup on a mission to revolutionize the B2C landscape in India. We're developing an AI application that addresses a groundbreaking use case, something that's never been tackled before.Founded by industry veterans from IIT Bombay and IIT Delhi with over a decade of startup experience, we foster a meritocratic and...


  • Gurgaon, Haryana, India Gloify Full time

    About Gloify GPTGloify GPT is a cutting-edge platform that leverages advanced Generative AI technology to revolutionize the legal, tax, and regulatory sectors in India.Position OverviewWe are seeking a seasoned Engineering Head to lead our engineering team in the development of AI/ML and Generative AI solutions.Key Responsibilities- Lead and manage a team of...


  • Gurgaon, Haryana, India UnitedHealth Group Full time

    Unlock your potential in a dynamic environment at UnitedHealth Group, a global leader in healthcare. As an AI/ML Engineering Team Lead, you will play a pivotal role in shaping the future of healthcare technology.We are seeking an exceptional Data Scientist to join our team based in Bangalore. With a strong background in AI/ML and data science, you will be...


  • Gurgaon, Haryana, India Shipsy Full time

    We are seeking a dynamic and results-driven Enterprise Sales Growth Leader to join our team at Shipsy. This is an exciting opportunity to drive revenue growth, build strong client relationships, and strategically position our product in the market.About the RoleAs an Enterprise Sales Growth Leader, you will be responsible for owning all revenue expansion...


  • Gurgaon, Haryana, India Impetus Full time

    About ImpetusWe are a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals.We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune 100...


  • Gurgaon, Haryana, India SAP Full time

    Overview">SAP is a global leader in enterprise software and a pioneer in business process innovation. Our solutions help over 400,000 customers worldwide work more efficiently and make better decisions.We are seeking a highly skilled Senior Data Scientist to join our team of innovative thinkers who are passionate about leveraging AI and ML to drive business...


  • Gurgaon, Haryana, India Leena AI Full time

    Job DescriptionWe are seeking a Product Support Engineer to join our team at Leena AI. As a Product Support Engineer, you will be responsible for providing exceptional technical support to our clients, addressing inquiries, troubleshooting, and resolving issues related to our virtual assistant products.Key Responsibilities:Provide high-quality technical...


  • Gurgaon, Haryana, India Kookar AI Full time

    About Kookar AIWe're a stealth-mode startup founded by IIT Bombay and IIT Delhi alumni, building a groundbreaking Gen AI application addressing a unique challenge. Our mission is to revolutionize the industry through innovation.Job OverviewThis role involves developing and maintaining web applications using React.js and Node.js, collaborating with our team...


  • Gurgaon, Haryana, India Incedo Inc. Full time

    Position:Data and AI Solutions Leader for Wealth Management, GurgaonAbout the Job:Incedo Inc., a leading digital, data, and AI firm, is seeking a seasoned leader to drive the growth of its Data and AI solutions in the Wealth Management sector. The successful candidate will be responsible for developing and executing a strategic plan to expand Incedo's...