Data Engineer

1 month ago


Bengaluru, India Boston Consulting Group Full time
Who We Are
Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we work closely with clients to embrace a transformational approach aimed at benefiting all stakeholdersâempowering organizations to grow, build sustainable competitive advantage, and drive positive societal impact.
Our diverse, global teams bring deep industry and functional expertise and a range of perspectives that question the status quo and spark change. BCG delivers solutions through leading-edge management consulting, technology and design, and corporate and digital ventures. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, fueled by the goal of helping our clients thrive and enabling them to make the world a better place.

BCG X

BCG X is the tech build & design unit of BCG. Turbocharging BCG's deep industry and functional expertise, BCG X brings together advanced tech knowledge and ambitious entrepreneurship to help organizations enable innovation at scale. With nearly 3,000 technologists, scientists, programmers, engineers, and human-centered designers located across 80+ cities, BCG X builds and designs platforms and software to address the world's most important challenges and opportunities. Teaming across our practices, and in close collaboration with our clients, our end-to-end global team unlocks new possibilities. Together we're creating the bold and disruptive products, services, and businesses of tomorrow.


Practice Area Profile
What You'll Do
As a part of BCGâs X team, you will work closely with consulting teams on a diverse range of advanced analytics and engineering topics. You will have the opportunity to leverage analytical methodologies to deliver value to BCG's Consulting (case) teams and Practice Areas (domain) through providing analytical and engineering subject matter expertise.As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines, systems, and solutions that empower our clients to make informed business decisions. You will collaborate closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to deliver high-quality data solutions that meet our clients' needs.

YOU'RE GOOD AT 
  • Delivering original analysis and insights to case teams, typically owning all or part of an analytics module whilst integrating with a case team.
  • Design, develop, and maintain efficient and robust data pipelines for extracting, transforming, and loading data from various sources to data warehouses, data lakes, and other storage solutions.
  • Building data-intensive solutions that are highly available, scalable, reliable, secure, and cost-effective using programming languages like Python and PySpark.
  • Deep knowledge of Big Data querying and analysis tools, such as PySpark, Hive, Snowflake and Databricks.
  • Broad expertise in at least one Cloud platform like AWS/GCP/Azure.
  • Working knowledge of automation and deployment tools such as Airflow, Jenkins, GitHub Actions, etc., as well as infrastructure-as-code technologies like Terraform and CloudFormation.
  • Good understanding of DevOps, CI/CD pipelines, orchestration, and containerization tools like Docker and Kubernetes.
  • Basic understanding on Machine Learning methodologies and pipelines.
  • Communicating analytical insights through sophisticated synthesis and packaging of results (including PPT slides and charts) with consultants, collecting, synthesizing, analyzing case team learning & inputs into new best practices and methodologies.

Communication Skills:
  • Strong communication skills, enabling effective collaboration with both technical and non-technical team members.

Thinking Analytically 
  • You should be strong in analytical solutioning with hands on experience in advanced analytics delivery, through the entire life cycle of analytics. Strong analytics skills with the ability to develop and codify knowledge and provide analytical advice where required.


What You'll Bring (Experience & Qualifications)
  • Bachelor's / Master's degree in computer science engineering/technology 
  • At least 2-4 years within relevant domain of Data Engineering across industries and work experience providing analytics solutions in a commercial setting. 
  • Consulting experience will be considered a plus. 
  • Proficient understanding of distributed computing principles including management of Spark clusters, with all included services â various implementations of Spark preferred.
  • Basic hands-on experience with Data engineering tasks like productizing data pipelines, building CI/CD pipeline, code orchestration using tools like Airflow, DevOps etc.

Good to have:- 
  • Software engineering concepts and best practices, like API design and development, testing frameworks, packaging etc.
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB 
  • Knowledge on web development technologies.
  • Understanding of different stages of machine learning system design and development.

YOU'LL WORK WITH 
  • You will work with the case team and/or client technical POCs and border X team.



  • Aptus Data Labs

    2 weeks ago


    Bengaluru, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Data Engineer

    1 day ago


    Bengaluru, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Data Engineer

    2 days ago


    Bengaluru, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Data Engineer

    6 days ago


    Bengaluru, India ANZ Full time

    About the roleData Engineer –Role Type – FTEJob Grade: Group 4.3At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe. The Australia Data tribe sits within our Australia Commercial division and our mission is to combine business & technology...

  • Data Engineer

    2 weeks ago


    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    6 days ago


    Bengaluru, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data EngineerData EngineerReq ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: BengaluruAbout the roleData Engineer –Role Type – FTEJob Grade: Group 4.3At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe....

  • Data Engineer

    2 weeks ago


    Bengaluru, India Ascendion Full time

    Job Title: Data Engineer/ LeadDuration: Full TimeLocation: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid)NOTE: Looking for Immediate Joiners ( 2-3 weeks notice)Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks.Familiarity with Kubeflow, with a preference on hands-on experience.Strong proficiency in Python programming for data...

  • Data Engineer

    6 days ago


    Bengaluru, India Aryng Full time

    Welcome! You made it to the job description page!Aryngis looking for aSenior Data Engineerwith experience in developing enterprise-class distributed data engineering solutions on the cloud. We are seeking an entrepreneurial and technology-proficientData Engineerwho is an expert in theimplementation of a large-scale, highly efficient data platform, batch, and...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NatWest Group Full time

    Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and...

  • Data Engineer

    3 weeks ago


    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    3 weeks ago


    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...


  • Bengaluru, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses. IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing...

  • Data Engineer

    2 weeks ago


    Bengaluru, India Ascendion Full time

    Job Title: Data Engineer/ LeadDuration: Full TimeLocation: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid)NOTE: Looking for Immediate Joiners ( 2-3 weeks notice)- Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks.- Familiarity with Kubeflow, with a preference on hands-on experience.- Strong proficiency in Python programming for data...

  • Data Engineer

    3 days ago


    Bengaluru, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role DescriptionThis is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehousing, and data analytics. The role is based in Bengaluru, with flexibility for some...


  • Bengaluru, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses.IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing Unified...

  • Data Engineer

    15 hours ago


    Bengaluru, India Joveo Full time

    Role:Data EngineerLocation:Hybrid (Bangalore/Hyderabad)About JoveoJoveo was founded in 2017 by a group of visionary entrepreneurs and enthusiastic problem solvers who foresaw the need for greater transparency and predictability in recruitment marketing. The focus was on building a cutting-edge technology platform that uses data and machine learning to enable...

  • Data Engineer

    3 weeks ago


    Bengaluru, India Analog Devices Full time

    Gather business and functional requirements and translate into robust scalable, solutions aligned to the Data Architecture guidelinesHands on development work on all aspects of data analysis, data provisioning, Data modeling, performance tuning and optimizationDesign, implement and operate large scale, high volume, high performance data structures for...

  • Data Engineer

    1 week ago


    Bengaluru, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data Engineer Data Engineer Req ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: Bengaluru About the roleData Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia...

  • Data Engineer

    3 weeks ago


    Bengaluru, India Yara Full time

    ResponsibilitiesParticipate in designing and building data pipelines to collect, manage and store data across different solutions and tools where the data resides for the YAA teams.Monitor, manage and maintain data pipelines as part of the day-to-day data operations.Build data mart tables for various use cases by working with the different data consumers...

  • Data Engineer

    15 hours ago


    Bengaluru, India RaaGaa Value Add Technologies. Full time

    Key Responsibilities:1.Design, develop, and maintain scalable data pipelines and ETL processes to extract, transform, and load large volumes of structured and unstructured data from diverse sources in Batch and Real-time processing.2.Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to...