Senior Data Engineer

1 month ago


Gurgaon, Haryana, India BluePi Consulting Private Limited Full time
About BluePi Consulting Private Limited

BluePi Consulting partners with organizations to help them achieve higher levels of maturity. Founded in 2012, it has grown to serve several established organizations across India and Australia. Self-funded, the organization has its sales offices in Mumbai and Sydney, besides its headquarters in Gurgaon. For over a decade, BluePi has helped organizations transform their businesses by providing data-driven business insights. It specializes in custom data analytics and AI/ML solutions that drive business outcomes for organizations. BluePi works with technology partners Amazon Web Services (AWS), Snowflake, Google Cloud Platform (GCP), and Databricks.

Key Responsibilities

Solve complex business problems involving TBs of data. Write performant code to extract, transform, and load data. Integrate and process data in batch and real-time. Work with domain experts in delivering a high-quality solution in an agile environment. Discuss, debate, and develop complex architectures. Follow internal processes while working on tasks/projects like creating LLDs, honoring estimated timelines, clear and quick articulation of dependencies and roadblocks, highlighting any exceptions or technical debt, and working in collaboration with peers, internal, and external (customer).

Requirements

On day one, we expect you to write performant, clean code in PySpark for batch and/or real-time pipelines. Have an in-depth understanding of PySpark APIs to follow best practices and write performant code. Integrate with different source systems to extract data like on-prem/cloud databases, website clickstream, SAP. Understand the scope, design, and business objective of the project. Own and execute the task, helping team members as the project progresses. Run and build ETL on AWS environment. Hence, need an in-depth knowledge of AWS. Understand Lower Level Designs and convert them into correct estimates. Create design documents for tasks along with clarity of test cases. Speak to the team for questions or integrations. Thus, decent communication skills are required. Perform exhaustive debugging and provide solution-oriented approach to a problem.

What Separates the Best from the Rest

  • Medical Insurance: A medical cover of Rs. 3 lacs is provided to the Employee and parents (if married to his/her spouse and kids).
  • Accidental Insurance: An accidental cover of Rs. 10 Lacs is provided to the Employee.

  • Senior Data Engineer

    1 month ago


    Gurgaon, Haryana, India FedEx Full time

    Data Engineer - SeniorFedEx is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures that support our business operations.Key Responsibilities:Develop and maintain scalable data pipelines and...

  • Senior Data Engineer

    1 month ago


    Gurgaon, Haryana, India Habilelabs Pvt. Ltd. Full time

    Job Title: Senior Data EngineerAbout Habilelabs Pvt. Ltd.Habilelabs Pvt. Ltd. is a leading technology company that specializes in developing innovative solutions for the data engineering space. We are seeking a highly skilled and motivated Senior Data Engineer to join our development team in Gurgaon.Job Description:We are looking for a talented Senior Data...


  • Gurgaon, Haryana, India NTT DATA Full time

    Job Title: Senior Software EngineerAs a Senior Software Engineer at {company}, you will be responsible for designing, developing, and maintaining complex software applications. You will work closely with cross-functional teams to ensure timely delivery of high-quality software products.Responsibilities:Design and develop software applications using a variety...

  • Senior Data Engineer

    1 month ago


    Gurgaon, Haryana, India Elite recruitments Full time

    Job Title: Senior Data EngineerJob Summary:Elite recruitments is hiring a seasoned data engineer to join our team. As a senior data engineer, you will be responsible for building efficient data pipelines using tools like Spark, Cloud native tools like EMR, Azure data factory, Informatica, Abinitio. You will also be responsible for understanding the need for...

  • Senior Data Engineer

    1 month ago


    Gurgaon, Haryana, India Petonic Infotech Pvt. Ltd. Full time

    Job TitleSenior Data Engineer Position Overview:Petonic Infotech Pvt. Ltd. is seeking a skilled Senior Data Engineer to play a pivotal role in our AI-driven project development. The ideal candidate will design, develop, and maintain robust data pipelines, manage APIs, and collaborate with data teams to ensure optimal data quality and access. This key role...


  • Gurgaon, Haryana, India Nagarro Full time

    Job Title: Senior Data Platform EngineerJob SummaryWe are seeking an experienced Senior Data Platform Engineer to join our team at Nagarro. The successful candidate will design, develop, and maintain large-scale data processing systems using Azure cloud services and Python.Key ResponsibilitiesDesign and implement data processing pipelines using Azure...


  • Gurgaon, Haryana, India Absolutdata Full time

    Job Title: Senior Alteryx Data EngineerWe are seeking an experienced Alteryx Developer to join our team at Absolutdata.OverviewAs a Senior Alteryx Data Engineer, you will play a key role in designing and developing ETL workflows using Alteryx. Our ideal candidate has a strong background in SQL, experience with Alteryx server and data warehousing, and good...


  • Gurgaon, Haryana, India United Airlines Full time

    Job Overview At United Airlines, we're committed to innovation and excellence in our digital technology solutions. As a Senior Manager, Data Engineering & Development, you'll be part of a team responsible for designing and developing enterprise-wide data and analytics environments. Key Responsibilities: Leading a team of engineers in the development of big...


  • Gurgaon, Haryana, India RENOUS EXTENSERVE PRIVATE LIMITED Full time

    **Job Title:** Senior Data Engineering Lead**Job Summary:** We're seeking a highly experienced Senior Data Engineering Lead to join our engineering team in building and deploying large-scale data systems. The ideal candidate will have a strong technical background, including 8+ years of experience in designing and engineering large-scale systems, and at...


  • Gurgaon, Haryana, India Metyis Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineering Lead to join our team at Metyis. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing solutions.About the RoleThe ideal candidate will have 7+ years of experience in managing and leading data engineering projects,...

  • Senior Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India Coforge Full time

    Job Title: Senior Data EngineerCoforge seeks a highly skilled Senior Data Engineer to join our team. As a key member of our engineering team, you will design, develop, and maintain large-scale data processing systems using Java and Scala.Responsibilities:Design and develop scalable data pipelines using Spark and KafkaCollaborate with cross-functional teams...

  • Senior Data Engineer

    1 month ago


    Gurgaon, Haryana, India Circle K Full time

    About the RoleCircle K is seeking a highly skilled Senior Data Engineer to join our growing Data Engineering team. As a Senior Data Engineer, you will play a key role in partnering with our Technical Development stakeholders to enable analytics for long-term success.Key ResponsibilitiesCollaborate with business stakeholders and other technical team members...


  • Gurgaon, Haryana, India Uncap Research Labs Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Uncap Research Labs. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement scalable data architectures to...

  • Senior Staff Engineer

    1 month ago


    Gurgaon, Haryana, India Nagarro Full time

    Job Title: Senior Staff EngineerJob Summary:We are seeking a highly skilled Senior Staff Engineer to join our team at Nagarro. As a Senior Staff Engineer, you will be responsible for designing and implementing large-scale data processing systems using Azure cloud services and Databricks.Responsibilities:Design and implement data processing systems using...

  • Senior Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India Publicis Sapient Full time

    Position OverviewAs a Senior Data Engineer at Publicis Sapient, you will play a key role in designing and implementing data engineering solutions that drive business value for our clients. With a strong background in big data technologies, you will translate client requirements into technical designs and lead the development of custom solutions.Your Key...


  • Gurgaon, Haryana, India Arrixa Full time

    Arrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...


  • Gurgaon, Haryana, India Metyis Full time

    About the RoleMetyis is a leading international company, and we are seeking a highly skilled Data Engineering Specialist to join our Data Engineering team.Independently execute data engineering projects with high levels of responsibility and client interactions under the guidance of senior team members.Interact with data engineers to drive innovation and...


  • Gurgaon, Haryana, India Lakshya Digital Full time

    Job Title: Senior Software Engineer - Data InfrastructureWe are looking for a highly skilled Senior Software Engineer to join our team. As a Senior Software Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure. This is a challenging and rewarding role that requires a strong understanding of software engineering...


  • Gurgaon, Haryana, India Salesforce Full time

    Job Title: Senior Data Engineer IIIJob Summary: We are seeking a highly skilled Senior Data Engineer III to join our team and lead the development of our data engineering capabilities.Key Responsibilities:Design, develop, and maintain ETL pipelines to ensure reliable and efficient data flow for high-scale data flows.Manage and optimize data storage and...


  • Gurgaon, Haryana, India AXA Group Full time

    Experience the excitement of transforming data into actionable insights as a Senior Data Pipeline Engineer at AXA XL.About UsAXA XL is a leading provider of specialty risk solutions, serving mid-sized companies and multinationals with innovative and flexible approaches to risk management. We're known for combining a comprehensive capital platform,...