Senior Big Data Engineer

1 day ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Data Engineer Job Opportunity

We are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with experience working with big data technologies such as PySpark.

This is a great opportunity for someone who wants to work on complex business logic and build scalable data pipelines. If you have hands-on expertise in building data pipelines using PySpark and proficiency in using Spark SQL, DataFrame, and RDD APIs, we want to hear from you.

  • Key Responsibilities:
  • Design, develop, and maintain batch and streaming data pipelines using PySpark.
  • Work with cloud services such as AWS S3, AWS Glue / EMR, and Redshift.
  • Implement complex business logic using Spark APIs.
About the Role

This role involves working on various aspects of data engineering, including designing, developing, and maintaining data pipelines, as well as implementing complex business logic using Spark APIs. The ideal candidate will have a solid understanding of ETL/ELT processes, data transformation, data quality, and performance optimization.

The role requires a strong background in Python programming, with experience working with data structures, algorithms, and software engineering principles. Familiarity with cloud services such as AWS Lambda, Step Functions, and similar orchestration tools is also a plus.

  • Requirements:
  • Strong experience in PySpark and Spark SQL.
  • Hands-on expertise in building scalable data pipelines using PySpark.
  • Proficiency in using Spark APIs to implement complex business logic.
  • Solid coding skills in Python, with strong fundamentals in data structures, algorithms, and software engineering principles.
  • Knowledge of modern data engineering ecosystem, including distributed data processing, storage systems, and workflow orchestration tools.
What We Offer

We offer a collaborative and dynamic work environment, with opportunities for growth and professional development. Our team is passionate about delivering high-quality solutions that meet the needs of our clients. If you are a motivated and experienced Data Engineer looking for a new challenge, we encourage you to apply for this exciting opportunity.

  • Senior Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Citigroup Full time

    The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team The overall objective of this role is to contribute to applications systems analysis and programming...

  • Big Data Engineer

    3 weeks ago

    Pune, Maharashtra, India WorkiFicient Full time

    Roles and Responsibility :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement systems to cleanse,...

  • Senior Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Devlats Pvt Ltd Full time

    About the Role : We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities : - Design, develop, and maintain scalable and high-performance...

  • Senior Big Data Engineer

    11 hours ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Our company is seeking a highly skilled Data Architect to design, develop and implement scalable data solutions using cutting-edge technologies.Key Responsibilities:Data Ingestion and Processing: Develop and maintain high-quality code, adhering to industry standards and best practices, for efficient data ingestion from disparate sources onto our Big Data...

  • Big Data Engineer

    1 day ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITED Full time

    Job Description : We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data environment at an enterprise scale application. You will work...

  • Big Data Engineer

    3 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer">We are seeking a highly skilled Big Data Engineer to drive the design and implementation of scalable data pipelines using Apache Spark, Databricks, or equivalent big data frameworks. This is an excellent opportunity for experienced professionals to join our organization and leverage their expertise to drive business outcomes through...

  • Senior Data Engineer

    5 days ago

    Pune, Maharashtra, India SPIRO Full time

    Position: Senior Data EngineerLocation: PuneExperience: 5+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...

  • Senior Big Data Developer

    1 day ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Big Data Engineer, to join our team. As a key member of our engineering team, you will be responsible for designing and developing large-scale data processing systems.Your primary focus will be on working with Big Data technologies such as Hadoop, Java, and Spark, to ensure the efficient processing and storage of vast amounts...

  • Big Data Engineering Leadership

    19 hours ago

    Pune, Maharashtra, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking ambitious professionals for the role of Lead Apache Hadoop Engineer in our Technology, Data, and Innovation (TDI) team.Key ResponsibilitiesDevelop robust architectures and designs for big data platforms and applications within the Apache Hadoop ecosystem.Implement and deploy big data platforms and solutions on-premises and in...