Senior Big Data Engineer

2 weeks ago


Pune, Maharashtra, India beBeeDataScientist Full time ₹ 20,00,000 - ₹ 35,00,000

Job Summary:

We are seeking a highly skilled and experienced PySpark Developer to join our data engineering team. The ideal candidate will possess 7+ years of expertise in Reltio MDM and design scalable data processing solutions.

Key Responsibilities:

  • Develop and maintain PySpark data pipelines on platforms like AWS EMR or Databricks.
  • Integrate and synchronize data between enterprise applications and Reltio MDM.
  • Design and implement data transformation, cleansing, and enrichment logic.
  • Collaborate with architects and analysts for effective data modeling.
  • Build and manage API-based integrations between Reltio and upstream/downstream systems.
  • Optimize PySpark jobs for performance, scalability, and cost-efficiency.
  • Ensure data quality, integrity, and governance throughout the pipeline lifecycle.
  • Troubleshoot and resolve data-related and performance issues.

Required Skills & Qualifications:

  • 7+ years of hands-on experience in PySpark and distributed data processing.
  • Strong command of Apache Spark, Spark SQL, and DataFrames.
  • Deep expertise in Reltio MDM (entity modeling, survivorship rules, match & merge configuration).
  • Proficiency in REST APIs, JSON, and data integration techniques.
  • Experience with AWS services (S3, Lambda, Step Functions).
  • Solid understanding of ETL workflows, data warehousing, and data modeling.
  • Familiarity with CI/CD pipelines and Git.
  • Excellent problem-solving, communication, and collaboration skills.

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...


  • Pune, Maharashtra, India beBeeData Full time

    Job DescriptionWe are seeking a highly skilled Big Data Developer to join our team. This individual will be responsible for designing, developing, and maintaining large-scale big data pipelines, real-time systems, and data warehouses.Required Skills and QualificationsCoding Experience: 2-5 years of experience in Java programming with a solid understanding of...


  • Pune, Maharashtra, India Citi Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Description:The Applications Development Senior big Data Engineer is responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to drive applications systems...


  • Pune, Maharashtra, India Devlats Pvt Ltd Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities :Design, develop, and maintain scalable and high-performance data...


  • Pune, Maharashtra, India Mycitypune Full time

    Job Description- Qualification: Hold a University degree, preferably in Computer Science/IT/Engineering or in a related field- Experience: 3-5 years of hands on experience across Big Data project implementations.- Skills: Familiar with designing high volume and fast big data solutions. Ability to articulate and hold solution discussion with key stakeholders...

  • Big Data Engineer

    1 week ago


    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineering Leader">We are looking for a seasoned Senior Data Engineering Leader to oversee the development and implementation of scalable, distributed data platforms that drive business value.">As a key member of our engineering team, you will be responsible for:">">Designing and architecting high-performance data pipelines that integrate with...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior Big Data EngineerWe are seeking a highly skilled and experienced Senior Big Data Engineer to fill this role.Design, develop, and maintain scalable and high-performance data processing systems for maximum efficiency.Build robust ETL/ELT workflows for structured and unstructured data using big data technologies like Hadoop, Spark, Hive, HBase, Kafka,...