
Senior Big Data Engineer
2 weeks ago
Job Summary:
We are seeking a highly skilled and experienced PySpark Developer to join our data engineering team. The ideal candidate will possess 7+ years of expertise in Reltio MDM and design scalable data processing solutions.
Key Responsibilities:
- Develop and maintain PySpark data pipelines on platforms like AWS EMR or Databricks.
- Integrate and synchronize data between enterprise applications and Reltio MDM.
- Design and implement data transformation, cleansing, and enrichment logic.
- Collaborate with architects and analysts for effective data modeling.
- Build and manage API-based integrations between Reltio and upstream/downstream systems.
- Optimize PySpark jobs for performance, scalability, and cost-efficiency.
- Ensure data quality, integrity, and governance throughout the pipeline lifecycle.
- Troubleshoot and resolve data-related and performance issues.
Required Skills & Qualifications:
- 7+ years of hands-on experience in PySpark and distributed data processing.
- Strong command of Apache Spark, Spark SQL, and DataFrames.
- Deep expertise in Reltio MDM (entity modeling, survivorship rules, match & merge configuration).
- Proficiency in REST APIs, JSON, and data integration techniques.
- Experience with AWS services (S3, Lambda, Step Functions).
- Solid understanding of ETL workflows, data warehousing, and data modeling.
- Familiarity with CI/CD pipelines and Git.
- Excellent problem-solving, communication, and collaboration skills.
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Merito Full timeJob Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India WorkiFicient Full timeTo be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...
-
Senior Big Data Engineer
1 week ago
Pune, Maharashtra, India beBeeData Full timeJob DescriptionWe are seeking a highly skilled Big Data Developer to join our team. This individual will be responsible for designing, developing, and maintaining large-scale big data pipelines, real-time systems, and data warehouses.Required Skills and QualificationsCoding Experience: 2-5 years of experience in Java programming with a solid understanding of...
-
Senior Big Data Engineer
3 days ago
Pune, Maharashtra, India Citi Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Description:The Applications Development Senior big Data Engineer is responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to drive applications systems...
-
Senior Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Devlats Pvt Ltd Full time US$ 1,50,000 - US$ 2,00,000 per yearAbout The RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities :Design, develop, and maintain scalable and high-performance data...
-
Senior Big Data Architect
5 days ago
Pune, Maharashtra, India Mycitypune Full timeJob Description- Qualification: Hold a University degree, preferably in Computer Science/IT/Engineering or in a related field- Experience: 3-5 years of hands on experience across Big Data project implementations.- Skills: Familiar with designing high volume and fast big data solutions. Ability to articulate and hold solution discussion with key stakeholders...
-
Big Data Engineer
1 week ago
Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full timeBig Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...
-
Big Data Engineering Lead
2 weeks ago
Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Data Engineering Leader">We are looking for a seasoned Senior Data Engineering Leader to oversee the development and implementation of scalable, distributed data platforms that drive business value.">As a key member of our engineering team, you will be responsible for:">">Designing and architecting high-performance data pipelines that integrate with...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full timeBig Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...
-
Big Data Architecture Expert
6 days ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000Senior Big Data EngineerWe are seeking a highly skilled and experienced Senior Big Data Engineer to fill this role.Design, develop, and maintain scalable and high-performance data processing systems for maximum efficiency.Build robust ETL/ELT workflows for structured and unstructured data using big data technologies like Hadoop, Spark, Hive, HBase, Kafka,...