iKrux - Big Data Tester
1 day ago
Job Description :
We are seeking a highly skilled Big Data Tester with strong expertise in ETL Testing, Hadoop, and Spark/PySpark. The candidate will be responsible for ensuring data quality, validating large-scale data pipelines, and working closely with data engineers and analysts to deliver reliable big data solutions.
Key Responsibilities :
- Validate data transformations, aggregations, and data quality across multiple sources and targets.
- Conduct functional, regression, system integration, and performance testing for big data solutions.
- Write and execute complex SQL and Hive queries to verify data accuracy and consistency.
- Collaborate with data engineers and developers to debug and resolve data issues.
- Design and maintain test plans, test cases, and automation frameworks for big data testing.
- Perform batch and streaming data validation on Hadoop ecosystem components.
- Ensure compliance with data governance, quality, and security standards.
Required Skills & Experience :
- Hands-on expertise in Hadoop ecosystem (HDFS, Hive, HBase, Sqoop, etc.).
- Proficiency in Apache Spark / PySpark for data validation and transformations.
- Strong SQL skills (Oracle, Teradata, MySQL, or similar) for data validation.
- Experience with big data testing strategies including volume, performance, and scalability testing.
- Familiarity with data pipeline orchestration tools (Airflow, Oozie, NiFi, etc.).
- Exposure to test automation frameworks for big data testing is a plus.
- Good analytical, debugging, and problem-solving skills.
-
Big Data
2 weeks ago
Pune, Maharashtra, India Atgeir Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMinimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir's Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required Skills:Work closely with customers, understand customer requirements and render those as architectural...
-
Big Data Lead
2 weeks ago
Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDesignation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...
-
Big Data Architect
2 weeks ago
Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per yearBig Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of data...
-
Big Data Developer
1 week ago
Pune, Maharashtra, India Populace World Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDescription : Big Data DeveloperLocation : Pune, IndiaExperience : 7 YearsAbout the Role : We are seeking a highly experienced and technically proficient Big Data Developer to join our team in Pune. In this role, you will be responsible for designing, developing, and optimizing large-scale data processing pipelines and platforms. The ideal candidate...
-
Big Data Engineer
1 day ago
Pune, Maharashtra, India RiskInsight Consulting Pvt Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per yearResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databasesBuild and maintain scalable data pipelines for effective data ingestion, transformation, and analysisCollaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India FUNIC TECH PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription :Job Opening : Big Data Engineer (7-10 yrs)Location : Aundh, Pune (Work From Office)Job Type : Full-Time | General Shift | Monday FridayKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal...
-
Big Data Developer
2 weeks ago
Pune, Maharashtra, India, Maharashtra UST Full timeWe are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...
-
Big Data Engineer
5 days ago
Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per yearCoforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...
-
Big Data Engineer
3 days ago
Pune, Maharashtra, India Information Technology Full time ₹ 8,00,000 - ₹ 24,00,000 per yearBig Data EngineerKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal solutions. - Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks. -...