iKrux - Big Data Tester

3 days ago

Pune, Maharashtra, India IKRUX SOLUTIONS (OPC) PRIVATE LIMITED Full time ₹ 10,00,000 - ₹ 12,00,000 per year

Job Description :

We are seeking a highly skilled Big Data Tester with strong expertise in ETL Testing, Hadoop, and Spark/PySpark. The candidate will be responsible for ensuring data quality, validating large-scale data pipelines, and working closely with data engineers and analysts to deliver reliable big data solutions.

Key Responsibilities :


- Perform end-to-end testing of big data applications, data pipelines, and ETL workflows.

- Validate data transformations, aggregations, and data quality across multiple sources and targets.

- Conduct functional, regression, system integration, and performance testing for big data solutions.

- Write and execute complex SQL and Hive queries to verify data accuracy and consistency.

- Collaborate with data engineers and developers to debug and resolve data issues.

- Design and maintain test plans, test cases, and automation frameworks for big data testing.

- Perform batch and streaming data validation on Hadoop ecosystem components.

- Ensure compliance with data governance, quality, and security standards.

Required Skills & Experience :


- Strong experience in ETL Testing with a solid understanding of data warehousing concepts.

- Hands-on expertise in Hadoop ecosystem (HDFS, Hive, HBase, Sqoop, etc.).

- Proficiency in Apache Spark / PySpark for data validation and transformations.

- Strong SQL skills (Oracle, Teradata, MySQL, or similar) for data validation.

- Experience with big data testing strategies including volume, performance, and scalability testing.

- Familiarity with data pipeline orchestration tools (Airflow, Oozie, NiFi, etc.).

- Exposure to test automation frameworks for big data testing is a plus.

- Good analytical, debugging, and problem-solving skills.

  • Big Data Tester

    1 day ago

    Pune, Maharashtra, India Shavish Hr And Digital Marketing Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Big data Tester have a good Big Data testing, focusing on both automated & manual testing for data validation.Strong understanding of Hadoop ecosystem.Skilled in writing & executing SQL queries. Hands-on exp. with JIRA or Bugzilla.

  • Junior Tester

    1 day ago

    Pune, Maharashtra, India Data Engine Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Job Title: Jr. TesterJob Description:We are looking for a Software & Embedded Systems Tester to work on testing software, embedded systems, and IoT devices. The candidate will be responsible for preparing and conducting test cases, validating functionalities, and working with development teams to ensure quality.Key Responsibilities:Conduct test cases for...

  • Big Data

    2 weeks ago

    Pune, Maharashtra, India Atgeir Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir's Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required Skills:Work closely with customers, understand customer requirements and render those as architectural...

  • Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of data...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : Big Data DeveloperLocation : Pune, IndiaExperience : 7 YearsAbout the Role : We are seeking a highly experienced and technically proficient Big Data Developer to join our team in Pune. In this role, you will be responsible for designing, developing, and optimizing large-scale data processing pipelines and platforms. The ideal candidate...

  • Big Data Developer

    1 day ago

    Pune, Maharashtra, India Wroots Global Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Engineer / Software EngineerLocation: Pune Kharadi (Client Location) | WFO 3 days a weekExperience: 6 to 10 yearsJob Description:We are hiring an experienced Software Engineer with strong expertise in big data and cloud technologies.Key Skills:Hands-on experience in Scala / Java / PythonStrong knowledge of Big Data technologies: Spark,...

  • Big Data Engineer

    3 days ago

    Pune, Maharashtra, India RiskInsight Consulting Pvt Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databasesBuild and maintain scalable data pipelines for effective data ingestion, transformation, and analysisCollaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India FUNIC TECH PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description :Job Opening : Big Data Engineer (7-10 yrs)Location : Aundh, Pune (Work From Office)Job Type : Full-Time | General Shift | Monday FridayKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal...

  • Big Data Engineer

    1 day ago

    Pune, Maharashtra, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greetings from TCSTCS is hiring forBig DataLocation: -Chennai/Mumbai/PuneDesired Experience Range:6 to 12 yearsMust-Have• PySpark • HiveGood-to-Have• Spark • HBase • DQ tool • Agile Scrum experience • Exposure in data ingestion from disparate sources onto Big Data platformThanksAnshika