iKrux - Big Data Tester

13 hours ago

Pune, Maharashtra, India IKRUX SOLUTIONS (OPC) PRIVATE LIMITED Full time ₹ 10,00,000 - ₹ 12,00,000 per year

Job Description :

We are seeking a highly skilled Big Data Tester with strong expertise in ETL Testing, Hadoop, and Spark/PySpark. The candidate will be responsible for ensuring data quality, validating large-scale data pipelines, and working closely with data engineers and analysts to deliver reliable big data solutions.

Key Responsibilities :


- Perform end-to-end testing of big data applications, data pipelines, and ETL workflows.

- Validate data transformations, aggregations, and data quality across multiple sources and targets.

- Conduct functional, regression, system integration, and performance testing for big data solutions.

- Write and execute complex SQL and Hive queries to verify data accuracy and consistency.

- Collaborate with data engineers and developers to debug and resolve data issues.

- Design and maintain test plans, test cases, and automation frameworks for big data testing.

- Perform batch and streaming data validation on Hadoop ecosystem components.

- Ensure compliance with data governance, quality, and security standards.

Required Skills & Experience :


- Strong experience in ETL Testing with a solid understanding of data warehousing concepts.

- Hands-on expertise in Hadoop ecosystem (HDFS, Hive, HBase, Sqoop, etc.).

- Proficiency in Apache Spark / PySpark for data validation and transformations.

- Strong SQL skills (Oracle, Teradata, MySQL, or similar) for data validation.

- Experience with big data testing strategies including volume, performance, and scalability testing.

- Familiarity with data pipeline orchestration tools (Airflow, Oozie, NiFi, etc.).

- Exposure to test automation frameworks for big data testing is a plus.

- Good analytical, debugging, and problem-solving skills.

  • iKrux - Big Data Engineer - Python/Scala

    2 weeks ago

    Pune, Maharashtra, India Ikrux Engineeering Full time

    We are seeking a highly skilled and motivated Big Data Engineer with strong experience in building, optimizing, and managing large-scale data processing pipelines. The ideal candidate will have hands-on expertise in Scala, Python, Apache Spark, Kafka, and/or Apache NiFi, and will work closely with cross-functional teams to design and implement scalable data...

  • iKrux - Data Engineer - Java/ETL

    3 weeks ago

    Pune, Maharashtra, India Ikrux Engineeering Full time

    Role : Data EngineerWe are looking for an experienced Data Engineer with a strong foundation in Java, AWS, SQL, and Apache Spark to join our growing data engineering team. The ideal candidate will be responsible for building scalable data pipelines, ensuring data quality and reliability, and contributing to the overall data infrastructure.Key...

  • Capco - Big Data Tester - Python/PySpark

    3 weeks ago

    Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

    Position : Big Data TesterExperience : 5-9 YearsLocation : Pune, IndiaJob Summary :We are seeking an experienced Big Data Tester with 5-9 years of experience in software quality assurance, with a dedicated focus on data. The ideal candidate will have a strong background in Python, PySpark, and SQL, along with a proven track record of implementing best...

  • Big Data

    2 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-Have- PySpark- HiveGood-to-Have- Spark- HBase- DQ tool- Agile Scrum experience- Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data

    2 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS Skill: Big Data Years of Experience: 6 - 12 years Location: Pune/ Mumbai/ Chennai Notice Period: 0 - 45 days Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data

    3 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS Skill: Big Data Years of Experience: 6 - 12 years Location: Pune/ Mumbai/ Chennai Notice Period: 0 - 45 days Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India MRO Full time

    Analyst - Big Data DeveloperWe are seeking a highly skilled Analyst -Big Data Developer to join our dynamic team.The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.You will be responsible for designing, implementing, and maintaining...

  • Data Tester

    3 weeks ago

    Pune, Maharashtra, India Gravity Infosolutions Full time

    Position: Data Tester - Snowflake Experience Required: 6+ Years Type: Full Time Location: Bangalore/Pune/Chennai and Hyderabad About the Role We are seeking a Data Tester with strong hands-on expertise in Snowflake and proven experience in validating data migrations, transformations, and pipelines . This role is critical to ensuring data accuracy,...

  • Data Tester

    4 weeks ago

    Pune, Maharashtra, India Gravity Infosolutions Full time

    Position: Data Tester - SnowflakeExperience Required: 6+ YearsType: Full TimeLocation: Bangalore/Pune/Chennai and HyderabadAbout the RoleWe are seeking a Data Tester with strong hands-on expertise in Snowflake and proven experience in validating data migrations, transformations, and pipelines. This role is critical to ensuring data accuracy, quality, and...

  • Data Tester

    3 weeks ago

    Pune, Maharashtra, India Gravity Infosolutions Full time

    Position: Data Tester - Snowflake Experience Required: 6+ Years Type: Full Time Location: Bangalore/Pune/Chennai and Hyderabad About the Role We are seeking a Data Tester with strong hands-on expertise in Snowflake and proven experience in validating data migrations, transformations, and pipelines.This role is critical to ensuring data accuracy, quality, and...