Big Data/ETL Test Engineer

4 days ago


Remote, India Gama Advisory Services LLP Full time

Overview :

We are seeking a proficient Big Data/ETL Test Engineer with 4-6 years of experience in testing Big Data platforms and ETL processes, specifically using Hadoop and Hive technologies.

As a Test Engineer, you will play a critical role in ensuring the quality and reliability of our Big Data solutions by designing and executing comprehensive test strategies.

Your expertise in Big Data testing methodologies, Hadoop, and Hive will contribute to the successful deployment and optimization of our data pipelines.

Responsibilities :

- Develop and execute test plans, test cases, and test scripts for Big Data applications, focusing on ETL processes using Hadoop and Hive.

- Perform functional, integration, regression, and performance testing of data pipelines and ETL workflows.

- Collaborate with data engineers, developers, and data scientists to understand system requirements and data transformations.

- Design and implement automated test scripts and frameworks for continuous testing and integration.

- Identify, isolate, document, and track defects throughout the testing lifecycle.

- Monitor and analyze system performance metrics to ensure scalability, reliability, and efficiency of data processing.

- Participate in troubleshooting and debugging of issues related to data ingestion, processing, and output validation.

- Document testing processes, methodologies, and results for stakeholders and project teams.

- Stay updated with emerging technologies and best practices in Big Data testing, Hadoop, and Hive ecosystems.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or related field.

- 4-6 years of experience as a Test Engineer or QA Engineer, with a focus on Big Data testing and ETL processes.

- Proficiency in testing Big Data technologies such as Hadoop, Hive, HBase, etc.

- Hands-on experience in writing complex SQL queries for data validation and analysis.

- Strong understanding of ETL concepts, data warehousing, and data modeling principles.

- Experience with scripting languages (e.g, Python, Shell scripting) for test automation.

- Familiarity with tools like Apache NiFi, Sqoop, or Kafka for data ingestion and integration.

- Excellent analytical and problem-solving skills with attention to detail.

- Effective communication and collaboration skills to work in a team-oriented environment.

Preferred Qualifications :

- Certification in Big Data or Software Testing (e.g, ISTQB, Cloudera Certified Professional).

- Knowledge of cloud platforms (e.g, AWS, Azure, GCP) and their Big Data services.

- Experience with distributed computing frameworks (e.g, Spark, MapReduce).

- Understanding of Agile/Scrum methodologies and continuous integration/continuous deployment (CI/CD) pipeline.

(ref:hirist.tech)

  • Remote, IN Gama Advisory Services LLP Full time

    Overview :We are seeking a proficient Big Data/ETL Test Engineer with 4-6 years of experience in testing Big Data platforms and ETL processes, specifically using Hadoop and Hive technologies. As a Test Engineer, you will play a critical role in ensuring the quality and reliability of our Big Data solutions by designing and executing comprehensive test...


  • Remote, India MindBrain Full time

    Job Title - Big Data Engineer. Location - Remote. Contractual - Duration 1 yr. Responsibilities :- Design, build, and maintain large-scale data processing systems (batch and streaming) using technologies such as Hadoop, Spark, Kafka, etc.- Develop and optimize data pipelines, data ingestion processes, and data integration workflows.- Implement data...


  • Remote, IN MindBrain Full time

    Job Title - Big Data Engineer. Location - Remote. Contractual - Duration 1 yr. Responsibilities :- Design, build, and maintain large-scale data processing systems (batch and streaming) using technologies such as Hadoop, Spark, Kafka, etc.- Develop and optimize data pipelines, data ingestion processes, and data integration workflows.- Implement data...

  • Etl Testing

    3 weeks ago


    Remote, India KEG HR Services Full time

    **Greetings From KEG HR Services!** Job Role: ETL Testing Experience:10+years Job Description: - Designing, testing, and debugging a company's data storage system before it starts its operation. - Performing validation of data sources. - Uploading data to the target tables. - Developing and executing test plans, test cases, and test scripts to validate...

  • Neurones IT

    2 days ago


    Remote, India IT AISA Full time

    Job Description : - As a Data engineer, you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks.- Designing and delivering software using an agile and iterative approach based on Scrum or Kanban.- Following and contributing to improvement of client's software engineering practices...

  • Neurones IT

    3 days ago


    Remote, IN IT AISA Full time

    Job Description :- As a Data engineer, you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks.- Designing and delivering software using an agile and iterative approach based on Scrum or Kanban.- Following and contributing to improvement of client's software engineering practices...

  • Big Data

    4 weeks ago


    Remote, India Technology Next Full time

    **Big Data AI/ML Engineer** **Experience**: 6 to 9 Yrs **Location**:Remote **Tenure: - **6 Months **Salary: - ** 80K-90K In hand **Notice**:Immediate Joiner We are seeking a talented Data Engineer with AI & ML knowledge to join our team. As Data Engineer or ML Ops Engineer, your primary responsibility will be to develop & integrate ML solutions that...

  • Data QA/etl Tester

    3 weeks ago


    Remote, India Agilite Global Solutions Company Full time

    **Location**:India, Remote (Work from Anywhere in India) **Minimum Qualification**:B. Tech. (or equivalent) from an accredited institution **Indicative Experience**:5+ Years **Domain**:Preferably in Life-sciences / Pharma. **Customer Profile**:Captive research and development pods for a $ 500 million group of pharma data research companies that help...

  • Etl Tester

    1 week ago


    Remote, India Mindtel Global Private Limited Full time

    We are looking for a detail-oriented and experienced ETL (Extract, Transform, Load) Testing Engineer to join our team. As an ETL Testing Engineer, you will be responsible for ensuring the accuracy, completeness, and performance of data extraction, transformation, and loading processes. You will collaborate with cross-functional teams to design, execute, and...

  • Etl Tester

    2 weeks ago


    Remote, India Mindtel Global Private Limited Full time

    We are looking for a detail-oriented and experienced ETL (Extract, Transform, Load) Testing Engineer to join our team. As an ETL Testing Engineer, you will be responsible for ensuring the accuracy, completeness, and performance of data extraction, transformation, and loading processes. You will collaborate with cross-functional teams to design, execute, and...

  • Senior Data Engineer

    4 weeks ago


    Remote, India Nthinsight Full time

    Job Description : We are seeking a skilled and experienced Data Engineer with expertise in Python, data warehousing, ETL (Extract, Transform, Load), and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with...

  • Senior Data Engineer

    4 weeks ago


    Remote, IN Nthinsight Full time

    Job Description :We are seeking a skilled and experienced Data Engineer with expertise in Python, data warehousing, ETL (Extract, Transform, Load), and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with cross-functional...


  • Remote, India Diatoz Solutions Full time

    A Senior Data Engineer Specializing In Snowflake And ETL (Extract, Transform, Load) Processes Is Responsible For Designing, Implementing, And Maintaining Data Infrastructure And Pipelines To Ensure Data Is Efficiently Extracted From Various Sources, Transformed Into Usable Formats, And Loaded Into Data Warehouses Or Data Lakes.Responsibilities : -...


  • Remote, IN Diatoz Solutions Full time

    A Senior Data Engineer Specializing In Snowflake And ETL (Extract, Transform, Load) Processes Is Responsible For Designing, Implementing, And Maintaining Data Infrastructure And Pipelines To Ensure Data Is Efficiently Extracted From Various Sources, Transformed Into Usable Formats, And Loaded Into Data Warehouses Or Data Lakes.Responsibilities :- Developing...

  • Data Architect

    1 week ago


    Remote, India Thinkreh Full time

    Hiring Azure Data Architects - Remote Minimum Exp - 10 Years Only immediate joiners shall apply Experience Experience of working with large, event based, datasets in an enterprise environment. Minimum 10 years within an Azure or SQL Data Engineering environment Engineering and database skills in SQL Server and/or Azure (Data Factory, Synapse) and the...


  • Remote/Bangalore/Pune, IN TechTiv Software Solutions Full time

    The Opportunity :Digit88 development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate would be joining an existing team of outstanding data...

  • Etl Tester

    4 weeks ago


    Remote, India Pennsylvania Enterprise Full time

    **Overview** **Key Responsibilities**: - Develop and execute ETL test plans and scenarios tailored for GxP-compliant environments and life sciences projects. - Perform data validation, reconciliation, and integrity checks to ensure accuracy and compliance with regulatory standards (e.g., FDA regulations, GAMP guidelines). - Collaborate closely with...

  • Etl Tester

    2 weeks ago


    Remote, India Pennsylvania Enterprise Full time

    OverviewKey Responsibilities: Develop and execute ETL test plans and scenarios tailored for GxPcompliant environments and life sciences projects. Perform data validation, reconciliation, and integrity checks to ensure accuracy and compliance with regulatory standards (e.g., FDA regulations, GAMP guidelines). Collaborate closely with stakeholders, including...

  • Etl Tester

    3 weeks ago


    Remote, India Tech Pundits Full time

    hope you are doing well. Greetings From Tech Pundits Job Title: ETL Tester with PLSQL Role: - Sr ETL Tester Experience: - 8 to 12 years Mode: - Remote Timings: - 5 PM IST to 1 AM IST Location: - India [Remote]/ work from home NP: - Immediate Joiner /1 month Skills: ETL tester with PLSQL background, excellent SQL skills; Good to have - SFDC...

  • Etl Tester

    3 weeks ago


    Remote, India HIRINGHOUSE TECHNOLOGIES PVT LTD Full time

    **Roles and Responsibilities: - ** - **Collaborate with Data Warehouse teams** **to promote effective utilization of data as well as tools for analytics relevant to the business needs**. - Prepare and deliver reports, recommendations or alternatives that address existing and potential trouble areas in IT systems and projects across the Enterprise. - Test...