Etl QA Pyspark

The ETL Tester is responsible for validating and verifying data extraction transformation and loading processes to ensure data accuracy and integrity This role involves designing and executing test cases identifying data quality issues and collaborating with data engineers to resolve discrepanciesThe ETL Tester will also develop automated testing frameworks...

Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). Develop and maintain robust data pipelines for batch and streaming data using Delta...

ETL QA Develop comprehensive test plans, test cases, and test scripts specifically for SSIS (SQL Server Integration Services) ETL processes. Define testing strategies and methodologies for data integration and data migration projects using SSIS Identify, document, and track defects and inconsistencies in ETL processes. Develop and maintain automated test...

Overall 6years in IT Experience Required technical skills with min 5 years of experience in: ETL QA Informatica ETL Cloud SQL Extensive data analysis skills and expertise in SQL Good communication skills Experience working in agile **About Virtusa** Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody....

Key Responsibilities: Design and develop robust ETL pipelines using Python, PySpark, and GCP services. Build and optimize data models and queries in BigQuery for analytics and reporting. Ingest, transform, and load structured and semi-structured data from various sources. Collaborate with data analysts, scientists, and business teams to understand data...

Keywords:ETL Testing Python PysparkExperience:5 - 10 yearsDesignation / Role:ETL TesterLocation:ChennaiJob Description:ob Overview We are seeking a skilled ETL Tester with strong expertise in Python and PySpark to join our QA team. The role involves validating large-scale data pipelines, ensuring data quality, and automating test processes in modern data...

**Role: Cloud QA Lead** **Work Mode: Hybrid** **Work timings: 2pm to 11pm** **Location: Chennai & Hyderabad** **Primary Skills: Strong ETL Testing, Cloud Services** **Python** Leadership Skills **Secondary Skills** SQL QA Testing with Automation **Detailed JD** Examining the business needs to determine the testing technique by automation...

**Role Description** This is a full-time on-site role for an ETL Tester located in Chennai. The ETL Tester will be responsible for executing test cases, performing software testing, and ensuring quality assurance throughout the ETL process. The ETL Tester will work closely with the development team to identify issues, analyze data, and ensure the accuracy...

Required Skills & ExperienceTechnical Expertise:Strong hands-on experience in Azure Data Factory (ADF) and Databricks.Proficiency in SQL for data validation and reconciliation (including advanced joins, window functions, aggregates).Hands-on experience with PySpark for large-scale data validation and transformations.Strong programming/scripting skills in...

ETL QA with automation - CREQ Description ETL QA with Automation Mandatory Skills Ready API SQL ETL QA Good to have. ETL Automated testing using Java or Python is a plus. Experience in manual testing, Automation Testing, test planning, test case creation, execution, and defect management Good communication and critical thinking Experience with testing...