Etl Testing with Pyspark

4 days ago

Chennai Tamil Nadu, India Virtusa Full time

The ETL Tester is responsible for validating and verifying data extraction transformation and loading processes to ensure data accuracy and integrity This role involves designing and executing test cases identifying data quality issues and collaborating with data engineers to resolve discrepanciesThe ETL Tester will also develop automated testing frameworks to enhance testing efficiency and coverage A strong understanding of ETL processes and data warehousing concepts is essential for success in this role
Minimum Qualification
At least 8 years of IT experience with minimum 5 years of ETL QA experience with below skills
Work experience in ETL testing
Proficiency in SQL with ability to write complex queries in big data ecosystem
Should possess PySpark Work experience
Testing experience in cloud environment AWS
S3 SSS Glue EMR Data Catalog Crawler SQS ETL Jobs Event Bridge
Athena Redshift Spectrum Databases
AWS Commands for running the jobs file process and movements
Experience with Test Automation and DevOps practices in ETL Cloud Systems
Extensive data analysis skills and knowledge in scripting to optimize data testing
Good to have knowledge in Healthcare Insurance
Experience working in Agile team

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Etl Databricks with Aws

    3 hours ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). Develop and maintain robust data pipelines for batch and streaming data using Delta...

  • ETL Test Architect

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Lead the end to end testing process for ETL workflows, data pipelines, and data warehouse solutions.Collaborate with business analysts, developers, and data engineers to understand data requirements and transformation logic.Design and develop comprehensive test strategies, test cases, and test data to validate ETL processes.Perform data validation,...

  • Etl Testing

    1 week ago

    Chennai, Tamil Nadu, India Novature Tech Full time

    Keywords: PLSQL,RDBMS databases, SQL scripts., ETL Testing **Experience**: 6 - 10 years Designation / Role: ETL Tester **Location**: Chennai **Job Description**: Key skills: Data-PLSQL,RDBMS databases, SQL scripts., ETL Testing JD: Python, SQL, Snowflake, Oracle PL/SQL, Database Model 3NF, Microsoft Power BI Snowflake, Requirements Engineering,...

  • Pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Skill**: Pyspark **Experience**: 6 to 13 years **Location**: Bhubaneswar **Job description**: - Develop and maintain scalable data pipelines using Python and PySpark. - Collaborate with data engineers and data scientists to understand and fulfill data processing needs. - Write clean, efficient, and well-documented code following best practices. -...

  • Etl Testing

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Key Responsibilities: Collaborate with the ETL development team and business stakeholders to understand the ETL workflows and data requirements. Create and execute test plans, test cases, and test scripts for ETL processes and data pipelines. Perform data validation and verification to ensure that the data extracted, transformed, and loaded by the ETL...

  • Etl Testing

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Key skills**: ETL Testing **Experience**: 6 to 9 years **Location**: Bhubaneswar **Job Summary**: We are seeking a detail-oriented and experienced Testing Engineer to join our team. The ETL Testing Engineer will be responsible for designing, executing, and automating test cases to ensure the quality and integrity of data extracted, transformed, and...

  • ETL Testing Pyspark

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    At least 6 years of IT experience with minimum 5 years of experience in below skillsTech SkillsProficiency in ETL Testing and developing automation framework testcases in atleast one scripting languageExperience in Pypark is MandatoryStrong SQL skills with experience in handling big data using ETL tools eg InformaticaTesting experience in cloud environment...

  • ETL Testing

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    Greetings from TATA CONSULTANCY SERVICES!Skill: ETL TestingYears of Experience: 5 - 10 yearsLocation: Chennai/ BangaloreJob Description:-Key Responsibilities:Create test cases, test plans, and perform SIT of ETL toolscodeWrite sql queries to perform QA of ETL codeFind defects in ETL code and document them in jiraAttend scrum calls, provide status...

  • ETL Testing

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    Greetings from TATA CONSULTANCY SERVICES! Skill: ETL Testing Years of Experience: 5 - 10 years Location: Chennai/ Bangalore Job Description:- Key Responsibilities: Create test cases, test plans, and perform SIT of ETL tools code Write sql queries to perform QA of ETL code Find defects in ETL code and document them in jira Attend scrum calls, provide status...

  • Etl Testing

    6 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Essential technical skills include proficiency in Oracle SQL and Unix. Experience with automation tools is also required Excellent hands on knowledge and experience in ETL testing Good hands on knowledge and experience in automation testing and tools ETL Testing Core Testing Data Validation skills Oracle SQL Unix Data warehousing Concepts Automation...