Etl Testing with Pyspark

5 days ago

Chennai Tamil Nadu, India Virtusa Full time

The ETL Tester is responsible for validating and verifying data extraction transformation and loading processes to ensure data accuracy and integrity This role involves designing and executing test cases identifying data quality issues and collaborating with data engineers to resolve discrepanciesThe ETL Tester will also develop automated testing frameworks to enhance testing efficiency and coverage A strong understanding of ETL processes and data warehousing concepts is essential for success in this role
Minimum Qualification
At least 8 years of IT experience with minimum 5 years of ETL QA experience with below skills
Work experience in ETL testing
Proficiency in SQL with ability to write complex queries in big data ecosystem
Should possess PySpark Work experience
Testing experience in cloud environment AWS
S3 SSS Glue EMR Data Catalog Crawler SQS ETL Jobs Event Bridge
Athena Redshift Spectrum Databases
AWS Commands for running the jobs file process and movements
Experience with Test Automation and DevOps practices in ETL Cloud Systems
Extensive data analysis skills and knowledge in scripting to optimize data testing
Good to have knowledge in Healthcare Insurance
Experience working in Agile team

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Etl Databricks with Aws

    23 hours ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). Develop and maintain robust data pipelines for batch and streaming data using Delta...

  • Etl Testing

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Key Responsibilities: Collaborate with the ETL development team and business stakeholders to understand the ETL workflows and data requirements. Create and execute test plans, test cases, and test scripts for ETL processes and data pipelines. Perform data validation and verification to ensure that the data extracted, transformed, and loaded by the ETL...

  • Pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Skill**: Pyspark **Experience**: 6 to 13 years **Location**: Bhubaneswar **Job description**: - Develop and maintain scalable data pipelines using Python and PySpark. - Collaborate with data engineers and data scientists to understand and fulfill data processing needs. - Write clean, efficient, and well-documented code following best practices. -...

  • Etl Testing

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Key skills**: ETL Testing **Experience**: 6 to 9 years **Location**: Bhubaneswar **Job Summary**: We are seeking a detail-oriented and experienced Testing Engineer to join our team. The ETL Testing Engineer will be responsible for designing, executing, and automating test cases to ensure the quality and integrity of data extracted, transformed, and...

  • ETL Testing Pyspark

    4 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    At least 6 years of IT experience with minimum 5 years of experience in below skillsTech SkillsProficiency in ETL Testing and developing automation framework testcases in atleast one scripting languageExperience in Pypark is MandatoryStrong SQL skills with experience in handling big data using ETL tools eg InformaticaTesting experience in cloud environment...

  • ETL tester

    2 weeks ago

    Chennai, Tamil Nadu, India Novature Tech Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Keywords:ETL Testing Python PysparkExperience:5 - 10 yearsDesignation / Role:ETL TesterLocation:ChennaiJob Description:ob Overview We are seeking a skilled ETL Tester with strong expertise in Python and PySpark to join our QA team. The role involves validating large-scale data pipelines, ensuring data quality, and automating test processes in modern data...

  • Etl Testing

    6 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Essential technical skills include proficiency in Oracle SQL and Unix. Experience with automation tools is also required Excellent hands on knowledge and experience in ETL testing Good hands on knowledge and experience in automation testing and tools ETL Testing Core Testing Data Validation skills Oracle SQL Unix Data warehousing Concepts Automation...

  • Etl Testing

    3 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Design and execute test plans for ETL processes, ensuring data accuracy, completeness, and integrity. Develop automated test scripts using Python or R for data validation and reconciliation. Perform source-to-target data verification, transformation logic testing, and regression testing. Collaborate with data engineers and analysts to understand business...

  • Data Engineer

    5 days ago

    Chennai, India Ixceed Solutions Full time

    Role : Data Engineer Location : Chennai (Hybrid).Job Description : Key Responsibilities : - Lead the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks). - Develop and maintain data processing workflows using PySpark and Python. - Collaborate with data scientists, analysts, and business...

  • Data Testing

    6 days ago

    Chennai, Tamil Nadu, India Citigroup Full time

    The Testing Analyst 2 is a developing professional role. Applies specialty area knowledge in monitoring, assessing, analyzing and/or evaluating processes and data. Identifies policy gaps and formulates policies. Interprets data and makes recommendations. Researches and interprets factual information. Identifies inconsistencies in data or results, defines...