ETL QA Pyspark

3 days ago

Chennai, Tamil Nadu, India Virtusa Full time ₹ 1,20,000 - ₹ 12,00,000 per year

ETL QA

Position Summary

The Sr QA is responsible for ensuring the quality and reliability of ETL processes and data integration workflows This role involves designing and implementing automated tests to validate data transformation and migration as well as collaborating with data engineers and developers to identify and resolve data quality issues The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity

Minimum Qualification

At least 7 years of IT experience with minimum 5 years of experience in below skills

Tech Skills

Proficiency in ETL Testing and developing automation framework testcases in atleast one scripting language

Strong SQL skills with experience in handling big data using ETL tools eg Informatica

Testing experience in cloud environment AWS s3

Experience with Test Automation and DevOps practices in ETL and Cloud

Experience providing testing oversight in Agile team

Should have excellent business communication to interact with Business teams and crossfunctional teams

Responsibilities

Review requirements specifications and technical design documents to understand and feedback

Experience in developing and implementing test strategies for complex initiatives

Estimate prioritize plan and coordinate testing activities

Create automation test framework

Design develop and execute automation scripts

Identify record document thoroughly and track bugs

Strong problem solving skills troubleshooting and root cause analysis skills

Perform thorough regression testing when bugs are resolved

Develop and apply testing processes for new and existing features to meet client needs

Liaise with cross functional teams to identify system requirements

Track quality assurance metrics like defect densities and open defect counts

Stay up to date with new testing tools and test strategies requirements

Support and guide junior team members

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • ETL Testing

    6 days ago

    Chennai, Tamil Nadu, India Kumaran Systems Full time ₹ 2,50,000 - ₹ 7,50,000 per year

    Required Skills & ExperienceTechnical Expertise:Strong hands-on experience in Azure Data Factory (ADF) and Databricks.Proficiency in SQL for data validation and reconciliation (including advanced joins, window functions, aggregates).Hands-on experience with PySpark for large-scale data validation and transformations.Strong programming/scripting skills in...

  • Pyspark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India MP DOMINIC AND CO Full time

    Job Summary - Design develop and implement scalable data pipelines and streaming use cases using PySpark and Spark on a distributed computing platform - Possess strong programming skills in Spark streaming - Have familiarity with cloud platforms like GCP - Gain experience in big data technologies such as Hadoop Hive and HDFS - Perform ETL operations...

  • etl qa

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position SummaryThe Sr QA is responsible for ensuring the quality and reliability of ETL processes and data integration workflows This role involves designing and implementing automated tests to validate data transformation and migration as well as collaborating with data engineers and developers to identify and resolve data quality issues The ideal...

  • Etl Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Decision Point Full time ₹ 2,50,000 - ₹ 7,50,000 per year

    Key Responsibilities:Design, develop, and optimize scalable and reliable ETL pipelines using Python and PySpark.Extract data from diverse data sources and transform it to meet analytical and business needs.Implement robust data validation, error handling, and quality checks within ETL pipelines.Work with large-scale datasets and ensure efficient performance...

  • ETL Support Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Star Health Insurance Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    ETL Support Engineer:Maintain ETL pipelines using Databricks and PySpark to extract, transform, and load data from various sources.Troubleshoot and resolve issues related to data transformations or loading processes in Databricks.Develop and maintain documentation for ETL processes, configurations, and data mappings.Strong proficiency in Databricks with...

  • Sr ETL QA Analyst

    6 days ago

    Chennai, Tamil Nadu, India Kiash Solution Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    ETL, QA Analyst, AWS, Apache NiFi, Azure, BigQuery, Design, HP ALM, Informatica, JIRA, Oracle, SQL queries, SSIS, Talend, TestRail, Cloud, Data Extraction, Data Integrity, Data Quality, Data Validation, Data Warehousing.

  • ETL Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Decision Point Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Roles and Responsibilities:Design, develop, and maintain scalable ETL pipelines using PySpark and Python for large-scale data processing.Work closely with data architects and analysts to understand business requirements and translate them into technical solutions.Develop and optimize SQL queries for data extraction, transformation, and loading from various...

  • ETL Tester

    24 hours ago

    Chennai, Tamil Nadu, India Iris Software Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ETL Tester - Senior QA We're hiring for ETL Tester - Senior QA. Skills :- ETL Testing, DWH testing, SQL Queries (complex queries). Experience :- 6 to 9 yrs What we're looking for :- 6 + Yrs of experience in ETL/DWH Testing Strong expertise in SQL- advanced queries, window functions(ROW_NUMBER,RANK,DENSE_RANK,LAG/LEAD),aggregations,...

  • ETL QA with MDM Lead

    5 days ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    QA Lead (12+ Years Experience)Job Title: QA Lead (Insurance Domain, Automation Testing)Experience: 12+ YearsDomain Expertise: Property and Casualty InsuranceProfessional SummaryExperienced QA Lead with over 12 years in the insurance domain, specializing in automation testing for MDM and data integration platforms. Leads QA strategy and execution across...

  • Pyspark Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Prowesstics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilledData Engineerwith hands-on experience inPySparkandDatabricksto design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams.Key Responsibilities:Develop...