Sr ETL QA Pyspark

5 days ago

Bengaluru, Karnataka, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Position Summary

The Sr QA is responsible for ensuring the quality and reliability of ETL processes and data integration workflows This role involves designing and implementing automated tests to validate data transformation and migration as well as collaborating with data engineers and developers to identify and resolve data quality issues The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity

Minimum Qualification

At least 8 years of IT experience with minimum 5 years of experience in below skills

Tech Skills

Proficiency in ETL Testing and developing automation framework testcases in atleast one scripting language

Experience in Pypark is Mandatory

Strong SQL skills with experience in handling big data using ETL tools eg Informatica

Testing experience in cloud environment AWS s3

Experience with Test Automation and DevOps practices in ETL and Cloud

Experience providing testing oversight in Agile team

Should have excellent business communication to interact with Business teams and crossfunctional teams

Responsibilities

Review requirements specifications and technical design documents to understand and feedback

Experience in developing and implementing test strategies for complex initiatives

Estimate prioritize plan and coordinate testing activities

Create automation test framework

Design develop and execute automation scripts

Identify record document thoroughly and track bugs

Strong problem solving skills troubleshooting and root cause analysis skills

Perform thorough regression testing when bugs are resolved

Develop and apply testing processes for new and existing features to meet client needs

Liaise with cross functional teams to identify system requirements

Track quality assurance metrics like defect densities and open defect counts

Stay up to date with new testing tools and test strategies requirements

Support and guide junior team members

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Data Engineer with SQL/ETL/Pyspark

    2 weeks ago

    Bengaluru, Karnataka, India Infosys Finacle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Mandate Skills - SQL, ETL ,hadoop, pyspark, Apache, KafkaRequired Skills5+ years of relevant Data engineering experience using Python or Java as tech be well versed into HadoopDevelopment expertise with 2+ years of experience, in SQL, ETL processes and other similar technologiesSkilled in Identifying and optimizing database queriesStrong understanding of...

  • Pyspark Lead

    1 week ago

    Bengaluru, Karnataka, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled PySpark Lead with 5 to 8 years of experience, based in Bangalore. The ideal candidate will have expertise in PySpark, SQL, ETL/Data Engineering Pipeline, Cloud understanding, CI/CD, Data Modelling, Airflow, Kafka, EMR/Databricks, Snowflake, and Hive.Roles and ResponsibilityDesign and develop scalable data pipelines using PySpark...

  • Technical Lead with ETL/SQL/Pyspark

    1 week ago

    Bengaluru, Karnataka, India EdgeVerve Systems Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Pipeline/ETL (Extract, Transform, Load) processes, API integration, scripting languages (Python), and big data technologies (Trio, Iceberg, DuckDB/Parquet).Database design, data modeling, and data warehousing. SQL and at least one cloud platform.Analytical tools (Superset, Power BI), statistical analysis, and SQL. To derive insights from data.Data governance...

  • Pyspark designer

    6 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for an experienced PySpark AWS Cloud Designer/Developer with a strong background in data integration and ETL. The ideal candidate will have:Over 5 years' experience designing and developing ETL integration patterns using Python and Spark.3+ years working with PySpark for data processing (Databricks or Apache Spark experience is a plus).Proven...

  • Pyspark Developer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Pyspark DeveloperRequired Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range: 4 to 10 YearsJob Location: Hyderabad, Bangalore, Chennai, Kolkata, PuneMust Have:Data Engineer, Python developer with specialty in...

  • Pyspark designer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    We are looking for an experienced PySpark AWS Cloud Designer/Developer with a strong background in data integration and ETL. The ideal candidate will have: - Over 5 years’ experience designing and developing ETL integration patterns using Python and Spark. - 3+ years working with PySpark for data processing (Databricks or Apache Spark experience is a...

  • Sr. Azure Data Engineers(Must

    2 weeks ago

    Bengaluru, Karnataka, India Myliara Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Sr. Azure Data Engineers(Must - Databricks + PySpark)Experience:6-8 yearsBudget: 180LPMHybrid (3 Days in a week WFO)(Bangalore, Pune, Mumbai, Hyderabad)FulltimeImmediate joiners preferred* Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (PySpark) / Azure...

  • QA Engineer – ETL

    5 days ago

    Bengaluru, Karnataka, India Relevance Labs Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Role OverviewWe are seeking a highly skilled QA Engineer with strong expertise in ETL and Data Engineering testing to ensure the quality, accuracy, and reliability of enterprise data pipelines and reporting solutions. The role involves validating data workflows, transformation logic, and reporting systems across multiple ETL tools and databases.### Key...

  • ETL QA with MDM Lead

    7 days ago

    Bengaluru, Karnataka, India, Karnataka People Prime Worldwide Full time

    About Client:Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation....

  • Sr. Azure Data Engineers(Must

    5 days ago

    Bengaluru, Karnataka, India Myliara Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Sr. Azure Data Engineers (Must - Databricks + PySpark)Experience:4 - 8 yrsBudget: OpenHybrid: 3days WFOShift: 11:00 am to 8 pm (Candidate has to be flexible, if required resource should be flexible to overlap with US business hours)Location/Mode: Hybrid (3 Days in a week WFO)(Bangalore, Pune, Mumbai, HyderabadAdvance SQLAzure Data Factory (ADF)Databricks...