Etl Pyspark

6 days ago

Chennai Tamil Nadu, India Virtusa Full time

The ETL Tester is responsible for validating and verifying data extraction transformation and loading processes to ensure data accuracy and integrity This role involves designing and executing test cases identifying data quality issues and collaborating with data engineers to resolve discrepanciesThe ETL Tester will also develop automated testing frameworks to enhance testing efficiency and coverage A strong understanding of ETL processes and data warehousing concepts is essential for success in this role
Minimum Qualification
At least 8 years of IT experience with minimum 5 years of ETL QA experience with below skills
Work experience in ETL testing
Proficiency in SQL with ability to write complex queries in big data ecosystem
Should possess PySpark Work experience
Testing experience in cloud environment AWS
S3 SSS Glue EMR Data Catalog Crawler SQS ETL Jobs Event Bridge
Athena Redshift Spectrum Databases
AWS Commands for running the jobs file process and movements
Experience with Test Automation and DevOps practices in ETL Cloud Systems
Extensive data analysis skills and knowledge in scripting to optimize data testing
Good to have knowledge in Healthcare Insurance
Experience working in Agile team
Should have excellent business communication to interact with Business teams and crossfunctional teams

**Responsibilities**:
Review requirements specifications and technical design documents to understand and derive test scenarios
Experience in developing and implementing test strategies for complex initiatives
Design develop and execute automation scripts
Identify record document thoroughly and track bugs
Strong problem solving skills troubleshooting and root cause analysis skills
Perform thorough regression testing when bugs are resolved
Liaise with cross functional teams to understand system requirements

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Etl Databricks with Aws

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). Develop and maintain robust data pipelines for batch and streaming data using Delta...

  • Gcp + Big Query + Python

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Key Responsibilities: Design and develop robust ETL pipelines using Python, PySpark, and GCP services. Build and optimize data models and queries in BigQuery for analytics and reporting. Ingest, transform, and load structured and semi-structured data from various sources. Collaborate with data analysts, scientists, and business teams to understand data...

  • Etl Tester

    2 weeks ago

    Chennai, Tamil Nadu, India Oxfaa Pvt.Ltd Full time

    **Role Description** This is a full-time on-site role for an ETL Tester located in Chennai. The ETL Tester will be responsible for executing test cases, performing software testing, and ensuring quality assurance throughout the ETL process. The ETL Tester will work closely with the development team to identify issues, analyze data, and ensure the accuracy...

  • Etl QA Pyspark

    13 hours ago

    Chennai, Tamil Nadu, India Virtusa Full time

    ETL QA Position Summary Minimum Qualification At least 7 years of IT experience with minimum 5 years of experience in below skills Tech Skills Proficiency in ETL Testing and developing automation framework testcases in atleast one scripting language Strong SQL skills with experience in handling big data using ETL tools eg Informatica Testing experience in...

  • Pyspark Reltio

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Key Responsibilities: Develop and maintain data pipelines using PySpark in distributed computing environments (e.g., AWS EMR, Databricks). Integrate and synchronize data between enterprise systems and the Reltio MDM platform. Design and implement data transformation, cleansing, and enrichment processes. Collaborate with data architects, business analysts,...

  • ETL Tester

    1 day ago

    tamil nadu, India Tata Consultancy Services Full time

    Role ; ETL TesterRequired Technical Skill Set : (ETL)SQL and Python programming languagesLocation: Pan IndiaMust-Have ETL Knowledge, SQL Programming, Azure, Databricks, Python Good-to-Have Python Automation ,Databricks,Pyspark,QuerySurge Automation Responsibility of / Expectations from the Role 1 Should have experience in database/ETL concepts & testing 2...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India MP DOMINIC AND CO Full time

    Job Summary - Design develop and implement scalable data pipelines and streaming use cases using PySpark and Spark on a distributed computing platform - Possess strong programming skills in Spark streaming - Have familiarity with cloud platforms like GCP - Gain experience in big data technologies such as Hadoop Hive and HDFS - Perform ETL operations...

  • ETL tester

    2 weeks ago

    Chennai, Tamil Nadu, India Novature Tech Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Keywords:ETL Testing Python PysparkExperience:5 - 10 yearsDesignation / Role:ETL TesterLocation:ChennaiJob Description:ob Overview We are seeking a skilled ETL Tester with strong expertise in Python and PySpark to join our QA team. The role involves validating large-scale data pipelines, ensuring data quality, and automating test processes in modern data...

  • ETL Tester

    22 hours ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Role ; ETL TesterRequired Technical Skill Set : (ETL)SQL and Python programming languagesLocation: Pan IndiaMust-Have ETL Knowledge, SQL Programming, Azure, Databricks, Python Good-to-Have Python Automation ,Databricks,Pyspark,QuerySurge Automation Responsibility of / Expectations from the Role 1 Should have experience in database/ETL concepts & testing 2...

  • Etl Developer

    3 weeks ago

    Chennai, India Decision Point Full time

    Key Responsibilities: Design, develop, and optimize scalable and reliable ETL pipelines using Python and PySpark. Extract data from diverse data sources and transform it to meet analytical and business needs. Implement robust data validation, error handling, and quality checks within ETL pipelines. Work with large-scale datasets and ensure efficient...