Azure/ ETL Testing

2 months ago

mumbai, India JRD Systems Full time

KEY DELIVERABLES & SKILLS

  • Help create test automation by following an existing data automation framework that validates business rules for audience creation across multiple social media channels.
  • Automate recurring ETL processes using the PyTest framework.
  • Validate the flow of data from disparate sources ingested into various data stores, Event Hub and Data Lakes post which data is transformed by workflows built inside Azure Data Factory followed by data getting stored in Azure Databricks.
  • Create and execute manual test cases based on details mentioned as part of functional requirements and technical specifications in order to assure quality and accuracy.
  • Thoroughly test the ETL rules built for data transformation.
  • Develop test queries using SQL, Python or PySpark as per the user stories to validate the data inside various databases including Databricks.
  • Experience with automating tests using Python/PySpark.
  • Exposure to PyTest framework would be an added advantage.
  • Experience building basic workflows or data pipelines inside Azure Data Factory would be a plus.
  • This would be a great add as certain repeated testing of data flows will need to be automated.
  • Knowledge on API testing is good to have. Preparing request block and analyzing API responses in JSON/XML formats.
  • Log appropriate defects within Jira when product does not conform to specifications.
  • Participate in daily stand-ups with project team as part of the agile methodology.
  • Coordinate with development team members regarding defect validation and assist development team members with re creating defects.
  • Create appropriate test cases within TestRail Test Management tool.
  • Update tasks information in Jira as appropriate to communicate progress with onshore test lead.


QUALIFICATION

  • Experience in Azure Databricks is a must.
  • Prior experience with building automation tests using Python/PySpark.
  • SQL/Python skills and the ability to write complex queries inside Azure Databricks.
  • 2+ years working in Azure Databricks, Data Factory, Data Lake.
  • Building basic workflows or data pipelines inside Azure Data Factory would be a plus.
  • Good understanding of file formats including JSON, Parquet, Avro, and others
  • Ability to learn new technologies quickly.
  • Excellent problem-solving skills
  • Basic understanding of software development principles.
  • Knowledge of Jira
  • Ability to handle multiple tasks/projects concurrently and meet deadlines.

  • Azure Databricks Engineer

    3 months ago

    Mumbai, India Selsoftinc Full time

    Experience : 3-5 yearsLocation : MumbaiWalk-in Drive : 23 AugustJob Describtion :Requirements :- Hands-on experience in Azure data bricks & Pyspark to develop ETL pipelines- Working experience in ETL testing including Master Data Management, Data Completeness Data Cataloging, Data Leverage, and Data Quality for various data feeds coming from the source-...

  • Azure Databricks Engineer

    1 month ago

    Mumbai, Maharashtra, India Selsoftinc Full time

    Experience : 3-5 yearsLocation : MumbaiWalk-in Drive : 23 AugustJob Describtion :Requirements :- Hands-on experience in Azure data bricks & Pyspark to develop ETL pipelines- Working experience in ETL testing including Master Data Management, Data Completeness Data Cataloging, Data Leverage, and Data Quality for various data feeds coming from the source-...

  • Azure Databricks Engineer

    4 weeks ago

    Mumbai, India Selsoftinc Full time

    Experience : 3-5 yearsLocation : MumbaiWalk-in Drive : 23 August Job Describtion :Requirements :- Hands-on experience in Azure data bricks & Pyspark to develop ETL pipelines- Working experience in ETL testing including Master Data Management, Data Completeness Data Cataloging, Data Leverage, and Data Quality for various data feeds coming from the source-...

  • Etl Tester

    5 months ago

    Mumbai, India Testriq QA Lab LLP Full time

    **(WORK FROM HOME)** **Job Title** OMNI Offshore ETL Tester **Primary Skills** Java,sql,Azure,Python,Databricks,azure data factory **Essential Job Functions**: Ø Create and execute scenarios to test various API. Preparing request block and analyzing the responses in JSON/XML formats. Ø Validate the flow of data from disparate sources ingested into...

  • Etl Tester

    5 months ago

    Mumbai, India Planit Testing Full time

    Experience - 2-4 Year - Percentage required - at least 60% (10th/12th/Graduation) - Knowledge of STLC and SDLC, should have worked on regression testing, smoke testing, functional testing, usability testing, system integration testing and UAT. - **Knowledge of Database testing is must.(Joins, SQl Queries)**: - Notice Period - Immediate Joinee - 15...

  • Etl Testing

    5 months ago

    Mumbai, Maharashtra, India Virtusa Full time

    Role: Senior ETL Tester 1) Minimum 8+ years of work experience in ETL testing with SQL hands-on 2) Preferred technical knowledge on PySpark and Cloud experience 3) Extensive data analysis skills and Good communication skills 4) Good to have knowledge in Healthcare Insurance **About Virtusa** Teamwork, quality of life, professional and personal...

  • Azure Data Engineer

    1 month ago

    Mumbai, India Techno Wise Full time

    1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and reliability.4. Work closely...

  • Azure Databricks Developer

    4 weeks ago

    Mumbai, India Selsoftinc Full time

    Job DescriptionWe are seeking a highly skilled Azure Databricks Engineer to join our team at Selsoftinc. The ideal candidate will have hands-on experience in Azure data bricks and Pyspark to develop ETL pipelines, as well as working experience in ETL testing including Master Data Management, Data Completeness Data Cataloging, Data Leverage, and Data Quality...

  • Azure Databricks Developer

    4 weeks ago

    Mumbai, Maharashtra, India Selsoft Full time

    Job DescriptionJob Title: Azure Databricks EngineerJob Summary:We are seeking an experienced Azure Databricks Engineer to join our team at Selsoft. The successful candidate will have hands-on experience in Azure data bricks and PySpark to develop ETL pipelines, as well as working experience in ETL testing, including Master Data Management, Data Completeness,...

  • ETL Lead

    4 days ago

    Mumbai, India VFS Global Full time

    ETL Architecture using latest Azure technology stackSupport EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation.Manage project plan, identify new reports scope in collaboration with Project ManagerArchitects an appropriate technical solution to meet business...

  • ETL Lead

    3 days ago

    mumbai, India VFS Global Full time

    - ETL Architecture using latest Azure technology stack - Support EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation. - Manage project plan, identify new reports scope in collaboration with Project Manager - Architects an appropriate technical solution to meet...

  • ETL Lead

    4 days ago

    mumbai, India VFS Global Full time

    - ETL Architecture using latest Azure technology stack- Support EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation.- Manage project plan, identify new reports scope in collaboration with Project Manager- Architects an appropriate technical solution to meet...

  • Etl lead

    5 days ago

    Mumbai, India VFS Global Full time

    - ETL Architecture using latest Azure technology stack- Support EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation.- Manage project plan, identify new reports scope in collaboration with Project Manager- Architects an appropriate technical solution to meet...

  • ETL Lead

    6 days ago

    mumbai, India VFS Global Full time

    ETL Architecture using latest Azure technology stackSupport EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation.Manage project plan, identify new reports scope in collaboration with Project ManagerArchitects an appropriate technical solution to meet business...

  • ETL Lead

    7 days ago

    Mumbai, India VFS Global Full time

    - ETL Architecture using latest Azure technology stack- Support EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation.- Manage project plan, identify new reports scope in collaboration with Project Manager- Architects an appropriate technical solution to meet...

  • ETL Lead

    6 days ago

    mumbai, India VFS Global Full time

    ETL Architecture using latest Azure technology stack Support EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation. Manage project plan, identify new reports scope in collaboration with Project Manager Architects an appropriate technical solution to meet business...

  • ETL Lead

    6 days ago

    mumbai, India VFS Global Full time

    ETL Architecture using latest Azure technology stackSupport EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation.Manage project plan, identify new reports scope in collaboration with Project ManagerArchitects an appropriate technical solution to meet business...

  • ETL Lead

    7 days ago

    Mumbai, India VFS Global Full time

    ETL Architecture using latest Azure technology stackSupport EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation.Manage project plan, identify new reports scope in collaboration with Project ManagerArchitects an appropriate technical solution to meet business...

  • ETL Lead

    3 days ago

    mumbai, India VFS Global Full time

    ETL Architecture using latest Azure technology stack Support EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation. Manage project plan, identify new reports scope in collaboration with Project Manager Architects an appropriate technical solution to meet business...

  • ETL Lead

    7 days ago

    Mumbai, India VFS Global Full time

    ETL Architecture using latest Azure technology stack Support EDW BI solution and infrastructure delivery as a subject matter expert. Strong experience in BI FACT and Dimension tables design and implementation. Manage project plan, identify new reports scope in collaboration with Project Manager Architects an appropriate technical solution to meet business...