Azure DataBricks Quality Assurance

1 month ago


Bangalore, India Visara Full time

Role: Azure ETL Tester., Databricks tester

- Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources.


- Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes.

- Well versed in Databricks, SQL Database, Azure Data Factory, Azure Data Lake


- Must have hands-on experience in PySpark, SparkSQL, T-SQL Should be able to go through requirements, design specs and create appropriate test scenarios across various layers/stages of data pipelines.

- Should be able to write reusable PySpark and T-SQL script to validate data across layers.

- Experience of working in Databricks Delta Lake will be highly desirable.

- Ideally should have worked in a team using Agile methodology.

- Appreciation of data, its quality, and its usage for business benefit Very good communication and written skills

(ref:hirist.tech)

  • Bangalore, Karnataka, India Visara Full time

    Role: Azure ETL Tester., Databricks tester- Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources. - Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. - Well versed in Databricks, SQL Database, Azure...

  • Data Engineer

    1 month ago


    Bangalore, India Career Soft Solutions Full time

    Job Description : - 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure...

  • Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Career Soft Solutions Full time

    Job Description :- 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure Data...


  • Bangalore, India ResourceTree Global Services Full time

    Job Title : Senior Databricks Data EngineerSkillset : Databricks, Datalake Architecture, AzureExperience : 6 - 8 yearsLocation : ChennaiJob Summary : We are seeking an experienced Senior Databricks Data Engineer with a very good understanding of Databricks, Lakehouse concepts, with architecture experience, and a sound knowledge of Azure and its services....


  • bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...


  • Bangalore, Karnataka, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...


  • Bangalore, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...


  • Bangalore, India ResourceTree Global Services Full time

    Resource Tree Global Services Pvt Ltd is hiring Senior Databricks Data Engineer for one of its leading client in Content & Data Analytics. Below are the details .Job Title : Senior Databricks Data EngineerSkills Required : Azure, Databricks, Datalake, Python/Scala/Java, Data Migration Strategies, Data Warehiusing, Data Modelling, Strong knowledge on Data...


  • bangalore, India Marlabs LLC Full time

    Marlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – Work Location -...

  • Data Scientist

    4 weeks ago


    bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

  • Technical Lead

    2 weeks ago


    bangalore, India Marlabs LLC Full time

    Marlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – .Work Location -...

  • Data Scientist

    2 weeks ago


    Bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

  • Data Scientist

    4 weeks ago


    Bangalore, Karnataka, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

  • ETL Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • ETL Data Engineer

    2 weeks ago


    Bangalore, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...


  • Mumbai/Bangalore, Maharashtra, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...


  • Mumbai/Bangalore, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Data Engineer

    2 weeks ago


    Bangalore/Hyderabad/Chennai, India Mouri Tech (P) Ltd Full time

    Job Title : Azure Data EngineerWork Location : Hyderabad , Bangalore, ChennaiExperience : 5+ yearsRequired Skills : Azure, Python, Azure DatabricksResponsibilities : . 5+ years as a data engineer.- 2- 3 years' experience in python- 2 years of experience in Azure SQL- Experience in DataBricks- Familiarity with Azure DevOps & database CI/CD.- Knowledge of...


  • Bangalore City, India Infogain Full time

    Position: Lead Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysEssential...

  • Databricks

    2 weeks ago


    Bangalore City, India Hexaware Technologies Full time

    Looking for 5+ Yrs of experience Exp Range: 5 to 9 Yrs (Not less than 5 Yrs)Work Location: Bangalore Weekend drive at 20th Apr'24 for 5+ Yrs of expMandatory Skill: Azure, Databricks with Py spark Primary Tech skills – AZURE ,Databricks ,Pyspark, SQLSecondary Tech skills – ADF, SynapseResponsibilities: Experience in Pyspark, SQL, Cloud data warehouse like...