Azure DataBricks Quality Assurance

4 weeks ago


Bangalore, Karnataka, India Visara Full time

Role: Azure ETL Tester., Databricks tester

- Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources.


- Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes.

- Well versed in Databricks, SQL Database, Azure Data Factory, Azure Data Lake


- Must have hands-on experience in PySpark, SparkSQL, T-SQL Should be able to go through requirements, design specs and create appropriate test scenarios across various layers/stages of data pipelines.

- Should be able to write reusable PySpark and T-SQL script to validate data across layers.

- Experience of working in Databricks Delta Lake will be highly desirable.

- Ideally should have worked in a team using Agile methodology.

- Appreciation of data, its quality, and its usage for business benefit Very good communication and written skills

(ref:hirist.tech)
  • Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Career Soft Solutions Full time

    Job Description :- 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure Data...


  • Bangalore, Karnataka, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...

  • Data Scientist

    4 weeks ago


    Bangalore, Karnataka, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

  • ETL Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...


  • Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...

  • Cloud Engineer

    4 days ago


    Bangalore, Karnataka, India Andor Tech Full time

    Experience Required: 5+ YearsImmediate Joiners Preferred: Max 15 Design, deploy, and maintain cloud-based solutions on the Azure platform, including Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.- Develop and optimize software applications and scripts using Python, SQL, PySpark, and Unix scripting to...


  • Bangalore, Karnataka, India Randstad India Full time

    Job Title : Microsoft Azure Data Services. Location : PAN INDIA. Experience : 8 -10 Years. Roles & Responsibilities :- Design, build, and configure applications to meet business process and application requirements using Microsoft Azure Data Services.- Collaborate with cross-functional teams to deliver impactful data-driven solutions.- Develop and maintain...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...

  • Vsquare Systems

    4 weeks ago


    Bangalore, Karnataka, India Vsquare Systems Pvt. Ltd. Full time

    Databricks AdministratorJob Title : Databricks Administrator. Location : Bangalore / Hybrid. Job Type : Full-time. Job Description : .- We are seeking a skilled and experienced Databricks Administrator to join our team.- As a Databricks Administrator, you will be responsible for the installation, configuration, maintenance, and optimization of our Databricks...

  • Data Modeler

    4 weeks ago


    Bangalore, Karnataka, India Whizz HR Full time

    We are seeking an experienced and skilled Data Modeler to join our team on a remote basis. The ideal candidate will have extensive expertise in data modeling and a strong background in utilizing Azure Data Lake and Databricks. This is an active position with a high priority, offering a competitive rate and the potential for a long-term engagement.Key...

  • Data Modeler

    4 weeks ago


    Bangalore, Karnataka, India TalentPulse Consultant Full time

    Role : Data ModelerJob Description :We are seeking an experienced and skilled Data Modeler to join our team on a remote basis.The ideal candidate will have extensive expertise in data modeling and a strong background in utilizing Azure Data Lake and Databricks.This is an active position with a high priority, offering a competitive rate and the potential for...

  • Azure Engineer

    2 weeks ago


    Bangalore, Karnataka, India Onward Technologies Limited Full time

    Job Description :- Develop scripts to process both structured and unstructured data, ensuring efficient data processing and management.- Recommend, develop, and implement strategies to improve data reliability, efficiency, and quality, driving continuous improvement in our data processes.- Support the translation of business needs into technical system...


  • Bangalore, Karnataka, India CGI Full time

    Job Title : Azure Data EngineerExperience : 4 to 10 yearsCategory : Software Development/ EngineeringLocation : Bangalore onlyNotice Period: Immediate / Max 30 DaysEmployment Type : Full TimeQualifying Criteria :- 4+ years of experience in Azure Data Engineer - ADF, ADB, ADLS- Notice period / Joining duration - Immediately / Less than 30 Days- Willing to...


  • Bangalore, Karnataka, India TalentPulse Consultant Full time

    About the job :Responsibilities :- Install, configure, and maintain Databricks environments to support data engineering and analytics activities.- Collaborate with cross-functional teams to understand data requirements and optimize Databricks clusters accordingly.- Monitor Databricks performance, troubleshoot issues, and implement solutions to ensure system...

  • Azure Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Talent Bee Consulting Pvt Ltd Full time

    About the job :Ideal Candidate :- 3+ years in Azure Data Engineering- Very good at ADF (Azure Data Factory)- Hands-on experience in designing and implementing data solutions on AzureOrganization :A global provider of Automation solutions in Assembly, Inspection, and Testing for manufacturing industries. With a mission to enhance the efficiency of the...

  • Data Architect

    4 weeks ago


    Bangalore/Hyderabad, Karnataka, India Job Store Consulting Full time

    Designation : Data ArchitectExp : 12+ yrsLocation : Bangalore / Hyderabad / Indore (Hybrid mode of work)Notice : Immediate-15 daysShift timings : 1 PM-10 PM / 2 PM-11 PM (IST)Key skills : Data Architecture, ADF, Azure Purview, Databricks, Azure Fabric Services, API, MySQL, Knowledge in Python, ETL and Data ModelingWhat you will do:Design and develop data...

  • AWS Architect

    4 weeks ago


    Bangalore, Karnataka, India Freelancer Recruiter Full time

    Over 10-14 years of IT experience- Deep expertise in S3, Redshift, Spectrum, Glue, SQS, and SNS services.- Very good Data lake concepts and at least 1 end to end project of data lake using AWS- Deep understanding of architecture and work experience on Databricks, hands-on programming with Data Frames, Python, Scala.- Experience with large data sets, data...

  • Data Scientist

    4 weeks ago


    Bangalore, Karnataka, India Magna Hire Full time

    [Quation Solutions]: Data Scientist - Utilize advanced machine learning techniques to extract insights and drive business decisions.- Collaborate with cross-functional teams to develop and deploy data-driven solutions.- Leverage databricks for data processing, analysis, and model development.- Apply expertise in the retail industry or pricing analytics to...


  • Bangalore, Karnataka, India Meved Solutions Full time

    Responsibilities :Ensure that standards and safety regulations are observed.Address and discuss issues and proposed solutions with superiors.Document quality assurance activities and create audit reports.Make recommendations for improvement.Create training materials and operating manuals.Requirements :Proven work experience as a Quality Assurance Specialist...

  • Databricks Engineer

    3 days ago


    Bangalore, Karnataka, India Hunarstreet Technologies Full time

    Databricks Role Overview :As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipelines to optimizing workflows and fostering cross-functional collaboration, you will...