Azure Databricks Engineer

1 week ago


India Optivalue tek consulting Full time

Key Responsibilities :

  • Work on client projects to deliver AWS, PySpark, Databricks based Data engineering & Analytics solutions.
  • Build and operate very large data warehouses or data lakes.
  • ETL optimization, designing, coding, & tuning big data processes using Apache Spark.
  • Build data pipelines & applications to stream and process datasets at low latencies.
  • Show efficiency in handling data tracking data lineage, ensuring data quality, and improving discoverability of data.

Technical Experience :

  • Minimum of 2 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark, Databricks SQL, Data pipelines using Delta Lake.
  • Minimum of 5 years of experience years of experience in ETL, Big Data/Hadoop and data warehouse architecture & delivery.
  • Minimum of 3 years of experience years in real time streaming using Kafka/Kinesis
  • Minimum 4 year of Experience in one or more programming languages Python, Java, Scala.
  • Experience using airflow for the data pipelines in min 1 project.
  • 2 years of experience developing CICD pipelines using GIT, Jenkins, Docker, Kubernetes, Shell Scripting, Terraform
  • Good knowledge on Data Warehousing

Professional Attributes:

  • Ready to work in C Shift (1 PM 11 PM)
  • A Client facing skills: solid experience working in client facing environments, to be able to build trusted relationships with client stakeholders.
  • Good critical thinking and problemsolving abilities
  • Health care knowledge
  • Good Communication Skills

Educational Qualification :
Bachelor of Engineering / Bachelor of Technology

Additional Information :
Data Engineering, PySpark, AWS, Python Programming Language, Apache Spark, Databricks, Hadoop, Certifications in Databrick or Python or AWS.
)
  • DevOps Engineer

    1 month ago


    india Sam manpower services & Career LLP Full time

    Require a DevOps Engineer Azure Databricks ETL Pipeline Specialist. Key Pointers :- Building CI/CD pipelines for migrating in Databricks .- Building Jenkins and Bitbucket.- Azure Fundamentals : A solid understanding of the core concepts, services, and infrastructure components of the Azure cloud platform.- Cloud Architecture : Proficiency in designing and...

  • Data Engineer

    3 weeks ago


    india Excelra Knowledge Solutions Full time

    Job Description : At Excelra ,We are seeking a highly skilled Data Engineer with expertise in Databricks, SQL, Python, and data flow pipelines. The ideal candidate will have experience in creating Azure Data Factory (ADF) pipelines, deploying code in Azure DevOps using Git Repos and YAML files, and exposure to Snowflake. This role involves designing,...


  • india Notus Full time

    Job Title : Azure Databricks Engineer Location : Pan India Job Type : Immediate to 15-Day Joiner Experience Level : 6+ Years Job Summary : We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory,...


  • India Talent-Max Consultant Full time

    Experience: 4-7 YearsLocation : Bhilai, Indore, BangaloreJob Description :We are seeking a skilled DataBricks Engineer to join our team. In this role, you will be responsible for engineering reliable data pipelines for sourcing, processing, distributing, and storing data in various ways using cloud data platform infrastructure. Your primary focus will be on...

  • DevOps Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Sam manpower services & Career LLP Full time

    Require a DevOps Engineer Azure Databricks ETL Pipeline Specialist. Key Pointers :- Building CI/CD pipelines for migrating in Databricks .- Building Jenkins and Bitbucket.- Azure Fundamentals : A solid understanding of the core concepts, services, and infrastructure components of the Azure cloud platform.- Cloud Architecture : Proficiency in designing and...

  • DevOps Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Sam manpower services & Career LLP Full time

    Require a DevOps Engineer Azure Databricks ETL Pipeline Specialist. Key Pointers :- Building CI/CD pipelines for migrating in Databricks .- Building Jenkins and Bitbucket.- Azure Fundamentals : A solid understanding of the core concepts, services, and infrastructure components of the Azure cloud platform.- Cloud Architecture : Proficiency in designing and...

  • DevOps Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Sam manpower services & Career LLP Full time

    Require a DevOps Engineer Azure Databricks ETL Pipeline Specialist. Key Pointers :- Building CI/CD pipelines for migrating in Databricks .- Building Jenkins and Bitbucket.- Azure Fundamentals : A solid understanding of the core concepts, services, and infrastructure components of the Azure cloud platform.- Cloud Architecture : Proficiency in designing and...

  • Azure Data Engineer

    2 weeks ago


    india Visionyle Full time

    Position Name: Azure Data Engineer Position Mode: PermanentExperience: 6 YearsJoining Location: Remote Notice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating...

  • Azure Data Engineer

    2 months ago


    india Visionyle Full time

    Position Name: Azure Data Engineer Position Mode: PermanentExperience: 6 YearsJoining Location: Remote Notice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating...

  • Data Engineer

    2 months ago


    india HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data...

  • Senior Data Engineer

    1 month ago


    india Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...


  • india Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • Databricks Engineer

    3 weeks ago


    india Arting Digital Private Limited Full time

    Job Description Job Title:-Databricks Engineer Experience:-7+yrLocation:-Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode:- OnsiteQualification:-B.TECH, M.tech, MCASkills:- Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Excelra Knowledge Solutions Full time

    Job Description : At Excelra ,We are seeking a highly skilled Data Engineer with expertise in Databricks, SQL, Python, and data flow pipelines. The ideal candidate will have experience in creating Azure Data Factory (ADF) pipelines, deploying code in Azure DevOps using Git Repos and YAML files, and exposure to Snowflake. This role involves designing,...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Excelra Knowledge Solutions Full time

    Job Description : At Excelra ,We are seeking a highly skilled Data Engineer with expertise in Databricks, SQL, Python, and data flow pipelines. The ideal candidate will have experience in creating Azure Data Factory (ADF) pipelines, deploying code in Azure DevOps using Git Repos and YAML files, and exposure to Snowflake. This role involves designing,...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Excelra Knowledge Solutions Full time

    Job Description : At Excelra ,We are seeking a highly skilled Data Engineer with expertise in Databricks, SQL, Python, and data flow pipelines. The ideal candidate will have experience in creating Azure Data Factory (ADF) pipelines, deploying code in Azure DevOps using Git Repos and YAML files, and exposure to Snowflake. This role involves designing,...

  • Data Engineering Lead

    1 month ago


    india QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ years Location : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...


  • Anywhere in India/Multiple Locations/Bangalore Notus Full time

    Job Title : Azure Databricks Engineer Location : Pan India Job Type : Immediate to 15-Day Joiner Experience Level : 6+ Years Job Summary : We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory,...


  • Anywhere in India/Multiple Locations/Bangalore Notus Full time

    Job Title : Azure Databricks Engineer Location : Pan India Job Type : Immediate to 15-Day Joiner Experience Level : 6+ Years Job Summary : We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory,...


  • Anywhere in India/Multiple Locations/Bangalore, IN Notus Full time

    Job Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...