Azure Databricks Lead

13 hours ago

Bengaluru, India Gig Consultants Full time

Description :Key Responsibilities :- Lead the design, development, and optimization of large-scale data solutions using Azure Databricks, Azure Data Factory (ADF), and Azure Synapse Analytics. - Architect and implement efficient ETL/ELT pipelines for ingesting, transforming, and processing structured and unstructured data. - Develop scalable data processing frameworks using PySpark and Python within the Azure ecosystem. - Collaborate with data scientists, analysts, and business stakeholders to deliver reliable, high-performance data solutions.- Ensure best practices in data governance, performance tuning, and cost optimization across Azure services. - Mentor and guide junior engineers and drive technical excellence within the data team.Technical Skills & Requirements:- Primary Skills: Azure, Databricks, ADF, PySpark, PythonExperience : 1. 10+ years in Data Warehousing and ETL development 2. 5+ years of hands-on experience with Azure Databricks 3. Strong working knowledge of Azure Data Factory and Azure Synapse 4. Proven expertise in data architecture, pipeline orchestration, and performance optimization. 5. Solid understanding of CI/CD practices, version control (Git), and cloud-native deployment pipelines (ref:hirist.tech)

  • Azure Databricks

    2 weeks ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position: Lead - Azure DatabricksOverall IT experience: 8 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, HyderabadNotice Period: 0 to 30 Days Essential experience:Experience in building ETL / data warehouse transformation processes Direct...

  • Azure Databricks

    4 days ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    **About the job Azure Databricks**: **Position**: Lead - Azure Databricks **Overall IT experience**:8 to 13 years **Primary Skills**:Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse **Secondary Skills**:U-SQL, Spark, Scala, Python **Work Location**:Bengaluru, Hyderabad **Notice Period**:0 to 30 Days **Essential experience**: Experience...

  • Azure Databricks

    7 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Description Position: Azure Databricks Experience: 6 to 10 years Location: Bengaluru Notice Period: 0-30 Days Job Description Required Information Details 1 Role – Senior Sr. DataBricks Developer 2 Required Technical Skill Set Azure Databricks & Pyspark,Python Desired Competencies (Technical/Behavioral Competency) Must-Have** Expertise in Azure...

  • Azure Databricks

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Description Position: Azure Databricks Experience: 6 to 10 years Location: Bengaluru Notice Period: 0-30 Days Job Description Required Information Details 1 Role – Senior Sr. DataBricks Developer 2 Required Technical Skill Set Azure Databricks & Pyspark,Python Desired Competencies (Technical/Behavioral Competency) Must-Have** - Expertise in Azure...

  • Azure Databricks

    6 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Description Position: Azure Databricks Experience: 6 to 10 years Location: Bengaluru Notice Period: 0-30 Days Job Description Required Information Details 1 Role – Senior Sr. DataBricks Developer 2 Required Technical Skill Set Azure Databricks & Pyspark,Python Desired Competencies (Technical/Behavioral Competency) Must-Have** Expertise in Azure...

  • Azure databricks

    6 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Description Position: Azure Databricks Experience: 6 to 10 years Location: Bengaluru Notice Period: 0-30 Days Job Description Required Information Details 1 Role – Senior Sr. Data Bricks Developer 2 Required Technical Skill Set Azure Databricks & Pyspark, Python Desired Competencies (Technical/Behavioral Competency) Must-Have** Expertise in Azure...

  • Azure databricks

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Description Position: Azure Databricks Experience: 6 to 10 years Location: Bengaluru Notice Period: 0-30 Days Job Description Required Information Details 1 Role – Senior Sr. Data Bricks Developer 2 Required Technical Skill Set Azure Databricks & Pyspark, Python Desired Competencies (Technical/Behavioral Competency) Must-Have** Expertise in Azure...

  • Azure Databricks

    7 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Job DescriptionPosition: Azure DatabricksExperience: 6 to 10 yearsLocation: BengaluruNotice Period: 0-30 DaysJob DescriptionRequired Information Details1 Role – SeniorSr. DataBricks Developer2 Required Technical Skill SetAzure Databricks & Pyspark,PythonDesired Competencies (Technical/Behavioral Competency)Must-Have**- Expertise in Azure Databricks &...

  • Azure Databricks

    6 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Job DescriptionPosition: Azure DatabricksExperience: 6 to 10 yearsLocation: BengaluruNotice Period: 0-30 DaysJob DescriptionRequired Information Details1 Role – SeniorSr. DataBricks Developer2 Required Technical Skill SetAzure Databricks & Pyspark,PythonDesired Competencies (Technical/Behavioral Competency)Must-Have**- Expertise in Azure Databricks &...

  • Azure Databricks

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Job DescriptionPosition: Azure DatabricksExperience: 6 to 10 yearsLocation: BengaluruNotice Period: 0-30 DaysJob DescriptionRequired Information Details1 Role – Senior Sr. DataBricks Developer2 Required Technical Skill SetAzure Databricks & Pyspark,PythonDesired Competencies (Technical/Behavioral Competency)Must-Have**Expertise in Azure Databricks &...