Lead - Azure Databricks, Pyspark, SQL

3 weeks ago


Bengaluru, India Infogain Full time

Position: Lead - Azure Databricks

Overall IT experience: 9 to 13 years

Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse

Secondary Skills: U-SQL, Spark, Scala, Python

Work Location: Bengaluru, Pune, Mumbai, Noida, Gurugram

Mode of work: Hybrid at Infogain office locations mentioned above

Notice Period: 0 to 30 Days


Essential experience:

Experience in building ETL / data warehouse transformation processes.

Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).

Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala).

Evaluating the performance and applicability of multiple tools against customer requirements. Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Coding complex U-SQL, Spark (Scala or Python), T-SQL.

Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks).



  • Bengaluru, Karnataka, India Infogain Full time

    Position: Lead - Azure Databricks Overall IT experience: 9 to 13 years Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, Python Work Location: Bengaluru, Pune, Mumbai, Noida, Gurugram Mode of work: Hybrid at Infogain office locations mentioned above Notice Period: 0 to 30 Days Essential...


  • Bengaluru, India Infogain Full time

    Position: Lead - Azure Databricks Overall IT experience: 9 to 13 years Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, Python Work Location: Bengaluru, Pune, Mumbai, Noida, Gurugram Mode of work: Hybrid at Infogain office locations mentioned above Notice Period: 0 to 30 Days...


  • Bengaluru, India Infogain Full time

    Position: Lead - Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysEssential...


  • Bengaluru, India Infogain Full time

    Position: Lead - Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysEssential...


  • Bengaluru, Karnataka, India Infogain Full time

    Job Title: Lead - Azure DatabricksCompany: InfogainYears of IT Experience: 9 to 13 yearsPrimary Skills:Azure DatabricksHadoopHivePigImpalaETLData warehouseSecondary Skills:U-SQLSparkScalaPythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of Work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysKey...


  • Bengaluru, Karnataka, India Infogain Full time

    Position:Lead - Azure DatabricksOverall IT experience:9 to 13 yearsPrimary Skills:Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills:U-SQL, Spark, Scala, PythonWork Location:Bengaluru, Pune, Mumbai, Noida, GurugramMode of work:Hybrid at Infogain office locations mentioned aboveNotice Period:0 to 30 DaysEssential...


  • Bengaluru, India Notus Full time

    Job Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...


  • Bengaluru, India Notus Full time

    Job Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...


  • Bengaluru, India Horigine Consulting Pvt. Ltd Full time

    DescriptionWe are seeking a highly skilled and experienced Azure Databricks Developer with expertise in PySpark and SparkSQL. As an Azure Databricks Developer, you will be responsible for designing, developing, and implementing data processing solutions using PySpark and SparkSQL. You will work closely with our team to understand business requirements and...

  • ETL Data Engineer

    2 months ago


    Bengaluru, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • ETL Data Engineer

    3 weeks ago


    Bengaluru, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • Azure Databricks

    2 weeks ago


    Bengaluru, India CIEL HR Services Full time

    Work experience-Above 6 years Notice period-Immediate to 15 days Work Mode-Hybrid Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile Project and familiar with Scrum/SAFe ceremonies Expertise in Azure Data Bricks, ADF,...

  • Data Engineer

    2 months ago


    Bengaluru, India Career Soft Solutions Full time

    Job Description :- 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure Data...


  • Bengaluru, Karnataka, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role : We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines. This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for largescale data...

  • Azure Data Engineer

    1 month ago


    Bengaluru, India Manvision Technologies Full time

    PySpark Development experience, especially in Spark SQL and Complex TransformationsPython development experienceExperience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure DatabasesAzure SkillsMust have working experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL DatabasesAzure DevOpsAzure AD Integration, Service...


  • Bengaluru, Karnataka, India Visara Full time

    Role: Azure ETL Tester., Databricks tester Experienced in endtoend of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources.Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. Well versed in Databricks, SQL Database, Azure Data...

  • Azure Databricks

    2 months ago


    Bengaluru, India CIEL HR Services Full time

    Work experience-Above 6 years Notice period-Immediate to 15 days Work Mode-Hybrid Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile Project and familiar with Scrum/SAFe ceremonies Expertise in Azure Data Bricks, ADF,...

  • Azure Databricks

    3 weeks ago


    Bengaluru, India CIEL HR Services Full time

    Work experience-Above 6 years Notice period-Immediate to 15 days Work Mode-Hybrid Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile Project and familiar with Scrum/SAFe ceremonies Expertise in Azure Data Bricks, ADF,...


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Title: Senior Data Engineer Location: Remote Experience Level: 5-7 Years Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, particularly with Azure Databricks, Pyspark, Medallion Architecture, and Data Lakes. If you are...

  • Databricks Lead

    2 months ago


    Bengaluru, India Hexaware Technologies Full time

    Description:Primary Skills: Databricks with Pyspark, PythonSecondaryskills; ADF7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.4+ years of work experience in Databricks, Pyspark and Python project development workExpertise in Bigdata Eco systems like HDFS and SparkStrong...